Data Engineer Lead

5 days ago

Boston, United States Boston Energy Trading and Marketing LLC Full time

Boston Energy Trading & Marketing (BETM) is looking for an innovative Lead Data Engineer who is passionate about data and analytics, highly motivated and can take technical ownership of data solutions with an emphasis on engineering efficiency and on-time delivery. This position is a critical hands-on role partnering closely with other product teams to build and enhance solutions that drive value for our clients. The Lead Data Engineer will focus on designing backend data models, architecting data flows, maintaining the stability of the platform and beyond. The role requires a strong ability to work independently while collaborating with other IT teams at BETM. This position will report to the head of IT Team and will be in our Boston, MA office.


Responsibilities:

  • Provide technical leadership in data architecture, ensuring best practices for data modeling, storage, and retrieval.
  • Lead the scoping, design and implementation of complex features including multi-layered data workflows.
  • Oversee data governance and quality, ensuring data accuracy, consistency, and compliance with industry standards.
  • Build and maintain data models and data pipelines to enable performant and scalable products.
  • Work with multiple sources of data, storage systems, and building processes and pipelines to provide cohesive datasets for analysis and modeling.
  • Ensure a high-quality code base by writing and reviewing performant & scalable, well-tested code.
  • Collaborate with cross-functional teams to define data requirements and design solutions that align with business objectives.
  • Mentor software engineers & data engineers, establishing data best practices and creating up-skilling opportunities for the team.
  • Drive innovative improvements to team development processes.
  • Build and manage a team of data engineers.


Qualifications:

  • Bachelor’s or higher degree in Computer Science, Mathematics, Physics, Quantitative Finance, Engineering, Statistics or equivalent field.
  • 7+ years of data engineering experience in an agile production environment.
  • Experience handling large amounts of fundamental datasets and market data.
  • Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines.
  • Experience working with enterprise databases and modern cloud-based environments leveraging industry best practices to manage large data sets supporting analytics and regression.
  • Experience in Python, Java/.Net technologies to manage data lifecycle across data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting.
  • Experience utilizing DevOps framework tools. Familiarity with Microsoft Azure tools is a plus
  • Effective communication and collaboration skills to work with both technical and non-technical stakeholders.
  • Results-oriented team player, with the ability to handle a rapidly changing set of projects and priorities while maintaining a strong professional presence.
  • Strong analytical skillset with demonstrated attention to detail.
  • Fast learner with the ability to adapt quickly and work in a dynamic environment.
  • Excellent time management skills.


Desired Experience:

  • Hands-on professional programming experience across commodities or other financial markets
  • Experience across power industry and power trading is a big plus. Knowledge of US ISO power markets strongly preferred.
  • Familiarity with industry best practices for collection and use of data.
  • Strong technologist eager to learn new technologies and frameworks.
  • Project management skills and a demonstrated ability to understand complex information product constructs.

  • Data Engineer Lead

    5 days ago

    Boston, United States Boston Energy Trading and Marketing LLC Full time

    Boston Energy Trading & Marketing (BETM) is looking for an innovative Lead Data Engineer who is passionate about data and analytics, highly motivated and can take technical ownership of data solutions with an emphasis on engineering efficiency and on-time delivery. This position is a critical hands-on role partnering closely with other product teams to build...

  • Lead Data Engineer

    2 weeks ago

    Boston, United States Saviance Full time

    Job Title- Lead Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) bout BigRio: BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis,...

  • Lead Data Engineer

    2 weeks ago

    Boston, United States VSG Business Solutions LLC Full time

    Job DescriptionJob DescriptionWork is HYBRID Monday-Friday w/Video interviews. **Due to client restrictions only USC, GC or EAD-GC may be submitted.** LEAD Data Engineer with streaming data sources to support the building out of a data consolidation project (Retail Spine). Primary skills; Java/Springboot (version 17), MongoDB, Confluent/Kafka, Avro Schema...

  • Lead Data Engineer

    3 weeks ago

    Boston, United States Zelis Full time

    Summary Build High level technical design both for Streaming and batch processing systems Design and build reusable components, frameworks and libraries at scale to support analytics data products Perform POCs on new technology, architecture patterns Design and implement product features in collaboration with business and Technology stakeholders Anticipate,...

  • Lead Quantitative Data Engineer

    2 weeks ago

    Boston, United States Selby Jennings Full time

    About: Selby Jennings has partnered with a leading Investment Manager to support their Asset Management technology team's search for a Principal Quant Data Engineer. This team is responsible for architecting, developing, and maintaining systems that support quantitative trading.Qualifications:7 YOE in full time positions across Software/Data Engineering or...

  • Lead Quantitative Data Engineer

    2 weeks ago

    Boston, United States Selby Jennings Full time

    About: Selby Jennings has partnered with a leading Investment Manager to support their Asset Management technology team's search for a Principal Quant Data Engineer. This team is responsible for architecting, developing, and maintaining systems that support quantitative trading.Qualifications:7 YOE in full time positions across Software/Data Engineering or...

  • Senior Lead Data Engineer

    1 month ago

    Boston, United States Capital One Full time

    West Creek 3 (12073), United States of America, Richmond, VirginiaSenior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Senior Lead Data Engineer

    4 weeks ago

    Boston, United States Capital One Full time

    West Creek 3 (12073), United States of America, Richmond, VirginiaSenior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Bilingual Data Team Lead

    4 weeks ago

    Boston, United States NTT DATA, Europe & LATAM, Branch in USA, Inc. Full time

    **Bilingual Data Team Lead** NTT DATA is a team of more than 139,000 diverse professionals, operating in more than 50 countries throughout the world. The sectors where we have activities include: telecommunications, finance, industry, utilities, energy, public administration and health. Our essence has led us to the forefront of technology, breaking...

  • Remote Lead Data Engineer

    2 weeks ago

    Boston, United States Insight Global Full time

    Position: Lead Data Engineer (Databricks/AWS) Duration: 6 Month Contract – w/extensions or conversion Location: Remote ; East Coast!!! Must Haves: 2-3 years exp. as a data engineer 3 years of RECENT experience with Data Bricks Must be their most relevant experience!! Experience with Cloud ( Azure, GCP, or AWS) Experience with SQL – they will be writing...

  • Remote Lead Data Engineer

    2 weeks ago

    Boston, United States Insight Global Full time

    Position: Lead Data Engineer (Databricks/AWS) Duration: 6 Month Contract - w/extensions or conversion Location: Remote ; East Coast!!! Must Haves: 2-3 years exp. as a data engineer 3 years of RECENT experience with Data Bricks Must be their most relevant experience!! Experience with Cloud ( Azure, GCP, or AWS) Experience with SQL - they will be writing...

  • Lead Data Engineer

    4 weeks ago

    Boston, United States Motion Recruitment Full time

    This world-renowned pharmaceutical company just opened up a brand-new innovation lab to spearhead the digital transformation of one of their main business lines. This new platform is designed to fuel the research for thousands of chemists and biologists, and directly impact millions of customers. The Director of Data and Machine Learning is looking to hire a...

  • Lead Data Engineer

    4 weeks ago

    Boston, United States Motion Recruitment Full time

    This world-renowned pharmaceutical company just opened up a brand-new innovation lab to spearhead the digital transformation of one of their main business lines. This new platform is designed to fuel the research for thousands of chemists and biologists, and directly impact millions of customers. The Director of Data and Machine Learning is looking to hire a...

  • Lead Data Engineer

    1 month ago

    Boston, United States Motion Recruitment Full time

    This world-renowned pharmaceutical company just opened up a brand-new innovation lab to spearhead the digital transformation of one of their main business lines. This new platform is designed to fuel the research for thousands of chemists and biologists, and directly impact millions of customers.The Director of Data and Machine Learning is looking to hire a...

  • Lead Data Engineer

    4 weeks ago

    Boston, United States Motion Recruitment Full time

    This world-renowned pharmaceutical company just opened up a brand-new innovation lab to spearhead the digital transformation of one of their main business lines. This new platform is designed to fuel the research for thousands of chemists and biologists, and directly impact millions of customers.The Director of Data and Machine Learning is looking to hire a...

  • Data Engineer

    3 weeks ago

    Boston, United States MassMutual Full time

    The Opportunity At MassMutual, we are dedicated to empowering millions of individuals to achieve financial independence, a commitment that fuels our journey to create highly interactive digital experiences for our customers. As part of our Data Platform Data Engineering team, we are seeking Data Engineers who are enthusiastic about utilizing data to drive...

  • Data Management Lead

    1 week ago

    Boston, United States The Brixton Group, Inc. Full time

    Location: Hybrid Position Type: Contract The Data Management Lead will play a pivotal role in enabling the Data Governance team by providing advanced tooling solutions and creating Proof of Concepts (POCs) to streamline data processes. This role requires a deep understanding of data management principles, data cataloging, data lineage, data governance, and...

  • Data Management Lead

    2 weeks ago

    Boston, United States The Brixton Group, Inc. Full time

    Location: HybridPosition Type: Contract The Data Management Lead will play a pivotal role in enabling the Data Governance team by providing advanced tooling solutions and creating Proof of Concepts (POCs) to streamline data processes. This role requires a deep understanding of data management principles, data cataloging, data lineage, data governance, and...

  • Data Management Lead

    2 weeks ago

    Boston, United States The Brixton Group, Inc. Full time

    Location: HybridPosition Type: Contract The Data Management Lead will play a pivotal role in enabling the Data Governance team by providing advanced tooling solutions and creating Proof of Concepts (POCs) to streamline data processes. This role requires a deep understanding of data management principles, data cataloging, data lineage, data governance, and...

  • Data Engineer

    3 weeks ago

    Boston, United States Sasaki Full time

    Data Engineer Sasaki is one of the leading multi-disciplinary design firms in the world, with 320 employees based primarily in the Boston region and over 700 awards for excellence in our architecture, site, and planning and urban design practices. Our Information Services team is looking for a Data Engineer to formulate a workable methodology for...