Lead Data Engineer

4 weeks ago

Houston, United States Robert Half Full time

The role

This is a great opportunity to join one of the largest integrated energy and commodity trading companies in the world.

We are looking for a hands-on Lead Data Engineer with experience in the Power & Gas Commodity markets of North America. You will work on full stack applications to support Front Office Trading across commodities and must be passionate about technology with experience developing enterprise-wide solutions.

You will need to partner with end-users to understand process, requirements and analyze problems to design solutions and ultimately deliver tangible business value & benefit.

Key responsibilities

  • for development and operations of Front Office Data warehouse hosted in Amazon Web Services (AWS).
  • and design scalable data pipelines and infrastructure to support the organization's data needs.
  • a team of data engineers in developing, testing, and deploying data pipelines and ETL processes.
  • with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver solutions.
  • best practices and standards for data engineering processes and ensure adherence to them.
  • and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.
  • and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness.
  • technical leadership and mentorship to junior members of the data engineering team.
  • and resolve issues related to data pipeline failures, data quality, and performance bottlenecks.
  • closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.
  • updated on industry trends and emerging technologies in data engineering and apply them to enhance existing systems.

Skill and Experience

  • or MS in Computer Science or relevant experience.
  • 10+ years of experience in designing, building, and deploying large-scale data pipelines and ETL processes.
  • & Gas Commodities background is a plus.
  • proficiency in programming languages such as Python.
  • Server expert with experience in Database Administration (DBA). In-depth knowledge of data modeling, database design.
  • with modern day data warehouse platforms like Snowflake and Data bricks
  • with AWS cloud platform.
  • with containerization technologies such as Docker and orchestration tools like Kubernetes.
  • problem-solving and analytical skills.
  • communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
  • experience in a leadership or mentoring role is preferred.
  • in relevant technologies (e.g., AWS Certification) are a plus.

  • Lead Data Engineer

    2 weeks ago

    Houston, United States Infinity Consulting Solutions Full time

    Responsibilities: - Lead a team of 2-3 data engineers to deliver high-quality solutions. - Design, develop, and maintain data pipelines and ETL processes. - Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. - Architect and implement scalable data solutions on AWS cloud infrastructure. - Ensure data...

  • Lead Data Engineer

    2 weeks ago

    Houston, United States iSphere Full time

    iSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast, you will collaborate with...

  • Lead Data Engineer

    6 days ago

    Houston, United States iSphere Full time

    Job DescriptionJob DescriptioniSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast,...

  • Lead Data Engineer

    3 weeks ago

    Houston, United States iSphere Full time

    Job DescriptionJob DescriptioniSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast,...

  • Lead Data Engineer

    1 week ago

    Houston, United States JPMorgan Chase Full time

    Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorgan Chase within the Legal Technology team, you are an integral part of an agile team that works to enhance, build,...

  • Lead Data Engineer

    1 week ago

    Houston, United States JPMorgan Chase Full time

    Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorgan Chase within the Legal Technology Team, you are an integral part of an agile team that works to enhance, build,...

  • Systems Engineering Configuration

    3 weeks ago

    Houston, United States Mb Solutions Inc Full time

    Are you passionate about human space exploration, understanding the origins of the universe, and working with a passionate and diverse team to make a difference? If you are, we need you! We need your talent, teamwork, and energy to help us achieve great things that inspire people all over the globe. We need you to bring creative ideas and diverse...

  • Systems Engineering Configuration

    2 weeks ago

    Houston, United States MbSolutions Inc Full time

    Job DescriptionJob DescriptionAre you passionate about human space exploration, understanding the origins of the universe, and working with a passionate and diverse team to make a difference? If you are, we need you! We need your talent, teamwork, and energy to help us achieve great things that inspire people all over the globe. We need you to bring creative...

  • Lead Data Scientist

    2 weeks ago

    Houston, United States Tiger Analytics Full time

    Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce. We are looking...

  • Lead Business Analyst

    6 days ago

    Houston, TX, United States Resource Data Full time

    As a Lead Business Analyst with Resource Data, you will be responsible for eliciting, analyzing and documenting requirements as needed, including determination of system impact and software configuration. You will also participate with customers and internal functions as appropriate throughout the development, testing, and implementation processes....

  • Lead Python Data engineer------12+years of experience.

    3 weeks ago

    Houston, United States Hirextra -World's First Staffing Aggregator Full time

    Role : Lead Python Data Engineer—-----12+years of experienceLocation:Houston, TX (Onsite) Duration : 12 monthsJob Description:We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Python Data Engineer will work closely with Business domain experts...

  • Lead Python Data engineer------12+years of experience.

    1 day ago

    Houston, United States Hirextra -World's First Staffing Aggregator Full time

    Role : Lead Python Data Engineer—-----12+years of experienceLocation:Houston, TX (Onsite) Duration : 12 monthsJob Description:We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Python Data Engineer will work closely with Business domain experts...

  • Lead Python Data engineer------12+years of experience.

    3 weeks ago

    Houston, United States Hirextra -World's First Staffing Aggregator Full time

    Role : Lead Python Data Engineer—-----12+years of experienceLocation:Houston, TX (Onsite) Duration : 12 monthsJob Description:We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Python Data Engineer will work closely with Business domain experts...

  • Lead Data Scientist

    2 weeks ago

    Houston, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote...

  • Data Engineer

    2 weeks ago

    Houston, United States Vantage Bank Full time

    JOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 5151 San Felipe St., Suite 730, Houston TX 77056 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...

  • Lead Data Scientist

    2 weeks ago

    Houston, Texas, United States Tiger Analytics Full time

    Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce. We are looking...

  • Contract - Data Scientist Lead

    1 week ago

    Houston, United States Smartbridge Full time

    Job DescriptionJob DescriptionPosition: Data Scientist LeadContract: 6 monthsLocation: Onsite Houston TexasExperience Level: 5-7 YearsJob Summary:This leadership role involves managing a team of data scientists, guiding the development of machine learning models, and overseeing the deployment and maintenance of data-driven solutions.Responsibilities:Develop...

  • Data Engineer

    4 weeks ago

    Houston, United States Client of Reputable Staffing & Recruiting Firm Full time

    Job DescriptionJob DescriptionBrookwoods Group is working with a Houston-based Energy Company to identify a Data Engineer. The Data Engineer role is a technical individual contributor role, focused on supporting data infrastructure to enable data analytics and machine learning. This role involves designing and building data pipelines, ensuring data...

  • Data Engineer

    4 weeks ago

    Houston, Texas, United States Apollose Full time

    Responsiblities Developing and maintaining scalable reusable data pipelines for both streaming and batch requirements to support continuing increases in data volume and complexity for user accesses via dashboard report self-service data platform to structured and unstructured data. Data processing & QC checks across multiple layers of data warehouses...

  • Data Engineer

    3 weeks ago

    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerOffice Status: RemoteRequirements:Standard data engineering responsibilities such as building pipelines, etc. 5-10 years of experiencePython coding experienceDatabricks,Trino, DBT core expeienceSQL backgroundData Modeling