Data Engineering Lead

4 weeks ago


Houston, Texas, United States Harnham Full time
Lead Data Engineer

Job Summary:

We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing, implementing, and architecting new AI/ML initiatives at the enterprise level.

About the Role:

This is a unique opportunity to join a brand new team as our client's business grows. You will be working on a combination of systems engineering, data analytics, and data integration projects. Your expertise will be crucial in helping us scale and implement our data infrastructure.

Key Responsibilities:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.

Requirements:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.

What We Offer:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus (20%)
  • 401(k) Matching Program

Please note: Candidates must be authorized to work in the United States to be considered at this time.


  • Lead Data Engineer

    2 weeks ago


    Houston, Texas, United States The University of Texas at Austin Full time

    Job Title: Lead Data EngineerJoin The University of Texas at Austin as a Lead Data Engineer and play a key role in building a trusted, integrated, and scalable information infrastructure that transforms complex UT data into valued insights for data-informed decisions.About the RoleWe are seeking a highly skilled and experienced Lead Data Engineer to lead our...

  • Data Engineering Lead

    2 weeks ago


    Houston, Texas, United States Harnham Full time

    Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing, implementing, and architecting new AI/ML initiatives at the enterprise level.About the Role:This is a unique opportunity to join a brand new team as our client's...

  • Lead Data Engineer

    2 weeks ago


    Houston, Texas, United States CenterPoint Energy Full time

    Job SummaryAs a Lead Data Engineer at CenterPoint Energy, you will be responsible for developing and maintaining data pipelines that support analytical analysis. You will partner with various business clients, data scientists, and data analysts to ensure that the company has access to the data it needs to make informed decisions. You will also be responsible...

  • Lead Data Engineer

    2 weeks ago


    Houston, Texas, United States The Friedkin Group Full time

    Job SummaryWe are seeking a highly skilled Lead Data Engineer to join our team at The Friedkin Group. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing robust, scalable data infrastructure to support advanced analytics, machine learning projects, and real-time data processing needs.As a Lead Data...


  • Houston, Texas, United States Harnham Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines, leveraging cloud services, and collaborating with data scientists to deliver high-quality data solutions.Key...


  • Houston, Texas, United States Asset Living Full time

    Data Engineering and Science LeadAsset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. With a strong emphasis on innovation and results, we empower our team members to lead by example, collaborate, and evolve.We are seeking a highly skilled Data Engineering and Science Lead to join our dynamic team....


  • Houston, Texas, United States DATAGRATION - Connecting Data | Powering Decisions Full time

    Job Summary:We are seeking a highly skilled Data Solutions Engineer to join our team at Datagration. As a Data Solutions Engineer, you will be responsible for implementing E&P and ESG related data solutions in the Oil and Gas industry, addressing customer challenges in a customer-facing environment.Key Responsibilities:Analyze customer requirements and...


  • Houston, Texas, United States Asset Living Full time

    About Asset LivingAsset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. Founded in 1986, Asset Living has decades of experience delivering exceptional value to our partners.We empower each other to lead by example, collaborate, and evolve - inspired by our belief that we can continually improve as...


  • Houston, Texas, United States Thompson Engineering Full time

    Job OverviewThompson Engineering is seeking a highly skilled Senior Geotechnical Engineer to join our team. This role is essential for overseeing and executing a variety of geotechnical projects, ranging from small-scale to large-scale endeavors.The Senior Geotechnical Engineer will be responsible for leading project teams, ensuring the technical quality of...


  • Houston, Texas, United States Publicis Sapient Full time

    Job Title: Senior Manager Data EngineeringPublicis Sapient is a global digital transformation partner that empowers organizations to embrace digital innovation, enhance customer experiences, and accelerate business growth through a blend of strategy, consulting, agile engineering, and problem-solving creativity.Job DescriptionWe are seeking a Senior Manager...

  • Data Engineer

    2 weeks ago


    Houston, Texas, United States VC5 Consulting Full time

    Job Title: Senior Data EngineerWe are seeking a highly motivated and experienced Senior Data Engineer to join our team at VC5 Consulting. As a key member of our Enterprise Data Engineering team, you will play a critical role in designing and developing scalable and efficient data solutions on the Azure platform.Key Responsibilities:Define and drive the data...

  • Lead Data Architect

    2 weeks ago


    Houston, Texas, United States Harnham Full time

    Lead Data EngineerAt Harnham, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines, utilizing cloud environments and services for efficient data handling and processing.Key Responsibilities:Design and implement data...

  • Safety Data Analyst

    1 week ago


    Houston, Texas, United States Universal Engineering Sciences Full time

    Safety Data Analyst Job DescriptionAt Universal Engineering Sciences, we are seeking a highly skilled Safety Data Analyst to join our team. As a Safety Data Analyst, you will play a critical role in supporting our safety objectives by utilizing data to identify trends, improve safety practices, and ensure compliance with safety regulations.Key...

  • Data Engineer

    2 weeks ago


    Houston, Texas, United States Eateam Full time

    Job Title: ETL DeveloperJob Description:We are seeking an experienced ETL Developer to join our team at Eateam Inc. in Plano, TX. The successful candidate will have a strong background in data engineering, with expertise in architecting, developing, and implementing end-to-end scalable data applications and data pipelines.Key Responsibilities:* Design,...

  • Data Engineer

    3 weeks ago


    Houston, Texas, United States Eateam Full time

    Job Title: ETL DeveloperWe are seeking an experienced ETL Developer to join our team at Eateam Inc. in Plano, TX. As an ETL Developer, you will be responsible for designing, implementing, and maintaining automated data pipelines using Informatica Cloud (IICS) and other technologies.Key Responsibilities:Design and develop end-to-end scalable data applications...

  • Data Engineer

    5 days ago


    Houston, Texas, United States The Select Group Full time

    Data Engineer Job DescriptionThe Select Group is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for developing, constructing, testing, and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing.Key Responsibilities:Develop...

  • Senior Data Engineer

    2 weeks ago


    Houston, Texas, United States VC5 Consulting Full time

    Job Title: Senior Data EngineerAt VC5 Consulting, we are seeking an experienced Senior Data Engineer to lead our data engineering initiatives. As a key member of our team, you will be responsible for designing and developing scalable and efficient data solutions on the Azure platform.Key Responsibilities:Define and drive the data engineering strategy for the...


  • Houston, Texas, United States Empower Pharmacy Full time

    Empower Pharmacy Data Engineering DirectorAt Empower Pharmacy, we are seeking a highly skilled Data Engineering Director to lead our data-driven initiatives. This pivotal role will be responsible for shaping the future of our data analytics infrastructure, including Artificial Intelligence and Machine Learning, to support our transition to the Snowflake data...


  • Houston, Texas, United States Fluence Corporation Full time

    Fluence Corporation, a pioneering leader in intelligent energy storage and optimization software for renewables and storage, is seeking a senior director engineering and data science to spearhead the development of cutting-edge AI-based auto-bidding solutions for its Mosaic platform. As a key member of the executive leadership team, you will be responsible...

  • Data Engineer

    2 weeks ago


    Houston, Texas, United States Saxon Global Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Saxon Global. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines using Azure Synapse Analytics or Data BricksConfigure Azure SQL or...