Lead Data Engineer

2 months ago


Houston, United States Harnham Full time

Title: Lead Data Engineer


Location: Houston, TX 77077 - Onsite 4 days per week.


Overview of Role:

As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.


Company Description:

Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.


Role Description:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.


Skills and Experience:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.


Benefits:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus (20%)
  • 401(k) Matching Program


Please note: Candidates must be authorized to work in the United States to be considered at this time.


  • Lead Data Engineer

    3 weeks ago


    Houston, Texas, United States The University of Texas at Austin Full time

    Job Title: Lead Data EngineerJoin The University of Texas at Austin as a Lead Data Engineer and play a key role in building a trusted, integrated, and scalable information infrastructure that transforms complex UT data into valued insights for data-informed decisions.About the RoleWe are seeking a highly skilled and experienced Lead Data Engineer to lead our...


  • Houston, Texas, United States Harnham Full time

    Job Title: Data Engineering LeadAbout the Role:At Harnham, we are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Apache Spark, Hadoop, and Kafka.Key Responsibilities:Design and implement cloud-based data...

  • Data Engineering Lead

    3 weeks ago


    Houston, Texas, United States Harnham Full time

    Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing, implementing, and architecting new AI/ML initiatives at the enterprise level.About the Role:This is a unique opportunity to join a brand new team as our client's...

  • Lead Data Engineer

    3 weeks ago


    Houston, Texas, United States CenterPoint Energy Full time

    Job SummaryAs a Lead Data Engineer at CenterPoint Energy, you will be responsible for developing and maintaining data pipelines that support analytical analysis. You will partner with various business clients, data scientists, and data analysts to ensure that the company has access to the data it needs to make informed decisions. You will also be responsible...

  • Lead Data Engineer

    3 weeks ago


    Houston, Texas, United States The Friedkin Group Full time

    Job SummaryWe are seeking a highly skilled Lead Data Engineer to join our team at The Friedkin Group. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing robust, scalable data infrastructure to support advanced analytics, machine learning projects, and real-time data processing needs.As a Lead Data...

  • Data Engineering Lead

    1 month ago


    Houston, Texas, United States Harnham Full time

    Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing, implementing, and architecting new AI/ML initiatives at the enterprise level.About the Role:This is a unique opportunity to join a brand new team as our client's...

  • Data Engineering Lead

    2 weeks ago


    Houston, Texas, United States Harnham Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Harnham. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines, leveraging cloud services, and collaborating with data scientists to deliver high-quality data solutions.Key...

  • Lead Data Engineer

    3 weeks ago


    houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Lead Data Engineer

    1 day ago


    houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Lead Data Engineer

    2 months ago


    Houston, United States Harnham Full time

    As a Lead Data Engineer you will:Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient...


  • Houston, Texas, United States Asset Living Full time

    Data Engineering and Science LeadAsset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. With a strong emphasis on innovation and results, we empower our team members to lead by example, collaborate, and evolve.We are seeking a highly skilled Data Engineering and Science Lead to join our dynamic team....


  • Houston, United States Amerit Consulting Full time

    Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks a Lead Cloud Data Engineer for a 100% remote role. Key Responsibilities: Lead a team of data engineers in designing, building, and maintaining high-performance software systems. Architect,...


  • Houston, Texas, United States DATAGRATION - Connecting Data | Powering Decisions Full time

    Job Summary:We are seeking a highly skilled Data Solutions Engineer to join our team at Datagration. As a Data Solutions Engineer, you will be responsible for implementing E&P and ESG related data solutions in the Oil and Gas industry, addressing customer challenges in a customer-facing environment.Key Responsibilities:Analyze customer requirements and...


  • Houston, Texas, United States Asset Living Full time

    About Asset LivingAsset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. Founded in 1986, Asset Living has decades of experience delivering exceptional value to our partners.We empower each other to lead by example, collaborate, and evolve - inspired by our belief that we can continually improve as...


  • Houston, Texas, United States Publicis Sapient Full time

    Job Title: Senior Manager Data EngineeringPublicis Sapient is a global digital transformation partner that empowers organizations to embrace digital innovation, enhance customer experiences, and accelerate business growth through a blend of strategy, consulting, agile engineering, and problem-solving creativity.Job DescriptionWe are seeking a Senior Manager...

  • Lead Data Engineer

    22 hours ago


    Houston, TX, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Data Engineer

    3 weeks ago


    Houston, Texas, United States VC5 Consulting Full time

    Job Title: Senior Data EngineerWe are seeking a highly motivated and experienced Senior Data Engineer to join our team at VC5 Consulting. As a key member of our Enterprise Data Engineering team, you will play a critical role in designing and developing scalable and efficient data solutions on the Azure platform.Key Responsibilities:Define and drive the data...

  • Data Engineer

    1 month ago


    Houston, United States VC5 Consulting Full time

    We are looking for highly-motivated individuals who enjoy working as part of a team in a dynamic and entrepreneurial work environment. Position Summary: The company is initiating new initiatives within the Enterprise Data Engineering team where an experienced Azure Data Engineer.  We are seeking someone who can demonstrate their qualifications and...


  • Houston, United States JPMorganChase Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within Corporate Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a...

  • Lead Data Architect

    3 weeks ago


    Houston, Texas, United States Harnham Full time

    Lead Data EngineerAt Harnham, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines, utilizing cloud environments and services for efficient data handling and processing.Key Responsibilities:Design and implement data...