Lead Data Engineer

2 months ago


Houston, United States Harnham Full time

Title: Lead Data Engineer


Location: Houston, TX 77077 - Onsite 4 days per week.


Overview of Role:

As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.


Company Description:

Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.


Role Description:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.


Skills and Experience:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.


Benefits:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus (20%)
  • 401(k) Matching Program


Please note: Candidates must be authorized to work in the United States to be considered at this time.


  • Data Engineering Lead

    3 weeks ago


    Houston, Texas, United States Harnham Full time

    Job Title: Data Engineering LeadAbout the Role:At Harnham, we are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Apache Spark, Hadoop, and Kafka.Key Responsibilities:Design and implement cloud-based data...

  • Lead Data Engineer

    3 weeks ago


    houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Lead Data Engineer

    1 month ago


    houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...


  • Houston, United States Amerit Consulting Full time

    Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks a Lead Cloud Data Engineer for a 100% remote role. Key Responsibilities: Lead a team of data engineers in designing, building, and maintaining high-performance software systems. Architect,...


  • Houston, Texas, United States Asset Living Full time

    About Asset LivingAsset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. Founded in 1986, Asset Living has decades of experience delivering exceptional value to our partners.We empower each other to lead by example, collaborate, and evolve - inspired by our belief that we can continually improve as...


  • Houston, United States Asset Living Full time

    Company Overview Asset Living is a third-party management firm and a proven partner in fostering thriving communities nationwide. Founded in 1986, Asset Living has decades of experience delivering exceptional value to our partners. Since the beginning, our undeniable passion has driven our organic growth from a small property management firm to one of the...

  • Lead Data Engineer

    3 weeks ago


    Houston, TX, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Data Engineer

    2 months ago


    Houston, United States VC5 Consulting Full time

    We are looking for highly-motivated individuals who enjoy working as part of a team in a dynamic and entrepreneurial work environment. Position Summary: The company is initiating new initiatives within the Enterprise Data Engineering team where an experienced Azure Data Engineer.  We are seeking someone who can demonstrate their qualifications and...

  • Data Engineer

    4 weeks ago


    Houston, Texas, United States The Select Group Full time

    Data Engineer Job DescriptionThe Select Group is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for developing, constructing, testing, and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing.Key Responsibilities:Develop...


  • Houston, Texas, United States Empower Pharmacy Full time

    Empower Pharmacy Data Engineering DirectorAt Empower Pharmacy, we are seeking a highly skilled Data Engineering Director to lead our data-driven initiatives. This pivotal role will be responsible for shaping the future of our data analytics infrastructure, including Artificial Intelligence and Machine Learning, to support our transition to the Snowflake data...


  • Houston, Texas, United States Fluence Corporation Full time

    Fluence Corporation, a pioneering leader in intelligent energy storage and optimization software for renewables and storage, is seeking a senior director engineering and data science to spearhead the development of cutting-edge AI-based auto-bidding solutions for its Mosaic platform. As a key member of the executive leadership team, you will be responsible...

  • Senior Data Engineer

    4 weeks ago


    Houston, Texas, United States Eateam Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Eateam INC.**Job Summary:**As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and architectures.**Responsibilities:**- Design and develop end-to-end scalable data applications and data...

  • Senior Data Engineer

    2 months ago


    Houston, United States VC5 Consulting Full time

    Position Summary:The company is initiating new initiatives within the Enterprise Data Engineering team where an experienced Azure Data Engineer. We are seeking someone who can demonstrate their qualifications and experience in all the items listed below.Reporting to the Data Engineering Manager, the Sr Data Engineer is a software engineer responsible for...

  • Senior Data Engineer

    1 month ago


    houston, United States VC5 Consulting Full time

    Position Summary:The company is initiating new initiatives within the Enterprise Data Engineering team where an experienced Azure Data Engineer. We are seeking someone who can demonstrate their qualifications and experience in all the items listed below.Reporting to the Data Engineering Manager, the Sr Data Engineer is a software engineer responsible for...

  • Lead Data Scientist

    3 weeks ago


    Houston, United States Resource Informatics Group Full time

    Lead Data Scientist Location: Houston, Texas Duration: 6+ months We are currently seeking an experienced data scientist to join the Big Data and Advanced Analytics department. As part of the Data Analytics team, the Lead Data Scientist will work closely with the Data Engineering team and business functions to solve real-world oil and gas midstream problems...


  • Houston, Texas, United States Phaxis Full time

    Job Title: Data Engineering DirectorAt Phaxis, we are seeking an experienced Data Engineering Director to lead our data platform team. The ideal candidate will have a strong background in software and data engineering, with a proven track record of delivering high-quality data solutions.**Responsibilities:*** Deliver the next iteration of our internal data...

  • Senior Data Engineer

    4 weeks ago


    Houston, Texas, United States ShiftCode Analytics Full time

    Job Description:At ShiftCode Analytics, we are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have 12+ years of experience in designing and implementing data pipelines, with a strong focus on Python and ETL. Prior experience with data lakes is also required.Key Responsibilities:Design and...

  • Data Engineer

    1 month ago


    Houston, Texas, United States Jobot Full time

    Job Title: Data EngineerJobot is seeking a highly skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining databases, data systems, and analytic solutions that turn data into knowledge.Responsibilities:Develop and maintain large-scale data processing systems and...


  • HOUSTON, United States US6469 Sysco Payroll, Division of Sysco Resources Services, LLC Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...


  • HOUSTON, United States Sysco Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...