Senior Data Engineer

3 weeks ago

Houston, United States Harnham Full time

Title: Senior Data Engineer

Location: Houston, TX 77077 - Onsite 4 days per week.

Overview of Role:

As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.

Company Description:

Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.

Role Description:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.

Skills and Experience:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.

Benefits:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus
  • 401(k) Matching Program


Please note: Candidates must be authorized to work in the United States to be considered at this time.

  • Senior Chemical Engineer

    3 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!Description: Senior Chemical EngineerAbout the opportunity:We are currently seeking a full-time Senior Chemical Engineer to help us achieve our company mission. This person will be part of the Process team which is responsible for...

  • Senior Chemical Engineer

    2 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!Description: Senior Chemical EngineerAbout the opportunity:We are currently seeking a full-time Senior Chemical Engineer to help us achieve our company mission. This person will be part of the Process team which is responsible for...

  • Senior Data Engineer

    5 days ago

    Houston, United States VC5 Consulting Full time

    Senior Data Engineer *Senior Level* 7 years of US experience as a Data Engineer and overall 11 years of experience as a Data Engineer Must haves: Data bricks on Azure Python Spark SQL Power BI US Citizen or GC only Nice to haves: Azure Data factory Knowledge of .Net development is a plus #10154  

  • Senior Data Engineer

    1 week ago

    Houston, United States VC5 Consulting Full time

    Senior Data Engineer *Senior Level* 7 years of US experience as a Data Engineer and overall 11 years of experience as a Data Engineer Must haves: Data bricks on Azure Python Spark SQL Power BI US Citizen or GC only Nice to haves: Azure Data factory Knowledge of .Net development is a plus #10154  

  • Senior Piping Designer

    3 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Piping Designer

    2 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Piping Designer

    2 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Data Engineer

    5 days ago

    Houston, United States Virtual Full time

    ** Sr. Data Engineer ** ** Direct Hire – no C2C **  eligible to work without sponsorship ** onsite in West Houston ** We have the following Senior Data Engineer role that plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures. This position demands a blend of systems engineering, data integration, and data...

  • Senior Data Engineer

    6 days ago

    Houston, United States BJSS Full time

    About Us We're an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organizations and delivered solutions that millions of people use every day. In the last 30 years we won several awards, including...

  • Senior Data Engineer

    6 days ago

    Houston, United States BJSS Full time

    About Us We're an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organizations and delivered solutions that millions of people use every day. In the last 30 years we won several awards, including...

  • Senior Software Engineer

    2 weeks ago

    Houston, United States Resource Data Full time

    Job DescriptionJob DescriptionAs a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems. Key...

  • Senior Software Engineer

    2 weeks ago

    Houston, United States Resource Data Full time

    Job DescriptionJob DescriptionAs a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems. Key...

  • Senior Software Engineer, Machine Learning/AI

    2 weeks ago

    Houston, United States Resource Data Inc Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Increase your chances of an interview by reading the following overview of this role before making an application. Your work will...

  • Analyst, Senior Data Engineering

    6 days ago

    Houston, United States Epco Corp Full time

    Analyst, Senior Data Engineering - 000EG2 Description Enterprise Products Partners L.P. is one of the largest publicly traded partnerships and a leading North American provider of midstream energy services to producers and consumers of natural gas, NGLs, crude oil, refined products and petrochemicals. Our services include: natural gas gathering, treating,...

  • Senior Data Engineer

    2 weeks ago

    Houston, United States Vaco Full time

    ** Sr. Data Engineer ** ** Direct Hire - no C2C ** eligible to work without sponsorship ** onsite in West Houston ** We have the following Senior Data Engineer role that plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures. This position demands a blend of systems engineering, data integration, and data...

  • Senior Data Engineer

    1 month ago

    Houston, United States Jade Business Services LLC Full time

    Job DescriptionJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team and play a key role in designing, developing, and maintaining our data infrastructure on GCP. You will leverage your deep expertise in Spark to build scalable and efficient data pipelines for large-scale data processing.Responsibilities:Design, develop, and...

  • Senior Data Engineer | Onsite in Houston, TX

    1 month ago

    Houston, United States Vaco Full time

    ***Senior Data Engineer******Onsite in Houston TX-77077*** Job SummaryThe Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced...

  • Senior Data Engineer | Onsite in Houston, TX

    1 month ago

    Houston, United States Vaco Full time

    ***Senior Data Engineer******Onsite in Houston TX-77077*** Job SummaryThe Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced...

  • Senior Software Engineer, Machine Learning/AI

    2 weeks ago

    Houston, United States Resource Data Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Your work will involve translating complex problems into practical AI applications, ensuring that our clients not only keep up but...

  • Sr Data Engineer

    3 weeks ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...