Senior Data Engineer | Onsite in Houston, TX

2 weeks ago


Crockett, United States Vaco Full time

***Senior Data Engineer***

All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description.

***Onsite in Houston TX-77077***

Job Summary

The Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.

This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced analytics, machine learning projects, and real-time data processing needs.

Responsibilities:

  • Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.
  • Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to support operational and analytical applications, ensuring data quality and accessibility.
  • Utilize ETL tools and frameworks (e.g., Apache Airflow, Talend) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.
  • Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.
  • Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.
  • Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.
  • Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.

Minimum Qualifications

  • Bachelor's degree in computer science, MIS, or other business discipline or equivalent combination of education and/or experience.
  • 8+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures.
  • Strong experience in AWS and Azure cloud services, with hands-on experience in integrating cloud storage and compute services with Databricks.
  • Expertise in developing ETL/ELT workflows.
  • Comprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native
  • data offerings
  • Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage.
  • Proficient in SQL and programming languages relevant to data engineering (Python, Java, Scala).
  • Hands on RDBMS experience (data modeling, analysis, programming, stored procedures)
  • Familiarity with machine learning model deployment and management practices is a plus.

Certificates, Licenses, Registrations:

Preferred: Databricks Certified Associate Developer for Apache Spark, AWS Certified Solutions Architect, Azure Data Engineer Associate, or other relevant certifications.


  • Senior Data Engineer

    1 month ago


    Crockett, United States IntagHire Full time

    Senior Data Engineer (Python/SQL) - Onsite in Houston, TX. The following information aims to provide potential candidates with a better understanding of the requirements for this role. No C2C please. Permanent position with full benefits. The Senior Data Engineer (Python/SQL) may end up working on various projects over time, involving potentially...

  • Data Engineer

    2 weeks ago


    Crockett, United States IntagHire Full time

    Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits package The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below. About the Role: We are seeking a skilled mid to senior level Python Data Engineer to join our clients’ team in...

  • Product Owner

    2 weeks ago


    Crockett, United States Vaco Full time

    ***Product Owner - Data & Analytics*** ***Onsite in Houston, TX - 77077*** Make sure to apply quickly in order to maximise your chances of being considered for an interview Read the complete job description below. ***Experience in Logistics industry required*** About the role: As a Product Owner in the Data & Analytics organization, you will be on the...


  • Crockett, United States Insight Global Full time

    Position Title: Embedded Software Engineer Locations: Houston, TX or Boulder, CO- onsite 2-3 days/week Duration: Direct Placement/Permanent Employee Salary Range: $100-$150k Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below. Must haves: 10-15 years of experience as a Software Engineer...


  • Crockett, United States Element Staffing Services Full time

    Job Title: Senior Process Engineer All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description. Job Description: Element Staffing is recruiting for a Senior Process Engineer for a specialty chemical plant in SE Houston. The Senior Process Engineer is responsible for monitoring,...

  • Lead Data Scientist

    2 weeks ago


    Crockett, United States Saxon Global Full time

    Data Scientist - Contract - 100% onsite in Houston Client: Enterprise Products Partners Location: Houston, TX Schedule: 100% onsite (Mon - Fri, Fridays are half days) Please double check you have the right level of experience and qualifications by reading the full overview of this opportunity below. We're looking for a Data Scientist who's ready to solve...


  • Crockett, United States Element Staffing Services Full time

    Job Title: Senior Process Engineer All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description. Job Description: Element Staffing is recruiting for a Senior Process Engineer for a specialty chemical plant in SE Houston. The Senior Process Engineer is responsible for monitoring,...

  • Data Analyst

    6 days ago


    Crockett, United States Insight Global Full time

    Client: Murphy Oil CorpPosition: Data AnalystDuration: Contract-to-Hire (6-9 month contract) Must be able to work directly on W2 (No C2C)Rate: $30-$45/hr based on experienceSchedule: 2 days onsite, 3 days WFHJob DescriptionInsight Global is looking for a Data Analyst to join the data science team of one of our large oil and gas clients in the Houston area!...


  • Crockett, United States Burnett Specialists Staffing | Recruiting Full time

    Senior Structural/Civil Engineer Our client is hiring several Engineers in Civil/Structural Design and project management. With over 25 years in the Houston, Texas marketplace, this employer has a strong brand recognition with a consistent and increasing project load allowing for excellent career growth and development. This has the opportunity for a hybrid...

  • Data Architect

    2 weeks ago


    Crockett, United States Birlasoft Full time

    Birlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. It is a consultative and design-thinking approach that makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified CK Birla Group, Birlasoft with its 12,500+...

  • Data Analyst

    1 week ago


    Crockett, United States Insight Global Full time

    Client: Murphy Oil Corp Position: Data Analyst Duration: Contract-to-Hire (6-9 month contract) Must be able to work directly on W2 (No C2C) Rate: $30-$45/hr based on experience Schedule: 2 days onsite, 3 days WFH Job Description Insight Global is looking for a Data Analyst to join the data science team of one of our large oil and gas clients in the Houston...


  • Crockett, United States Mackinnon & Partners Full time

    Our client is a leader in the custom design, development, and manufacturing of heavy load-moving, positioning, and restraining systems. Their solutions serve various markets worldwide, including Military & Super Yacht Shipyards, Offshore Drilling Platforms, and Floating Production Units. They are seeking a Senior Structural Engineer (Offshore Solutions) for...


  • Crockett, United States Helix Earth Technologies Full time

    Helix Earth Technologies Inc. (Houston, TX 77004) is a rapidly growing startup on a mission to combat climate change by transforming the way we cool our planet and is transforming the way we do carbon capture and sequestration (CCS). We're looking for exceptional talent to join our journey. Born from innovations originally designed for NASA's space...


  • Crockett, United States Helix Earth Technologies Full time

    Helix Earth Technologies Inc. (Houston, TX 77004) is a rapidly growing startup on a mission to combat climate change by transforming the way we cool our planet and is transforming the way we do carbon capture and sequestration (CCS). We're looking for exceptional talent to join our journey. Born from innovations originally designed for NASA's space...


  • Crockett, United States INTELLECTT INC Full time

    Role: Master Data Lead- SAP PM Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button. Location: Houston, TX - Onsite Job Description & Skill Requirement: PLANT MAINTENANCE (SAP-PM) DATA MANAGEMENT Master equipment list (MEL) / asset register preparation & Physical asset...


  • Crockett, United States Techwave Full time

    Snowflake Data Architect || Location: Houston, TX Are you the right candidate for this opportunity Make sure to read the full description below.Duration: Long Term || Day one onsite Experience Required : 12+ years of experience .9+ years of experience in DWH, 4 years of experience in implementing DWH on Snowflake.Experience in end-to-end data analytics...


  • Crockett, United States talisman advisory partners Full time

    Hiring in the following locations -Houston. TX| Chicago, IL | Denver, CO | Phoenix, AZ Check below to see if you have what is needed for this opportunity, and if so, make an application asap. Join this prominent global firm renowned for its excellence in engineering and construction services. They are currently seeking a Senior Process Engineer with a...


  • Crockett, United States Engtal Inc Full time

    Senior Design Engineer Apply fast, check the full description by scrolling below to find out the full requirements for this role. Location: Houston, TX Overview: We are seeking a highly skilled Senior Design Engineer with a unique blend of experience in downhole oil & gas equipment design and composites technology. The ideal candidate will possess a strong...


  • Crockett, United States Techwave Full time

    Snowflake Data Architect Learn more about the general tasks related to this opportunity below, as well as required skills. Location: Houston, TX Duration: Long Term Day one onsite Experience Required : 12+ years of experience . 9+ years of experience in DWH, 4 years of experience in implementing DWH on Snowflake. Experience in end-to-end data analytics...


  • Crockett, United States Techwave Full time

    Snowflake Data Architect || Location: Houston, TX Are you the right candidate for this opportunity Make sure to read the full description below. Duration: Long Term || Day one onsite Experience Required : 12+ years of experience . 9+ years of experience in DWH, 4 years of experience in implementing DWH on Snowflake. Experience in end-to-end data...