Senior Data Engineer | Onsite in Houston, TX

3 weeks ago

Houston, United States Vaco Full time

***Senior Data Engineer***

***Onsite in Houston TX-77077***

Job Summary

The Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.

This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced analytics, machine learning projects, and real-time data processing needs.

Responsibilities:

  • Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.
  • Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to support operational and analytical applications, ensuring data quality and accessibility.
  • Utilize ETL tools and frameworks (e.g., Apache Airflow, Talend) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.
  • Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.
  • Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.
  • Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.
  • Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.

Minimum Qualifications

  • Bachelor's degree in computer science, MIS, or other business discipline or equivalent combination of education and/or experience.
  • 8+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures.
  • Strong experience in AWS and Azure cloud services, with hands-on experience in integrating cloud storage and compute services with Databricks.
  • Expertise in developing ETL/ELT workflows.
  • Comprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native
  • data offerings
  • Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage.
  • Proficient in SQL and programming languages relevant to data engineering (Python, Java, Scala).
  • Hands on RDBMS experience (data modeling, analysis, programming, stored procedures)
  • Familiarity with machine learning model deployment and management practices is a plus.

Certificates, Licenses, Registrations:

Preferred: Databricks Certified Associate Developer for Apache Spark, AWS Certified Solutions Architect, Azure Data Engineer Associate, or other relevant certifications.

  • Senior Data Engineer

    2 months ago

    Houston, United States IntagHire Full time

    Senior Data Engineer (Python/SQL) - Onsite in Houston, TX.No C2C please. Permanent position with full benefits.The Senior Data Engineer (Python/SQL) may end up working on various projects over time, involving potentially different and evolving sets of technologies as needed for modern business applications and systems.The Senior Data Engineer (Python/SQL) is...

  • Senior Data Engineer

    2 months ago

    Houston, United States IntagHire Full time

    Senior Data Engineer (Python/SQL) - Onsite in Houston, TX.No C2C please. Permanent position with full benefits.The Senior Data Engineer (Python/SQL) may end up working on various projects over time, involving potentially different and evolving sets of technologies as needed for modern business applications and systems.The Senior Data Engineer (Python/SQL) is...

  • Sr Data Engineer

    3 days ago

    Houston, United States IntagHire Full time

    Senior Data Engineer Real-time Operations (Python/AWS) - Onsite in Houston, TX. Fulltime position with a benefits package. No C2C please. Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the clients development teams, you will...

  • Data Engineer

    2 months ago

    Houston, United States IntagHire Full time

    Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits packageAbout the Role:We are seeking a skilled mid to senior level Python Data Engineer to join our clients’ team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about...

  • Data Engineer

    2 months ago

    Houston, United States IntagHire Full time

    Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits packageAbout the Role:We are seeking a skilled mid to senior level Python Data Engineer to join our clients’ team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about...

  • Data Engineer

    4 hours ago

    Houston, United States IntagHire Full time

    Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits packageAbout the Role:We are seeking a skilled mid to senior level Python Data Engineer to join our clients’ team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about...

  • Sr Data Engineer

    5 days ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    4 days ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    1 day ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    4 hours ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Data Architect

    2 weeks ago

    Houston, United States Saksoft Full time

    Hi, Position: Azure Data ArchitectLocation: Houston, TX OnsiteDuration: Long Term Job description: 15+ yrs experience within depth knowledge of Azure fundamentals - Data lake, ADF with Data bricks.Database design and modeling experience.Knowledge and experience in Azure Architecture.Good understanding and experience of working on Azure cloud.Understanding...

  • Legal Staff Paralegal in Houston, TX

    2 weeks ago

    Houston, United States Houston, TX Full time

    2-5 yrs required No Not specified. Dental, Medical, Retirement, Vision Not specified. Discovery Responses, Motions, Client Meetings, Record Ordering, Document Assembly, E-filing Paralegal Certification Legal May...

  • Data Engineer II

    1 week ago

    Houston, United States Loves Travel Stops & Country Store Full time

    Req ID: 433864 Address: 2929 Allen Parkway, Ste 4100 Houston, TX, 77019  POSITION OVERVIEW: Love’s Travel Stops is seeking a Data Engineer III to join our dynamic team that’s shaping the future of travel and commerce. In this role, you'll be the architect of our data pipelines, instrumental in operationalizing data & advanced analytics to drive...

  • Data Engineer II

    24 hours ago

    Houston, United States Loves Travel Stops & Country Store Full time

    Req ID: 433864 Address: 2929 Allen Parkway, Ste 4100 Houston, TX, 77019  POSITION OVERVIEW: Love’s Travel Stops is seeking a Data Engineer III to join our dynamic team that’s shaping the future of travel and commerce. In this role, you'll be the architect of our data pipelines, instrumental in operationalizing data & advanced analytics to drive...

  • Data Engineer II

    13 hours ago

    Houston, United States Loves Travel Stops & Country Store Full time

    Req ID: 433864 Address: 2929 Allen Parkway, Ste 4100 Houston, TX, 77019  POSITION OVERVIEW: Love’s Travel Stops is seeking a Data Engineer II to join our dynamic team that’s shaping the future of travel and commerce. In this role, you'll be the architect of our data pipelines, instrumental in operationalizing data & advanced analytics to drive...

  • Legal Practice Assistant Asbestos Litigation in Houston, TX

    2 weeks ago

    Houston, United States Houston, TX Full time

    Min 1 yrs required No Legal May 10, 2024 Mar 11, 2024 Email   |   Print Apply for this Legal Practice Assistant Asbestos Litigation in Houston, TX job Upload Resume: Apply Now Apply Later ...

  • Solutions Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Solutions Engineer with oil/gas experience. Onsite in downtown Houston, TX and 20% travel within USA. Perm role with benefits. About the Role: We are seeking an experienced Solutions Engineer to join our team and work with one of our Fortune 200 oil and gas clients located in Houston, TX. The ideal candidate will have a background in oil and gas and/or...

  • Solutions Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Solutions Engineer with oil/gas experience. Onsite in downtown Houston, TX and 20% travel within USA. SQL experience is great to have. Perm role with benefits.About the Role:We are seeking an experienced Solutions Engineer to join our team and work with one of our Fortune 200 oil and gas clients located in Houston, TX. The ideal candidate will have a...

  • Solutions Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Solutions Engineer with oil/gas experience. Onsite in downtown Houston, TX and 20% travel within USA. SQL experience is great to have. Perm role with benefits. About the Role: We are seeking an experienced Solutions Engineer to join our team and work with one of our Fortune 200 oil and gas clients located in Houston, TX. The ideal candidate will have a...

  • Solutions Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Solutions Engineer with oil/gas experience. Onsite in downtown Houston, TX and 20% travel within USA. SQL experience is great to have. Perm role with benefits.About the Role:We are seeking an experienced Solutions Engineer to join our team and work with one of our Fortune 200 oil and gas clients located in Houston, TX. The ideal candidate will have a...