Senior Data Engineer

3 weeks ago

Houston, United States Jade Business Services LLC Full time
Job DescriptionJob Description

We are seeking a highly skilled Senior Data Engineer to join our team and play a key role in designing, developing, and maintaining our data infrastructure on GCP. You will leverage your deep expertise in Spark to build scalable and efficient data pipelines for large-scale data processing.

Responsibilities:

  • Design, develop, and implement data pipelines using GCP services like BigQuery, Cloud Dataflow, Cloud Dataproc, and Cloud Storage.
  • Utilize Spark for complex data transformations and large-scale data processing tasks.
  • Optimize data pipelines for performance, scalability, and cost-effectiveness.
  • Collaborate with data scientists, analysts, and other engineers to define data requirements and design data solutions.
  • Implement data quality checks and ensure data governance principles are followed.
  • Stay up-to-date with the latest GCP and Spark technologies and best practices.
  • Automate data engineering tasks using scripting languages (e.g., Python).

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
  • 8+ years of experience as a Data Engineer or similar role.
  • Deep expertise in Google Cloud Platform (GCP), including experience with BigQuery, Cloud Dataflow, Cloud Dataproc, and Cloud Storage.
  • Proven experience with Apache Spark for large-scale data processing.
  • Strong programming skills in Python and familiarity with SQL.
  • Experience with data warehousing and data modeling concepts.
  • Excellent communication, collaboration, and problem-solving skills.

  • Senior Chemical Engineer

    1 week ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!Description: Senior Chemical EngineerAbout the opportunity:We are currently seeking a full-time Senior Chemical Engineer to help us achieve our company mission. This person will be part of the Process team which is responsible for...

  • Senior Chemical Engineer

    2 days ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!Description: Senior Chemical EngineerAbout the opportunity:We are currently seeking a full-time Senior Chemical Engineer to help us achieve our company mission. This person will be part of the Process team which is responsible for...

  • Senior Data Engineer

    2 weeks ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Data Engineer

    2 weeks ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Data Engineer

    1 day ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Piping Designer

    2 weeks ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Piping Designer

    5 days ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Piping Designer

    1 day ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Senior Piping DesignerWe are currently seeking a Senior Piping Designer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment...

  • Senior Software Engineer

    7 days ago

    Houston, United States Resource Data Full time

    Job DescriptionJob DescriptionAs a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems. Key...

  • Senior Software Engineer

    1 day ago

    Houston, United States Resource Data Full time

    Job DescriptionJob DescriptionAs a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems. Key...

  • Senior Software Engineer, Machine Learning/AI

    4 days ago

    Houston, United States Resource Data Inc Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Increase your chances of an interview by reading the following overview of this role before making an application. Your work will...

  • Senior Data Engineer

    2 days ago

    Houston, United States Vaco Full time

    ** Sr. Data Engineer ** ** Direct Hire - no C2C ** eligible to work without sponsorship ** onsite in West Houston ** We have the following Senior Data Engineer role that plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures. This position demands a blend of systems engineering, data integration, and data...

  • Senior Data Engineer | Onsite in Houston, TX

    3 weeks ago

    Houston, United States Vaco Full time

    ***Senior Data Engineer******Onsite in Houston TX-77077*** Job SummaryThe Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced...

  • Senior Data Engineer | Onsite in Houston, TX

    3 weeks ago

    Houston, United States Vaco Full time

    ***Senior Data Engineer******Onsite in Houston TX-77077*** Job SummaryThe Senior Data Engineer plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures.This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company's data capabilities, supporting advanced...

  • Senior Software Engineer, Machine Learning/AI

    4 days ago

    Houston, United States Resource Data Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Your work will involve translating complex problems into practical AI applications, ensuring that our clients not only keep up but...

  • Sr Data Engineer

    2 weeks ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...

  • Sr Data Engineer

    2 days ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...

  • Senior Software Engineer, Machine Learning/AI

    4 weeks ago

    Houston, United States Resource Data Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Your work will involve translating complex problems into practical AI applications, ensuring that our clients not only keep up but...

  • Senior Software Engineer, Machine Learning/AI

    3 days ago

    Houston, United States Resource Data Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Your work will involve translating complex problems into practical AI applications, ensuring that our clients not only keep up but...

  • Senior Software Engineer, Machine Learning/AI

    18 hours ago

    Houston, United States Resource Data Full time

    As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. Your work will involve translating complex problems into practical AI applications, ensuring that our clients not only keep up but...