Sr Data Engineer

3 weeks ago

Houston, United States IntagHire Full time

Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.

Fulltime position with a benefits package. No C2C please.


Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will contribute to the development of software solutions that aide in driving efficiencies for drilling, completions, production, and subsurface evaluation activities for a premiere, Fortune 200, Oil & Gas company.


*This position will require the candidate to be on-site at our client's office in downtown Houston, TX.


Responsibilities:

Data Management & Integration:

· Design and build pipelines to ingest and transport data

· Own data quality and reliability for app-related data pipelines.

· Collaborate with data and product teams to deliver robust, scalable data solutions.


API Development & Management:

· Design and develop secure, robust, user-friendly APIs for applications and users.

· Ensure API performance, fault tolerance, and comprehensive documentation.


Data Storage & Accessibility:

· Build and support databases specific to app usage.

· Work with enterprise database teams to make relevant app data available to stakeholders.


Analytics & Monitoring:

· Generate business rule-based alerts and notifications for stakeholders.

· Develop and support app health monitoring infrastructure to ensure uptime and reliability.

· Enhance and maintain the performance of real-time streaming data processes.


Additional Responsibilities:

· Understand the oil and gas business domain to translate needs into technical solutions.

· Participate in code review processes to ensure code quality and security.

· Provide data quality support and maintenance for assigned applications.


Requirements:


· Minimum 5 years of experience as a Data Engineer or in a similar role.

· Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.

· Strong proficiency in Python preferred.

· Demonstrated experience in stream processing and real-time data calculations, ideally with IoT data.

· Proven ability in working with data caching, relational databases (RDBMS), and API creation/integration.

· Strong problem-solving skills and a proven track record of learning and adapting to new technologies.

· Excellent collaboration and communication skills, with a keen ability to work effectively within dynamic team environments.


Our Approach to Technology:


We prioritize finding the right cultural fit and strong technical aptitude, with a willingness to learn and adapt. While we've listed technologies based on past implementations, we are flexible to similar experience and value candidates who can demonstrate their ability to excel in a dynamic environment.


· Understanding of Relational Database Management Systems (RDBMS)

o Oracle, SingleStore, MySQL, or Postgres

· Experience with NoSQL Databases

o Redis, MongoDB, and Elasticsearch

· Exposure to Event Log/Message Queuing Systems

o RabbitMQ, Pulsar, or Kafka

· API Development and Integration

o API creation concepts and experience with Python and FastAPI is a benefit

· Stream Processing Expertise

o Experience with large-scale IoT stream processing using Python for real-time data calculations and transformations (on data volumes exceeding MBs per second) is desirable.

· Infrastructure and Deployment Skills

o GitHub Actions, Kubernetes, Docker, Terraform, and Azure for deployment and infrastructure management on Linux (CentOS)


Why Join Us?

· Contribute to industry-leading technology solving real and significant business problems in the oil and gas sector.

· Be part of a large enterprise development group offering extensive opportunities for professional growth and learning.

· Engage in meaningful work directly impacting company efficiency and sustainability.


Tags: Python, Python Data Engineer, AWS, AWS, Amazon Web Services, API's, Terraform, Kafka, Kubernetes, Senior Data Engineer, Houston

  • Sr. Data Engineer

    4 weeks ago

    Houston, United States Inceed Full time

    Compensation: $140000Location: Houston, TXSr. Data EngineerInceed has partnered with a great company to help find a skilled Sr. Data Engineer to join their team!We are looking for a talented and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining the data architecture,...

  • Sr. Data Engineer

    3 weeks ago

    Houston, United States Inceed Full time

    Compensation: $140000Location: Houston, TXSr. Data EngineerInceed has partnered with a great company to help find a skilled Sr. Data Engineer to join their team!We are looking for a talented and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining the data architecture,...

  • Sr. Data Engineer

    4 weeks ago

    Houston, Texas, United States EOG Resources Full time

    Details:The Sr. Data Engineer is responsible for designing, implementing and supporting full life-cycle data engineering projects for current and future economic planning applications. These project should include large data ingestion, persistence, transformation, and retrieval. Day-to-day responsibilities include designing, developing and maintaining the...

  • Sr. Data Engineer

    3 weeks ago

    Houston, Texas, United States EOG Resources Full time

    Details:The Sr. Data Engineer is responsible for designing, implementing and supporting full life-cycle data engineering projects for current and future economic planning applications. These project should include large data ingestion, persistence, transformation, and retrieval. Day-to-day responsibilities include designing, developing and maintaining the...

  • Sr Data Engineer(DB2)

    2 weeks ago

    Houston, United States EOGAvance Consulting Full time

    Title: Sr Data Engineer (DB2) Location: Houston, TX (Hybrid - 3 days onsite in a week) Duration: Long term Requirements: We have 2 new openings,  both of them senior database developers, who have experience with db2 database development.  Most of the db2 developers typically have experience in RPG programming, we would prefer someone who has done SQL...

  • Sr Data Engineer(DB2)

    1 month ago

    Houston, United States Avance Consulting Full time

    Job DescriptionJob DescriptionTitle: Sr Data Engineer (DB2)Location: Houston, TX (Hybrid - 3 days onsite in a week)Duration: Long termRequirements:We have 2 new openings, both of them senior database developers, who have experience with db2 database development. Most of the db2 developers typically have experience in RPG programming, we would prefer someone...

  • Sr. Snowflake Data Engineer

    2 days ago

    Houston, Texas, United States Delphi-US Full time

    Job Title: Sr. Snowflake Data Engineer (Contract) - Job#4996 Worksite:Houston TX (Onsite 3x/week) Tue-Thurs. You will help optimize data flow and collection across our Business Portfolio. Play an active role in our pipelines, data wrangling, and optimization of data systems builds from the ground up. Support data product owners, developers, data architects,...

  • Sr. Snowflake Data Engineer

    2 weeks ago

    Houston, United States Delphi-US Full time

    Job Title: Sr. Snowflake Data Engineer (Contract) - Job#4996Worksite: Houston TX (Onsite 3x/week) Tue-Thurs. You will help optimize data flow and collection across our Business Portfolio. Play an active role in our pipelines, data wrangling, and optimization of data systems builds from the ground up. Support data product owners, developers, data architects,...

  • Sr Data Analyst

    4 days ago

    Houston, United States Diverse Lynx Full time

    Role: Sr Data Analyst Location: Houston, TX ( Onsite from Day 1) Duration: Full-time Job Description Responsibilities are to collect, clean, and interpret datasets from various sources to support building of the Surface Data Hub, an ecosystem of defined interrelated data products to service the Surface domain. Key job responsibilities Receive direction from...

  • Sr Data Analyst

    2 weeks ago

    Houston, United States Diverse Lynx Full time

    Role: Sr Data Analyst Location: Houston, TX ( Onsite from Day 1) Duration: Full-time Job Description Responsibilities are to collect, clean, and interpret datasets from various sources to support building of the Surface Data Hub, an ecosystem of defined interrelated data products to service the Surface domain. Key job responsibilities Receive direction from...

  • Sr Data Analyst

    2 days ago

    Houston, Texas, United States Diverse Lynx Full time

    Role: Sr Data Analyst Location: Houston, TX ( Onsite from Day 1) Duration: Full-time Job Description Responsibilities are to collect, clean, and interpret datasets from various sources to support building of the Surface Data Hub, an ecosystem of defined interrelated data products to service the Surface domain.Key job responsibilities Receive direction from...

  • Sr Data Engineer

    4 weeks ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...

  • Sr Data Engineer

    3 weeks ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...

  • Sr Data Engineer

    3 days ago

    Houston, Texas, United States MD Anderson Cancer Center Full time

    The Senior Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Senior Data Engineer assists in managing business requirements gathering, end-to-end solution planning and optimizes...

  • Sr. Process Engineer

    2 months ago

    Houston, United States MODEC Full time

    MODEC is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...

  • Sr. Process Engineer

    12 hours ago

    Houston, United States MODEC Full time

    MODEC is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...

  • Sr. Data Engineer w/d Python and Spark

    2 weeks ago

    Houston, United States Diverse Lynx Full time

    Role: Sr. Data Engineer w/d Python and Spark Type: Contract and FTE both Location: Houston, TX and Plano, TX (onsite day 1, locals only) Salary: $120K-130K Plus Benefits Job Description: 6+ years of professional work experience designing and implementing data pipelines in a cloud environment is required. 5+ years of experience...

  • Sr. Process Engineer

    2 months ago

    Houston, United States Modec International Inc. Full time

    MODEC is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...

  • Sr. Process Engineer

    2 months ago

    Houston, United States Modec International Inc. Full time

    MODEC is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...

  • Sr. Process Engineer

    2 months ago

    Houston, United States Modec International Inc. Full time

    MODEC is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...