Sr Data Engineer

3 weeks ago


Houston, United States IntagHire Full time

Senior Data Engineer – Real-time Operations (Python/AWS/SQL) - Onsite in Houston, TX.

Fulltime position with a benefits package. No C2C please.


Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will contribute to the development of software solutions that aide in driving efficiencies for drilling, completions, production, and subsurface evaluation activities for a premiere, Fortune 200, Oil & Gas company.


*This position will require the candidate to be on-site at our client's office in downtown Houston, TX.


Responsibilities:

Data Management & Integration:

· Design and build pipelines to ingest and transport data

· Own data quality and reliability for app-related data pipelines.

· Collaborate with data and product teams to deliver robust, scalable data solutions.


API Development & Management:

· Design and develop secure, robust, user-friendly APIs for applications and users.

· Ensure API performance, fault tolerance, and comprehensive documentation.


Data Storage & Accessibility:

· Build and support databases specific to app usage.

· Work with enterprise database teams to make relevant app data available to stakeholders.


Analytics & Monitoring:

· Generate business rule-based alerts and notifications for stakeholders.

· Develop and support app health monitoring infrastructure to ensure uptime and reliability.

· Enhance and maintain the performance of real-time streaming data processes.


Additional Responsibilities:

· Understand the oil and gas business domain to translate needs into technical solutions.

· Participate in code review processes to ensure code quality and security.

· Provide data quality support and maintenance for assigned applications.


Requirements:


· Minimum 5 years of experience as a Data Engineer or in a similar role.

· Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.

· Strong proficiency in Python preferred.

· Demonstrated experience in stream processing and real-time data calculations, ideally with IoT data.

· Proven ability in working with data caching, relational databases (RDBMS), and API creation/integration.

· Strong problem-solving skills and a proven track record of learning and adapting to new technologies.

· Excellent collaboration and communication skills, with a keen ability to work effectively within dynamic team environments.


Our Approach to Technology:


We prioritize finding the right cultural fit and strong technical aptitude, with a willingness to learn and adapt. While we've listed technologies based on past implementations, we are flexible to similar experience and value candidates who can demonstrate their ability to excel in a dynamic environment.


· Understanding of Relational Database Management Systems (RDBMS)

o Oracle, SingleStore, MySQL, or Postgres

· Experience with NoSQL Databases

o Redis, MongoDB, and Elasticsearch

· Exposure to Event Log/Message Queuing Systems

o RabbitMQ, Pulsar, or Kafka

· API Development and Integration

o API creation concepts and experience with Python and FastAPI is a benefit

· Stream Processing Expertise

o Experience with large-scale IoT stream processing using Python for real-time data calculations and transformations (on data volumes exceeding MBs per second) is desirable.

· Infrastructure and Deployment Skills

o GitHub Actions, Kubernetes, Docker, Terraform, and Azure for deployment and infrastructure management on Linux (CentOS)


Why Join Us?

· Contribute to industry-leading technology solving real and significant business problems in the oil and gas sector.

· Be part of a large enterprise development group offering extensive opportunities for professional growth and learning.

· Engage in meaningful work directly impacting company efficiency and sustainability.


Tags: Python, Python Data Engineer, AWS, AWS, Amazon Web Services, API's, Terraform, Kafka, Kubernetes, Senior Data Engineer, Houston



  • Houston, United States Data Piper Full time

    Develop and implement scalable and efficient data architectures using Snowflake.5+ years of experience in data engineering, with a focus on Snowflake.Proven experience with Snowflake design, development, and optimization.Strong proficiency in SQL and query optimization techniques.Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache...


  • Houston, Texas, United States Data Piper Full time

    Company DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of...


  • Houston, United States Data Piper Full time

    Job DescriptionJob DescriptionCompany DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments,...

  • Sr Data Engineer

    2 months ago


    Houston, Texas, United States Apollose Full time

    Responsibilities Lead the development of our data warehousing strategy including data modeling and architecture. Design and maintain data models that facilitate data analytics reporting and machine learning. Ensure the data infrastructure meets the evolving needs of the organization with an emphasis on data warehousing solutions. Take the lead in ensuring...

  • Sr. Process Engineer

    1 month ago


    Houston, Texas, United States NES Fircroft Full time

    Client is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...

  • Senior Data Engineer

    2 weeks ago


    Houston, United States Harnham Full time

    JOB SUMMARYAs a Sr. Data Engineer you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure. This position demands a blend of systems engineering, data integration, and data analytics skills to enhance our data capabilities, supporting advanced analytics, machine learning projects, and real-time data...

  • Sr Electrical Engineer

    2 months ago


    Houston, United States SOFEC, Inc. Full time

    SOFEC, Inc. is a leader in the development and supply of Single-Point Mooring (SPM) systems and is engaged in research involving new and improved tanker mooring systems and associated components. Projects range from preliminary design studies to major engineering, fabrication, and procurement projects that include installation and commission. Projects...

  • Sr Electrical Engineer

    2 months ago


    Houston, United States SOFEC, Inc. Full time

    SOFEC, Inc. is a leader in the development and supply of Single-Point Mooring (SPM) systems and is engaged in research involving new and improved tanker mooring systems and associated components. Projects range from preliminary design studies to major engineering, fabrication, and procurement projects that include installation and commission. Projects...


  • Houston, United States BE STAFFING SOLUTIONS, LLC Full time

    Job DescriptionJob DescriptionSr. Sensor Software Engineer -OverviewAs a Sr. Sensor Software Engineer specializing in GNSS/IMU, you will play a crucial role in developing and optimizing software solutions for our autonomous vehicle platform. You will be responsible for designing, implementing, and testing sensor drivers and data processing algorithms that...


  • Houston, United States Valaris Full time

    Job DescriptionJob Summary The Sr Engineer Business Intelligence is the most senior technical member of a BI team and reports to the Manager of Business Intelligence. In this role, the Sr. Engineer Business Intelligence actively collaborates with business stakeholders, BI analysts & developers, and other teammates in IT to design, implement, & maintain BI...

  • Sr EPC Data Manager

    3 weeks ago


    Houston, Texas, United States KBR Full time

    Title:Sr EPC Data ManagerKBR Sustainable Technology Solutions (STS) provides holistic and value-added solutions across the entire asset life cycle. These include world-class licensed process technologies, differentiated advisory services, deep technical domain expertise, energy transition solutions, high-end design capabilities, and smart solutions to...

  • Sr. Data Analyst

    2 weeks ago


    Houston, United States Spruce Power Full time

    Job DescriptionJob DescriptionTHE ROLE: Sr. Data AnalystSpruce Power, a leading provider of solar energy to over 53,000 customers, is the nation’s #1 independent residential solar servicing company, and offers customers a comprehensive, end-to-end servicing solution including financial asset management, account services, billing, fleet management, and...

  • Sr. Data Analyst

    1 week ago


    Houston, United States Spruce Power Full time

    THE ROLE: Sr. Data AnalystSpruce Power, a leading provider of solar energy to over 53,000 customers, is the nation’s #1 independent residential solar servicing company, and offers customers a comprehensive, end-to-end servicing solution including financial asset management, account services, billing, fleet management, and customer support to third-party...

  • Sr. Project Engineer

    2 weeks ago


    Houston, United States Kelly Services Full time

    Kelly® Engineering is seeking a skilled Sr. Project Engineer for a direct-hire position with a leading manufacturer of composites and engineered components in Houston, TX! If you are passionate about shaping the world we live in and are ready to reengineer your future, trust the experts at hiring experts.   Overview This client specializes in composites,...

  • Workover Engineer Sr

    3 months ago


    Houston, United States Apache Full time

    The Workover Engineer Sr for Apache Corporation will be a member of Apaches Drilling, Completion & Workover team at the companys Houston office reporting to the Completions & Workover Engineering Manager. Specific role will be a Workover Engineer f Engineer, Operations, Energy, Experience


  • Houston, United States Saint-Gobain S.A. Full time

    Whats the job? The Sr Reliability Engineer will drive technical equipment improvements and manage engineering and product change development. This role involves assessing mechanical requirements, implementing technology advancements, and optimizing Reliability Engineer, Engineer, Liability, Reliability, Project Management, Reliability


  • Houston, United States Baylor St Luke's Medical Center Full time

    Overview St. Luke’s Health is the largest Catholic health system in greater Houston and southeast Texas. Our integrated delivery network comprises sixteen hospitals covering Houston, Brazos Valley, southeast Texas and Lake Jackson, and East Texas and Lufkin, and includes Baylor St. Luke’s Medical Center, the research and teaching hospital for Baylor...


  • Houston, United States Intellectt Inc Full time

    Role: Sr. Manufacturing Engineer/ ManagerLocation: Houston, TXDuration: Contract Description:We are looking for a Sr. Manufacturing Engineer /Manager to lead our manufacturing engineering team at the Houston, TX facility. The successful candidate will have extensive experience in Polymer Development, Molding, Design, and Machining Materials.This role...


  • Houston, United States Intellectt Inc Full time

    Role: Sr. Manufacturing Engineer/ ManagerLocation: Houston, TXDuration: Contract Description:We are looking for a Sr. Manufacturing Engineer /Manager to lead our manufacturing engineering team at the Houston, TX facility. The successful candidate will have extensive experience in Polymer Development, Molding, Design, and Machining Materials.This role...

  • Sr. Process Engineer

    1 month ago


    Houston, United States Solugen Full time

    Solugen Houston, TX 77035 Position Sr. Process Engineer About Solugen: Solugen is a groundbreaking technology company on a bold mission to decarbonize the physical world. At the heart of our innovation is the world’s first sustainable molecule factory—the Bioforge. This unique manufacturing platform uses a chemienzymatic process to convert plant-derived...