Senior Data Engineer

4 days ago

Houston, United States IntagHire Full time

Back-End Data Engineer (Python/SQL/AWS) - ONSITE daily in Houston, TX.


Our client is looking for talented back-end data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will contribute to the development of software solutions that aide in driving efficiencies for drilling, completions, production, and subsurface evaluation activities for a premiere, Fortune 200, Oil & Gas company.

This position and program will require the candidate to be on-site at our client's office in downtown Houston, TX.


Responsibilities:

Data Management & Integration:

· Design and build pipelines to ingest and transport data

· Own data quality and reliability for app-related data pipelines.

· Collaborate with data and product teams to deliver robust, scalable data solutions.


API Development & Management:

· Design and develop secure, robust, user-friendly APIs for applications and users.

· Ensure API performance, fault tolerance, and comprehensive documentation.


Data Storage & Accessibility:

· Build and support databases specific to app usage.

· Work with enterprise database teams to make relevant app data available to stakeholders.


Analytics & Monitoring:

· Generate business rule-based alerts and notifications for stakeholders.

· Develop and support app health monitoring infrastructure to ensure uptime and reliability.

· Enhance and maintain the performance of real-time streaming data processes.


Additional Responsibilities:

· Understand the oil and gas business domain to translate needs into technical solutions.

· Participate in code review processes to ensure code quality and security.

· Provide data quality support and maintenance for assigned applications.


Requirements:


· Minimum 5 years of experience as a Data Engineer or in a similar role.

· Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.

· Strong proficiency in Python preferred.

· Demonstrated experience in stream processing and real-time data calculations, ideally with IoT data.

· Proven ability in working with data caching, relational databases (RDBMS), and API creation/integration.

· Strong problem-solving skills and a proven track record of learning and adapting to new technologies.

· Excellent collaboration and communication skills, with a keen ability to work effectively within dynamic team environments.


Our Approach to Technology:


We prioritize finding the right cultural fit and strong technical aptitude, with a willingness to learn and adapt. While we've listed technologies based on past implementations, we are flexible to similar experience and value candidates who can demonstrate their ability to excel in a dynamic environment.


· Understanding of Relational Database Management Systems (RDBMS)

o Oracle, SingleStore, MySQL, or Postgres

· Experience with NoSQL Databases

o Redis, MongoDB, and Elasticsearch

· Exposure to Event Log/Message Queuing Systems

o RabbitMQ, Pulsar, or Kafka

· API Development and Integration

o API creation concepts and experience with Python and FastAPI is a benefit

· Stream Processing Expertise

o Experience with large-scale IoT stream processing using Python for real-time data calculations and transformations (on data volumes exceeding MBs per second) is desirable.

· Infrastructure and Deployment Skills

o GitHub Actions, Kubernetes, Docker, Terraform, and Azure for deployment and infrastructure management on Linux (CentOS)


Why Join Us?

· Contribute to industry-leading technology solving real and significant business problems in the oil and gas sector.

· Be part of a large enterprise development group offering extensive opportunities for professional growth and learning.

· Engage in meaningful work directly impacting company efficiency and sustainability.

  • Senior Data Engineer

    3 weeks ago

    Houston, United States Walker Elliott Full time

    Our client is looking for a Senior Data Engineer to lead the development and execution of the data engineering strategy, collaborating with senior leadership to ensure data initiatives align with business objectives. This role requires expertise in data integration, data modeling, and the implementation of Azure services.Key Responsibilities:Define and drive...

  • Senior Data Engineer

    3 weeks ago

    Houston, United States Walker Elliott Full time

    Our client is looking for a Senior Data Engineer to lead the development and execution of the data engineering strategy, collaborating with senior leadership to ensure data initiatives align with business objectives. This role requires expertise in data integration, data modeling, and the implementation of Azure services.Key Responsibilities:Define and drive...

  • Senior Data Engineer

    3 months ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Data Engineer

    3 months ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Snowflake Data Engineer

    2 weeks ago

    Houston, United States Data Piper Full time

    Develop and implement scalable and efficient data architectures using Snowflake.5+ years of experience in data engineering, with a focus on Snowflake.Proven experience with Snowflake design, development, and optimization.Strong proficiency in SQL and query optimization techniques.Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache...

  • Snowflake Data Engineer

    1 month ago

    Houston, Texas, United States Data Piper Full time

    Company DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of...

  • Snowflake Data Engineer

    1 month ago

    Houston, United States Data Piper Full time

    Job DescriptionJob DescriptionCompany DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments,...

  • Senior Data Engineer

    3 months ago

    Houston, United States ManhattanLife Insurance & Annuity Company Full time

    Job DescriptionJob DescriptionWho We Are:ManhattanLife Insurance and Annuity Company was founded in 1850, the Company’s longevity makes it one of the oldest and most reliable health and life insurance companies in the country. Operating successfully for 174 years is a testimony to ManhattanLife’s enduring history, and an indicator of the reliability of...

  • Senior Data Engineer

    1 month ago

    Houston, United States Mondo Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to design and implement scalable, reliable data pipelines that drive our analytics and operational applications. As a key member of our data engineering team, you will work with cutting-edge technologies such as Apache Spark, Hadoop, Kafka, and cloud services from AWS and Azure. Your expertise...

  • Senior Data Engineer

    1 month ago

    Houston, United States Mondo Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to design and implement scalable, reliable data pipelines that drive our analytics and operational applications. As a key member of our data engineering team, you will work with cutting-edge technologies such as Apache Spark, Hadoop, Kafka, and cloud services from AWS and Azure. Your expertise...

  • Senior Data Engineer

    4 weeks ago

    North Houston, United States Infomatics Corp Full time

    We are looking for a Data engineer for our project. Please use the following job description for the role to look for a candidate with good leadership and communication skills. Senior Data EngineerLeads the design, development, and operation of robust, scalable, and secure data platforms on the Azure cloud. Drives the adoption of cloud-native technologies...

  • Senior Project Engineer, NA

    3 weeks ago

    Houston, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Senior Project Engineer, NA

    3 days ago

    Houston, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Senior Data Engineer

    1 month ago

    Houston, Texas, United States Argus Media Full time

    Senior Data Engineer & Support (R-Shiny)Location: Houston, US.About ArgusArgus is the leading independent provider of market intelligence to the global energy and commodity markets. We offer essential price assessments, news, analytics, consulting services, data science tools and industry conferences to illuminate complex and opaque commodity markets....

  • Senior Research Engineer/Data Scientist

    2 months ago

    Houston, United States Corva Full time

    About Corva Corva has built a first-of-its-kind energy app store on a bedrock of best-in-class technologies, data pipelines, and a secure and scalable architecture. Our energy solutions solve today's toughest well delivery challenges, from well design through drillout. The ever-evolving platform is not only future-proof for digitizing operations but is your...

  • Senior Data Engineer

    3 weeks ago

    Houston, United States Harnham Full time

    JOB SUMMARYAs a Sr. Data Engineer you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure. This position demands a blend of systems engineering, data integration, and data analytics skills to enhance our data capabilities, supporting advanced analytics, machine learning projects, and real-time data...

  • Data Engineer

    3 weeks ago

    Houston, United States Brooksource Full time

    Data EngineerBrooksourceFortune 500 Utility ClientDowntown Houston, TXOur client is scaling their Analytics organization and creating specialized verticals based on business unit. They need a senior-level Data Engineer to join the group that does Analytics Enablement for these verticals who will build data sets from unstructured sources to solve business...

  • Data Engineer

    5 days ago

    Houston, United States Brooksource Full time

    Data EngineerBrooksourceFortune 500 Utility ClientDowntown Houston, TXOur client is scaling their Analytics organization and creating specialized verticals based on business unit. They need a senior-level Data Engineer to join the group that does Analytics Enablement for these verticals who will build data sets from unstructured sources to solve business...

  • Battery Data Engineer

    2 weeks ago

    Houston, United States Fluence Full time

    Fluence is a leader in energy storage solutions, committed to innovation and excellence in battery technology. We are dedicated to advancing the integration of renewable energy and ensuring the reliability and efficiency of energy storage systems. Join our team and contribute to a sustainable future. We are seeking a highly skilled and experienced Senior...

  • Structural Engineer

    2 months ago

    Houston, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!About the opportunity: Civil Structural EngineerWe are currently seeking a full-time Civil Structural Engineer to help us achieve our company mission. This person will be part of the Civil/Structural team, which is responsible for...