Sr Data Engineer
3 weeks ago
Senior Data Engineer – Real-time Operations (Python/AWS/SQL) - Onsite in Houston, TX.
Fulltime position with a benefits package. No C2C please.
Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will contribute to the development of software solutions that aide in driving efficiencies for drilling, completions, production, and subsurface evaluation activities for a premiere, Fortune 200, Oil & Gas company.
*This position will require the candidate to be on-site at our client's office in downtown Houston, TX.
Responsibilities:
Data Management & Integration:
· Design and build pipelines to ingest and transport data
· Own data quality and reliability for app-related data pipelines.
· Collaborate with data and product teams to deliver robust, scalable data solutions.
API Development & Management:
· Design and develop secure, robust, user-friendly APIs for applications and users.
· Ensure API performance, fault tolerance, and comprehensive documentation.
Data Storage & Accessibility:
· Build and support databases specific to app usage.
· Work with enterprise database teams to make relevant app data available to stakeholders.
Analytics & Monitoring:
· Generate business rule-based alerts and notifications for stakeholders.
· Develop and support app health monitoring infrastructure to ensure uptime and reliability.
· Enhance and maintain the performance of real-time streaming data processes.
Additional Responsibilities:
· Understand the oil and gas business domain to translate needs into technical solutions.
· Participate in code review processes to ensure code quality and security.
· Provide data quality support and maintenance for assigned applications.
Requirements:
· Minimum 5 years of experience as a Data Engineer or in a similar role.
· Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.
· Strong proficiency in Python preferred.
· Demonstrated experience in stream processing and real-time data calculations, ideally with IoT data.
· Proven ability in working with data caching, relational databases (RDBMS), and API creation/integration.
· Strong problem-solving skills and a proven track record of learning and adapting to new technologies.
· Excellent collaboration and communication skills, with a keen ability to work effectively within dynamic team environments.
Our Approach to Technology:
We prioritize finding the right cultural fit and strong technical aptitude, with a willingness to learn and adapt. While we've listed technologies based on past implementations, we are flexible to similar experience and value candidates who can demonstrate their ability to excel in a dynamic environment.
· Understanding of Relational Database Management Systems (RDBMS)
o Oracle, SingleStore, MySQL, or Postgres
· Experience with NoSQL Databases
o Redis, MongoDB, and Elasticsearch
· Exposure to Event Log/Message Queuing Systems
o RabbitMQ, Pulsar, or Kafka
· API Development and Integration
o API creation concepts and experience with Python and FastAPI is a benefit
· Stream Processing Expertise
o Experience with large-scale IoT stream processing using Python for real-time data calculations and transformations (on data volumes exceeding MBs per second) is desirable.
· Infrastructure and Deployment Skills
o GitHub Actions, Kubernetes, Docker, Terraform, and Azure for deployment and infrastructure management on Linux (CentOS)
Why Join Us?
· Contribute to industry-leading technology solving real and significant business problems in the oil and gas sector.
· Be part of a large enterprise development group offering extensive opportunities for professional growth and learning.
· Engage in meaningful work directly impacting company efficiency and sustainability.
Tags: Python, Python Data Engineer, AWS, AWS, Amazon Web Services, API's, Terraform, Kafka, Kubernetes, Senior Data Engineer, Houston
-
Snowflake Data Engineer
2 weeks ago
Houston, United States Data Piper Full timeDevelop and implement scalable and efficient data architectures using Snowflake.5+ years of experience in data engineering, with a focus on Snowflake.Proven experience with Snowflake design, development, and optimization.Strong proficiency in SQL and query optimization techniques.Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache...
-
Snowflake Data Engineer
1 month ago
Houston, Texas, United States Data Piper Full timeCompany DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of...
-
Snowflake Data Engineer
1 month ago
Houston, United States Data Piper Full timeJob DescriptionJob DescriptionCompany DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments,...
-
Sr Data Engineer
2 months ago
Houston, Texas, United States Apollose Full timeResponsibilities Lead the development of our data warehousing strategy including data modeling and architecture. Design and maintain data models that facilitate data analytics reporting and machine learning. Ensure the data infrastructure meets the evolving needs of the organization with an emphasis on data warehousing solutions. Take the lead in ensuring...
-
Sr. Process Engineer
1 month ago
Houston, Texas, United States NES Fircroft Full timeClient is a general contractor specializing in engineering, procurement, construction and installation of floating production systems including Floating Production Storage and Offloading (FPSO) vessels, Floating Storage and Offloading (FSO) vessels, Tension Leg Platforms (TLPs), Production Semi-Submersibles, Mobile Offshore Production Units (MOPUs) and other...
-
Senior Data Engineer
2 weeks ago
Houston, United States Harnham Full timeJOB SUMMARYAs a Sr. Data Engineer you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure. This position demands a blend of systems engineering, data integration, and data analytics skills to enhance our data capabilities, supporting advanced analytics, machine learning projects, and real-time data...
-
Sr Electrical Engineer
2 months ago
Houston, United States SOFEC, Inc. Full timeSOFEC, Inc. is a leader in the development and supply of Single-Point Mooring (SPM) systems and is engaged in research involving new and improved tanker mooring systems and associated components. Projects range from preliminary design studies to major engineering, fabrication, and procurement projects that include installation and commission. Projects...
-
Sr Electrical Engineer
2 months ago
Houston, United States SOFEC, Inc. Full timeSOFEC, Inc. is a leader in the development and supply of Single-Point Mooring (SPM) systems and is engaged in research involving new and improved tanker mooring systems and associated components. Projects range from preliminary design studies to major engineering, fabrication, and procurement projects that include installation and commission. Projects...
-
Sr. Sensor Software Engineer
2 months ago
Houston, United States BE STAFFING SOLUTIONS, LLC Full timeJob DescriptionJob DescriptionSr. Sensor Software Engineer -OverviewAs a Sr. Sensor Software Engineer specializing in GNSS/IMU, you will play a crucial role in developing and optimizing software solutions for our autonomous vehicle platform. You will be responsible for designing, implementing, and testing sensor drivers and data processing algorithms that...
-
Sr. Engineer Business Intelligence
1 week ago
Houston, United States Valaris Full timeJob DescriptionJob Summary The Sr Engineer Business Intelligence is the most senior technical member of a BI team and reports to the Manager of Business Intelligence. In this role, the Sr. Engineer Business Intelligence actively collaborates with business stakeholders, BI analysts & developers, and other teammates in IT to design, implement, & maintain BI...
-
Sr EPC Data Manager
3 weeks ago
Houston, Texas, United States KBR Full timeTitle:Sr EPC Data ManagerKBR Sustainable Technology Solutions (STS) provides holistic and value-added solutions across the entire asset life cycle. These include world-class licensed process technologies, differentiated advisory services, deep technical domain expertise, energy transition solutions, high-end design capabilities, and smart solutions to...
-
Sr. Data Analyst
2 weeks ago
Houston, United States Spruce Power Full timeJob DescriptionJob DescriptionTHE ROLE: Sr. Data AnalystSpruce Power, a leading provider of solar energy to over 53,000 customers, is the nation’s #1 independent residential solar servicing company, and offers customers a comprehensive, end-to-end servicing solution including financial asset management, account services, billing, fleet management, and...
-
Sr. Data Analyst
1 week ago
Houston, United States Spruce Power Full timeTHE ROLE: Sr. Data AnalystSpruce Power, a leading provider of solar energy to over 53,000 customers, is the nation’s #1 independent residential solar servicing company, and offers customers a comprehensive, end-to-end servicing solution including financial asset management, account services, billing, fleet management, and customer support to third-party...
-
Sr. Project Engineer
2 weeks ago
Houston, United States Kelly Services Full timeKelly® Engineering is seeking a skilled Sr. Project Engineer for a direct-hire position with a leading manufacturer of composites and engineered components in Houston, TX! If you are passionate about shaping the world we live in and are ready to reengineer your future, trust the experts at hiring experts. Overview This client specializes in composites,...
-
Workover Engineer Sr
3 months ago
Houston, United States Apache Full timeThe Workover Engineer Sr for Apache Corporation will be a member of Apaches Drilling, Completion & Workover team at the companys Houston office reporting to the Completions & Workover Engineering Manager. Specific role will be a Workover Engineer f Engineer, Operations, Energy, Experience
-
Sr Reliability Engineer
3 weeks ago
Houston, United States Saint-Gobain S.A. Full timeWhats the job? The Sr Reliability Engineer will drive technical equipment improvements and manage engineering and product change development. This role involves assessing mechanical requirements, implementing technology advancements, and optimizing Reliability Engineer, Engineer, Liability, Reliability, Project Management, Reliability
-
Sr Clinical Data Analyst
3 months ago
Houston, United States Baylor St Luke's Medical Center Full timeOverview St. Luke’s Health is the largest Catholic health system in greater Houston and southeast Texas. Our integrated delivery network comprises sixteen hospitals covering Houston, Brazos Valley, southeast Texas and Lake Jackson, and East Texas and Lufkin, and includes Baylor St. Luke’s Medical Center, the research and teaching hospital for Baylor...
-
Sr. Manufacturing Engineer
4 days ago
Houston, United States Intellectt Inc Full timeRole: Sr. Manufacturing Engineer/ ManagerLocation: Houston, TXDuration: Contract Description:We are looking for a Sr. Manufacturing Engineer /Manager to lead our manufacturing engineering team at the Houston, TX facility. The successful candidate will have extensive experience in Polymer Development, Molding, Design, and Machining Materials.This role...
-
Sr. Manufacturing Engineer
4 days ago
Houston, United States Intellectt Inc Full timeRole: Sr. Manufacturing Engineer/ ManagerLocation: Houston, TXDuration: Contract Description:We are looking for a Sr. Manufacturing Engineer /Manager to lead our manufacturing engineering team at the Houston, TX facility. The successful candidate will have extensive experience in Polymer Development, Molding, Design, and Machining Materials.This role...
-
Sr. Process Engineer
1 month ago
Houston, United States Solugen Full timeSolugen Houston, TX 77035 Position Sr. Process Engineer About Solugen: Solugen is a groundbreaking technology company on a bold mission to decarbonize the physical world. At the heart of our innovation is the world’s first sustainable molecule factory—the Bioforge. This unique manufacturing platform uses a chemienzymatic process to convert plant-derived...