Senior Data Engineer

2 weeks ago


Houston, TX, United States Wilks Brothers Full time
Overview

Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of data-driven innovation, LINQX combines cutting-edge technology with oilfield expertise to deliver transformative results.

Website: https://linqx.io/

NOTE: THIS POSITION DOES NOT OFFER VISA SPONSORSHIP.

Position Summary

The Senior Data Engineer designs, builds, and operates cloud-scale data platforms and pipelines that power AI, analytics, ML, and data products across the business. This role partners with Product, Architecture, and Data Scientist teams to deliver secure, reliable, and cost-efficient batch and streaming data services on AWS/Azure. The engineer implements data modeling, orchestration, storage, and compute layer strategies and will work directly with developers and architects from other product lines to enable integration and data strategies across products, mentoring and collaborating with teams on best practices in data engineering, reliability, and governance.

Key Roles / Responsibilities
  • Lead the end-to-end design and implementation of enterprise data platforms (e.g., lakehouse, streaming, and data hub patterns); coordinate dependencies and integrations with product and enterprise systems.
  • Provide technical leadership to internal and partner teams; plan scope, estimate effort, manage risks, and uphold delivery commitments.
  • Coach engineers on data engineering standards, observability, and operational excellence; conduct design and code reviews.
  • Define and evolve cloud data architecture (ingest, storage, compute, catalog, access) for both real-time and batch use cases; select services and patterns aligned to scalability, performance, and security requirements.
  • Build robust data pipelines (ELT/ETL) using orchestration frameworks (e.g., Airflow, Dagster), event/stream platforms (e.g., Kafka/Kinesis/Event Hub/IoT Hub), and distributed processing (e.g., Spark/Databricks/Beam/Flink).
  • Implement lakehouse/lake patterns with medallion layering, CDC, and schema evolution; operationalize quality gates, testing, and lineage.
  • Establish SLOs for data freshness, availability, and quality; implement observability (metrics, logs, lineage) and on-call runbooks.
  • Optimize cost/performance of storage and compute; manage capacity, autoscaling, and usage governance for data solutions.
  • Ensure privacy, security, and compliance (IAM, tokenization, row/column security, data retention); collaborate with enterprise security.
  • Translate product and stakeholder requirements into data contracts and SLAs; document architecture and operational procedures.
  • Evaluate emerging data technologies; create POVs and reference implementations.
  • Anticipate future needs (multi-cloud, edge/IoT ingestion, vector/AI workloads) and create roadmaps and platform capabilities.
  • Champion modernizing existing data architectures using current best practices: lakehouse, CDC, medallion layering, data mesh principles, and streaming.
  • Strong software engineering in Python/SQL and one of Scala/Java; familiarity with REST/gRPC and microservices patterns.
  • Expert with cloud data services (e.g., Azure Data Lake/Databricks/Synapse; or AWS S3/EMR/Glue/Redshift; or GCP BigQuery/Dataflow).
  • Hands-on with distributed stores (e.g., Delta/Iceberg/Hudi; Kafka; Redis) and both SQL/NoSQL databases (e.g., Postgres, Cosmos/ DynamoDB, MongoDB, Cassandra).
  • CI/CD (GitHub Actions/Azure DevOps), containerization (Docker/Kubernetes), Infrastructure as Code (Terraform).
  • Data governance and security (catalogs, lineage, RBAC/ABAC, encryption, key management).
  • Exposure to or experience implementing real time systems, with IoT/hardware design preferred; experience in oil and gas industry is a plus.
  • Excellent stakeholder communication; ability to translate business needs into scalable data solutions.
Required Education, Experience, and Qualifications
  • Bachelors in computer science, Engineering, or related field (masters preferred).
  • 510+ years in data engineering or platform roles delivering enterprise-grade data systems (SaaS or large-scale internal platforms).
  • 2+ years leading or building technical design/delivery for cloud data platforms at scale.
  • Proven delivery of streaming and batch pipelines, lakehouse implementations, and production ML data flows.
  • Experience operating data platforms with SLAs/SLOs, cost governance, and on-call ownership.
Working Conditions
  • Prolonged periods sitting at a desk and working on a computer.
  • Must be able to lift 15 pounds at times.
  • Positions self to install equipment, including under desks.
  • Moves throughout the building to access files.
  • Must be able to comprehend and follow written and oral instructions.
  • Must be able to complete tasks even with frequent interruptions.
  • Must be able to use discretion and independent judgment as needed.
  • Must be able to speak clearly on the phone and to fellow workers.

This job description should not be interpreted as an exhaustive list of responsibilities or as an employment agreement between the employer and the employee. The above statements are intended to describe the general nature and level of work being performed by employees assigned to this classification and are subject to change as the needs of the employer and requirements of the job change. Any essential functions of this position will be evaluated as necessary should an employee/applicant be unable to perform the functions or requirements due to a disability as defined by the Americans with Disabilities Act (ADA). Reasonable accommodation for the specific disability will be made for the employee/applicant when possible.

I acknowledge that I have read and understand the description of this position and have had the opportunity to ask my supervisor about any points I did not understand. I hereby state that I can perform the essential functions of this position with or without reasonable accommodation.

#LINQX#LI-AD1#LI-ONSITE

Equal Opportunity Employer

This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.

#J-18808-Ljbffr
  • Senior Data Engineer

    15 hours ago


    Houston, TX, United States Gateway Recruiting Full time

    Job Description: The Senior Data Engineer will support the development, maintenance, optimization, and use of the Company’s data infrastructure. This role is looking for a collaborative, well-rounded professional with expertise in building scalable data solutions and enabling data-driven insights. As a key member of the growing data team, the Senior Data...


  • Houston, TX, United States Best Flow Full time

    Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of data-driven...

  • Senior Data Engineer

    12 hours ago


    Houston, TX, United States LINQX Full time

    Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of data-driven...

  • Senior Data Engineer

    13 hours ago


    Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...

  • Senior Data Engineer

    2 weeks ago


    Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...


  • Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...

  • Senior Data Engineer

    16 hours ago


    Houston, TX, United States Elios, Inc. Full time

    Senior Data Engineer - (100% Remote)Fully Remote: Work from anywhere with flexible hours that fit your lifestyle. Award-Winning Culture: Be part of a company recognized for exceptional employee satisfaction, inclusivity, and professional development. Competitive Compensation: Generous salary, performance bonuses, and comprehensive benefits package....


  • Houston, TX, United States RxVantage Full time

    Senior Data QA Engineer We're looking for a US based Senior Data QA Engineer to join our high-performing, fully remote engineering team. This is a senior-level role for someone who thrives in fast-paced environments, excels at solving complex problems, and is comfortable leading technical initiatives across product, data, and analytics domains through both...


  • Houston, TX, United States DoiT International Full time

    Senior Software Engineer In Test, Data / ETL Senior Software Engineer In Test, Data / ETL Location: Remote Estonia Our Senior Software Engineer In Test, Data / ETL will be an integral part of our Engineering team in EMEA. This full-time remote role is open to employees based in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel, and to contractors...


  • Houston, TX, United States DoiT International Full time

    Senior Software Engineer In Test, Data / ETL Senior Software Engineer In Test, Data / ETL Location: Remote Estonia Our Senior Software Engineer In Test, Data / ETL will be an integral part of our Engineering team in EMEA. This full-time remote role is open to employees based in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel, and to contractors...