Data Engineer, Research

22 hours ago

Houston, United States Houston Astros Full time
Department: Baseball Operations, Research and Development

Supervisor: Sr. Director, Research and Development

Classification: Full-Time/Exempt

Location: Houston, TX

The Houston Astros baseball organization is accepting applications for a Data Engineer to join our Research & Development team within Baseball Operations. We are seeking an applicant to support the growth of our data architecture using cloud-based data lake technologies. This role will work within a team of software developers supporting the broad need of Baseball Operations and will be central to the workflow of departments across the organization, including opportunities to interface with and understand the needs of other departments and drive creative solutions.

Essential Functions & Responsibilities

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • Collaborate with the team on the design and implementation of a cloud-based data architecture.
  • Leverage Spark-based solutions to develop and maintain data processing pipelines that provide efficient access to data at various stages of transformation.
  • Integrate structured, semi-structured, and unstructured data sources, handling various formats including Parquet, JSON, and more.
  • Automate workflows and monitoring procedures to promote a maintainable infrastructure.
  • Write clean and iterative code and leverage continuous integration practices to deploy, support and operate data pipelines.
  • Interact with stakeholders internal to R&D (research analysts, application developers, ) and external to understand their needs from our architecture and data.
  • Participate in a rotating on-call schedule to tend to any immediate issues with our architecture and data.
  • Perform other duties as assigned.
Qualifications
  • Experience with one or more cloud platforms such as Azure, AWS, GCP.
  • Experience building and maintaining ETL processes with Databricks, Snowflake, or other data lake technologies.
  • Experience with Apache Spark (especially PySpark) a plus.
  • Proficiency with Python, including best practices and OOP design.
  • Proficiency with SQL and relational database structures.
  • Experience working on software teams and promoting software development best practices, including continuous integration, documentation, process automation, and monitoring.
  • Resilient in evolving environments and advocates for technical excellence.


Work Environment

This job operates in an office setting. This role routinely uses standard office equipment such as computers, phones and photocopiers. The noise level is usually moderate but can be loud within the stadium environment.

Physical Demands

While performing the duties of this job, the employee is occasionally required to stand; walk; sit (for long periods of time); use hands to handle or feel objects, tools or controls; reach with hands and arms; climb stairs; talk or hear. The employee may occasionally lift or move equipment, up to 20 pounds.

Specific vision abilities required by this job include close and focused vision.

Position Type and Expected Hours of Work

Ability to work a flexible schedule, including extended hours, evenings, weekends, and holidays.

Travel

Some travel may be expected in this role.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

EOE/M/F/Vet/Disability

  • Research Data Engineer

    16 hours ago

    Houston, United States Houston Methodist Full time

    Overview At Houston Methodist, the Research Data Engineer position is responsible for building and managing the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of clinical and population-health data sources using big data technologies in partnership with Houston Methodist IT. The position entails...

  • Data Engineer, Research

    17 hours ago

    Houston, United States AEG Full time

    In order to be considered for this role, after clicking "Apply Now" above and being redirected, you must fully complete the application process on the follow-up screen.Department: Baseball Operations, Research and Development Supervisor: Sr. Director, Research and Development Classification: Full-Time/Exempt Location: Houston, TX The Houston Astros baseball...

  • Data Engineer

    21 hours ago

    Houston, United States SysMind Tech Full time

    Title: Data Engineer Location: Houston, TX (On-site) Client: Quest Global/Halliburton Roles: This role is a part of the Production Enhancement Data Backbone team. The team, as well as a successful candidate, will create useful data products to be used in operations, data science modeling, business intelligence, and reporting. Overview: The candidate...

  • Data Engineer

    2 months ago

    Houston, United States Jobot Full time

    Job DescriptionJob Description100% Remote, Silicon Valley Health & Wellness start-up, Salary + EquityThis Jobot Job is hosted by: Duran WorkmanAre you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume.Salary: $70,000 - $85,000 per yearA bit about us:We are currently seeking a highly skilled and motivated Data Engineer to join...

  • Principal Data Engineer

    2 weeks ago

    HOUSTON, United States US6469 Sysco Payroll, Division of Sysco Resources Services, LLC Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...

  • Principal Data Engineer

    1 month ago

    HOUSTON, United States Sysco Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...

  • Principal Data Engineer

    2 weeks ago

    HOUSTON, United States US6469 Sysco Payroll, Division of Sysco Resources Services, LLC Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...

  • Principal Data Engineer

    19 hours ago

    Houston, United States Sysco Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...

  • Lead Cloud Data Engineer

    3 weeks ago

    Houston, United States Amerit Consulting Full time

    Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks a Lead Cloud Data Engineer for a 100% remote role. Key Responsibilities: Lead a team of data engineers in designing, building, and maintaining high-performance software systems. Architect,...

  • Data Engineer

    15 hours ago

    Houston, United States Apex Health Solutions Full time

    Description Summary: The Data Engineer will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision-making. In this role, the Data Engineer will play a critical role in connecting our partners and enabling our critical solutions using...

  • Research Engineer I

    1 month ago

    Houston, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Research Engineer I

    1 month ago

    Houston, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Research Engineer I

    1 month ago

    Houston, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Research Engineer I

    4 weeks ago

    Houston, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Data Entry Coordinator PRN

    4 weeks ago

    Houston, United States Evolution Research Group Full time

    Job DetailsJob Location LOC010 HDR Memorial Hermann Village inc HHH - Houston, TX Data Entry (PRN)Title: Data Entry Coordinator Location: Houston, TXAbout us: ERG is a leading U.S. based, privately held, independent clinical research site company, and provider of clinical development services with expertise in early and late-stage neuroscience drug...

  • Data Entry Coordinator PRN

    4 weeks ago

    Houston, United States Evolution Research Group Full time

    Job DetailsJob Location LOC010 HDR Memorial Hermann Village inc HHH - Houston, TX Data Entry (PRN)Title: Data Entry Coordinator Location: Houston, TXAbout us: ERG is a leading U.S. based, privately held, independent clinical research site company, and provider of clinical development services with expertise in early and late-stage neuroscience drug...

  • Research Engineer I

    3 months ago

    Houston, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Data Engineer

    20 hours ago

    Houston, United States TEKsystems Full time

    *Description:* Top Skills' Details 1. Snowflake 2. SQL 3. Upstream Oil & Gas - operations & production, GGRE, wells, supply chain 4. Work hand-in-hand with stakeholders to migrate, integrate, and test all of the data across the industry This project is to impact the validation & migration of data within operations & production, maintenance and reliability,...

  • Research Engineer I

    4 weeks ago

    Houston, TX, United States Houston Methodist Academic Institute Full time

    At Houston Methodist, the Research Engineer I position is responsible for providing technical support for laboratory-based research. This position, under the direction of a Principle Investigator (PI), may support bench techniques, working with laboratory animals, scientific writing, and data analysis. The Research Engineer I position may oversee equipment...

  • Data Engineer

    18 hours ago

    Houston, United States Chord Energy Full time

    Position Summary Chord Energy is looking for an experienced Data Engineer to join our Data Solutions Team. This individual must have a strong foundation in data engineering and experience building data analytics solutions. The successful candidate will work with Microsoft Azure Data Factory, Airbyte, DBT or similar data pipeline tools, and will have...