Staff Data Engineer

2 days ago

Austin TX, Travis County, TX; Texas, United States General Motors Full-time
What You’ll DoOwn production data products from ingestion through curated, analytics-ready datasets, including the silver-to-gold pipelines that feed feature-performance reporting, safety workflows, and self-service analysis.
Design and operate reliable pipelines on Databricks for large, raw vehicle telemetry: decoding, deduplication, ordering, completeness, and late or missing data.
Run the self-service analytics platform from the engineering side: workspace onboarding, compute, and governed access so partner teams can analyze approved ADAS data without one-off pipelines.
Define data-quality checks, monitoring, and alerting, and drive issues to a fix before downstream scorecards and investigations are wrong.
Ship through a standard path: GitHub, Databricks Asset Bundles, automated tests, and a clear dev-to-prod promotion, including rollback.
Make data reusable. Model datasets so scientists, analysts, and product partners can use them without rediscovering lineage, grain, or known quality limits.
Apply enterprise data governance: classification, access control, lineage, and privacy constraints on customer and vehicle data.
Partner with upstream data engineers, scientists, product managers, and safety stakeholders on contracts, feasibility, and production support.
Leave the platform easier to operate than you found it.
Build the data layer agents depend on: an entity spine that joins vehicle, event, software, and road context; Ground every result in approved data, return the evidence, and evaluate the workflow against known cases. Hold the line on access, privacy, and AI-review requirements.
Connect production analytics to agent workflows through APIs and tool interfaces, including MCP, so an investigation, a fleet scan, and a KPI explanation reuse the same datasets. Align with the enterprise agent platform instead of a separate stack.
Your Skills & Abilities (Required Qualifications)7+ years of experience building and operating production data platforms.
Bachelor’s degree in computer science, Software Engineering, or a closely related technical field, or equivalent demonstrable professional software engineering experience.
Deep hands-on experience with Python, SQL, and Spark on a lakehouse, (e.g. Databricks)Experience designing batch and incremental pipelines that stay correct under late, duplicate, and incomplete source data.
Experience running production operations: monitoring, alerting, incident response, and cost-aware performance tuning.
Experience releasing data code through CI/CD, including infrastructure-as-code or bundle-based deployment.
Experience putting agent or LLM workflows on production data: multi-source retrieval, tool use, and checks that the answer is grounded in the data.
Sound judgment on data governance, access control, and sensitive vehicle or customer data.
Clear writing and speaking, including design docs and production runbooks.
Your Skills & Abilities (Required Qualifications)Automotive, ADAS, or vehicle-telemetry experience.
Work across more than one cloud, especially Azure and GCP.
Experience building self-service analytics for analysts and scientists who are not on your team.
Familiarity with Unity Catalog, data contracts, and medallion (bronze, silver, gold) architecture.
Experience supporting safety or regulatory reporting, where a wrong row has a real consequence.
This job may be eligible for relocation benefits.
Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more. GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE. DO NOT APPLY FOR THIS ROLE IF YOU WILL NEED GM IMMIGRATION SPONSORSHIP NOW OR IN THE FUTURE. THIS INCLUDES DIRECT COMPANY SPONSORSHIP, ENTRY OF GM AS THE IMMIGRATION EMPLOYER OF RECORD ON A GOVERNMENT FORM, AND ANY WORK AUTHORIZATION REQUIRING A WRITTEN SUBMISSION OR OTHER IMMIGRATION SUPPORT FROM THE COMPANY (e.g., H-1B, OPT, STEM OPT, CPT, TN, J-1, etc.)#Benefits OverviewFrom day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.
All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orien