Data Engineer

2 weeks ago

Foster City, CA, United States Vertex Sigma Software Full time

As an AV Safety Data Engineer, you will play a critical role in developing and maintaining robust data infrastructure to surface safety-relevant interactions, assess AV events, and inform autonomy development through data-driven insights. You will build scalable pipelines and metrics that ensure we receive strong, reliable signals from data, directly influencing how we assess system readiness and accelerate safe deployment, while also supporting the crucial task of event triage and analysis.

In this role you will:

  • Develop and maintain miners that identify events of interest from fleet and simulation data.
  • Improve the accuracy and efficiency of existing miners through advanced statistical and ML techniques, ensuring high signal quality.
  • Build scalable data pipelines and dashboards to monitor miner performance, signal quality, and key safety metrics.
  • Conduct exploratory data analyses to uncover trends, failure modes, and opportunities to improve vehicle behavior, specifically focusing on critical safety events and system anomalies.
  • Triage and assess AV events including both system behavior and hardware related anomalies, for potential safety/legal/regulatory concerns or system gaps, using contextual judgment grounded in safety, legal, and engineering principles.
  • Develop and maintain clear triage guidelines and criteria for both onshore and offshore triage teams.
  • Support regulatory reporting processes by providing data and analysis as needed.

Requirements

  • Master’s Degree in Computer Science, Data Science, Statistics, Applied Mathematics, or a related quantitative or Engineering field such as Transportation Engineering, Systems Engineering, Civil Engineering, Mechanical Engineering, or Electrical Engineering.
  • 6-8 years of experience working with safety-critical systems in AV, Automotive, Transportation Engineering, or a closely related industry.
  • Strong programming skills in Python and SQL.
  • Experience with large datasets and distributed data processing frameworks (e.g., Spark, Databricks).
  • Strong data engineering skills, including data wrangling and expertise in building maintainable, scalable, and efficient data pipelines.
  • Familiarity with statistics and probability, and experience with sampling and estimation methodologies.
  • Proven ability to design metrics, run analyses, and translate findings into actionable recommendations.
  • Strong understanding of behavioral safety concepts and the ability to interpret vehicle behavior in real-world contexts, along with knowledge of AV requirements, road user behavior, and traffic regulations.
  • Experience working with cross-functional teams and clearly communicating technical content to both engineering and non-technical audiences.
  • Strong organizational skills with attention to detail, especially in process development and documentation related to data pipelines and safety analysis.

Bonus Qualifications

  • PhD in Engineering or a related technical field.
  • Prior experience with AV safety or system behavior triage.
  • Experience with geospatial data analysis.
  • Experience with business intelligence tools (e.g., Looker) to support analysis.
  • Familiarity with ISO 26262 or other functional safety standards

Benefits

    • Health Care Plan (Medical, Dental & Vision)
    • Life Insurance (Basic, Voluntary & AD&D)
    • Paid Time Off (Vacation, Sick & Public Holidays)
    • Training & Development
    • Retirement Plan (401k, IRA)
    • Free breakfast and lunch

  • Data Engineer

    2 weeks ago

    Foster City, CA, United States IEQ Capital Full time

    Who are we? IEQ Capital is a Registered Investment Advisor seeking to transform traditional wealth management. Our quest is to integrate the Intellectual and Emotional Quotient, generating exceptional investment results driven by a values-oriented culture that fosters connection and collaboration with our clients. We are an independent, predominantly...

  • Data Engineer

    2 weeks ago

    Foster City, CA, United States IEQ Capital Full time

    Who are we? IEQ Capital is a Registered Investment Advisor seeking to transform traditional wealth management. Our quest is to integrate the Intellectual and Emotional Quotient, generating exceptional investment results driven by a values-oriented culture that fosters connection and collaboration with our clients. We are an independent, predominantly...

  • Data Engineer Intern

    5 days ago

    Foster City, CA, United States Zoox Full time

    Zoox's internship program provides hands-on experiences with state of the art technology, mentorship from some of the industry's brightest minds, and the opportunity to play a part in our success. Internships at Zoox are reserved for those who demonstrate outstanding academic performance, activities outside their course work, aptitude, curiosity, and a...

  • Director Data Engineering NALAC

    3 days ago

    Foster City, CA, United States Visa Full time

    Job Description With data being the fuel that drives our future - our strategies, policies, and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers, businesses, and communities is key to our future. With our ongoing commitment to Visa’s Data Values...

  • Director Data Engineering NALAC

    2 weeks ago

    Foster City, CA, United States Visa Full time

    Job Description With data being the fuel that drives our future - our strategies, policies, and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers, businesses, and communities is key to our future. With our ongoing commitment to Visa’s Data Values...

  • Staff Data Engineer

    15 hours ago

    Foster City, CA, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • AWS Data Engineer

    3 days ago

    Foster City, CA, United States Texas State Library and Archives Commision Full time

    Job Title: AWS Data Engineer Location: Foster City, CA/Raleigh, NC || Onsite Job Type: Contract Job Description: Qualifications: This position requires a Bachelor's Degree in Computer Science or a related technical field, and 5+ years of relevant employment experience 10+ years of work experience with ETL, Data Modeling, and Data Architecture Expert-level...

  • Lead Data Engineer

    5 days ago

    Foster City, CA, United States InterSources Full time

    Job Title: Lead Data Engineer job Location: Foster City, CA Job Type: Fulltime Job Mode: Onsite Required Skills: Minimum 10 years experience in Data Engineering and Lead experience atleast 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in...

  • Lead Data Engineer

    11 hours ago

    Foster City, CA, United States InterSources Full time

    Job Title: Lead Data Engineer job Location: Foster City, CA Job Type: Fulltime Job Mode: Onsite Required Skills: Minimum 10 years experience in Data Engineering and Lead experience atleast 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in...

  • Director, Data Engineering NA/LAC

    7 days ago

    Foster City, CA, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...