Senior Data Engineer

4 weeks ago


Stanford, United States Stanford University Full time
Job Summary

We are seeking a highly skilled Senior Data Engineer to lead a team of engineers in building robust data pipelines for our Neuro-AI project. The successful candidate will have extensive experience in designing and scaling big data pipelines and proficiency with tools and frameworks such as Apache Spark, Airflow, and DeltaLake.

The ideal candidate will have a strong background in software engineering, excellent communication skills, and the ability to work effectively within an interdisciplinary team. They will be responsible for setting up and maintaining the hardware and software infrastructure to support distributed computing, data orchestration, and distributed data storage.

Key Responsibilities:

  • Lead a team of engineers to design, build, and maintain high-throughput data pipelines.
  • Set up and maintain the hardware and software infrastructure to support distributed computing, data orchestration, and distributed data storage.
  • Tightly coordinate with experimentalists, research scientists, and machine learning engineers to accelerate and facilitate the workflows for large-scale neuroscientific data analyses and foundation model training.

Requirements:

  • PhD or Master's degree in Computer Science or related fields.
  • At least 5 years of experience in designing or running big data pipelines with a particular focus on data infrastructure engineering.
  • Detailed knowledge and experience in working with state-of-the-art big data tools and frameworks.
  • Strong expertise in setting up and managing large-scale data and compute infrastructure to support high-throughput data processing.
  • Strong software engineering background for ensuring high-quality code and continuous development of data analysis pipelines in coordination with other teams.
  • Excellent communication skills to work effectively within an interdisciplinary team.

What We Offer:

  • Competitive salary and benefits.
  • Strong mentoring in career development.
  • A collaborative and uniquely positioned project spanning several disciplines, from neuroscience to artificial intelligence and engineering.


  • Stanford, California, United States S.T.E.P. Full time

    At S.T.E.P., we're revolutionizing the way the next generation thinks about finance. Our mission is to empower teens and young adults to take control of their financial futures, and we're looking for an exceptional Senior Data Analytics Engineer to help us achieve this goal.About UsWe're a well-funded Series C company that has raised over $175M, dedicated to...


  • Stanford, California, United States Rivian Full time

    Rivian is on a mission to keep the world adventurous forever. This mission is reflected in our Electric Adventure Vehicles and the diverse team we seek to attract. As a company, we challenge what's possible and seek new solutions to old problems. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future...

  • Data Engineer

    4 weeks ago


    Stanford, United States Stanford University Full time

    Job DescriptionStanford University is seeking a Data Engineer to join its team. The successful candidate will be responsible for designing and implementing data models that support specific analytic needs, providing leadership in data modeling techniques, and collaborating with researchers to ensure the timely completion of projects.Key...


  • Stanford, California, United States Stanford University Full time

    Job SummaryWe are seeking a highly skilled Senior Civil Infrastructure Engineer to join our team at Stanford University. As a key member of our Water Resources and Civil Infrastructure Group, you will be responsible for managing and executing the engineering aspects of our civil infrastructure systems' reliability and capacity assurance, capital program...


  • Stanford, United States Stanford University Full time

    Job SummaryWe are seeking a highly skilled Senior Civil Infrastructure Engineer to join our team at Stanford University. As a key member of our Water Resources and Civil Infrastructure Group, you will be responsible for managing and executing the engineering aspects of our civil infrastructure systems' reliability and capacity assurance, capital program...


  • Stanford, California, United States Rhombus Services Full time

    Rhombus Services is seeking a seasoned Senior Product Engineer to lead the development of our cutting-edge AI/ML technology. As a key member of our team, you will be responsible for driving the technical vision and strategy for our AI/ML products, working closely with cross-functional teams to deliver innovative solutions that meet the needs of our...


  • Stanford, California, United States Stanford University Full time

    Job SummaryWe are seeking a highly skilled Senior Civil Infrastructure Engineer to join our team at Stanford University. As a key member of our Water Resources and Civil Infrastructure Group, you will be responsible for managing and executing the engineering aspects of our civil infrastructure systems' reliability and capacity assurance, capital program...


  • Stanford, United States Tesla Full time

    Job SummaryThe Integration Platforms team at Tesla is responsible for developing cutting-edge technology to support our expanding customer fleet. As a Senior Fullstack Software Engineer, you will play a key role in building systems that leverage real-time data streams from our global prototype and customer vehicle fleets. Your work will enable the entirety...


  • Stanford, California, United States Rubrik Job Board Full time

    About the Role:We are seeking a highly skilled Senior Site Reliability Engineer to join our team at Rubrik. As a Senior Site Reliability Engineer, you will be responsible for ensuring the high availability and durability of our databases, establishing best practices for internal teams to write performant SQL queries, and performing periodic database upgrades...


  • Stanford, California, United States Teleo Inc. Full time

    About the RoleTeleo Inc. is a robotics startup revolutionizing the trillion-dollar construction industry by converting heavy equipment into autonomous robots. Our technology enables a single operator to efficiently control multiple machines simultaneously, delivering substantial benefits to our customers while enhancing operator safety and comfort.As the...


  • Stanford, United States Tesla Full time

    Job SummaryThe Tesla Energy UI team is seeking an experienced Senior Full-Stack Software Engineer to contribute to the development of our web-based, external-facing tooling. These tools are part of Tesla's advanced platforms for monitoring and controlling distributed energy resources, renewable power plants, and microgrids. Our UIs are built with Typescript...


  • Stanford, California, United States Tesla Full time

    The Tesla Energy UI team is seeking an experienced Senior Full-Stack Software Engineer to contribute to the development of our web-based, external-facing tooling.These tools are part of Tesla's advanced platforms for monitoring and controlling distributed energy resources, renewable power plants, and microgrids.Powerhub is one such tool, deployed across...

  • Senior Biochemist

    4 weeks ago


    Stanford, California, United States International Flavors & Fragrances Full time

    Job SummaryAs a Senior Biochemist at International Flavors & Fragrances, you will demonstrate expertise in bio-chemistry or adjacent fields, developing value-creating solutions for project teams and stakeholders. You will manage multiple projects, overseeing the experimental aspects and providing high-quality data. Your role will involve recognizing and...


  • Stanford, California, United States Rivian Full time

    Rivian is on a mission to keep the world adventurous forever. This mission is reflected in our Electric Adventure Vehicles and the team we seek to attract. As a company, we challenge what's possible and never simply accept what has always been done. We reframe old problems, seek new solutions, and operate comfortably in areas that are unknown.We are seeking...


  • Stanford, California, United States Integration Appliance, Inc. Full time

    Job SummaryAs a Senior Business Analyst at Integration Appliance, Inc., you will play a critical role in shaping the company's corporate strategy and advising executive leadership on long-term company direction and strategy execution. This is an exciting opportunity to work with a talented team of professionals and contribute to the growth and success of the...


  • Stanford, California, United States PsiQuantum Full time

    We are seeking a highly skilled Mechanical Design Engineer to join our Cryogenic Engineering Department at PsiQuantum. As a key member of our team, you will be responsible for designing and developing the thermal mechanical systems for our quantum computer.The ideal candidate will have a strong background in mechanical engineering, with experience in thermal...


  • Stanford, California, United States Tesla Full time

    The Cloud Storage Platform team at Tesla is seeking a seasoned systems engineering leader to help design and develop a scalable and secure infrastructure for our cloud storage platform.This platform plays a critical role in providing infrastructure services as managed services, powering everything from data centers to factory floors.In this role, you will...


  • Stanford, United States HP Development Company, L.P. Full time

    Senior Business Development & Strategic Partnership manager of Ad Tech Description - We are looking for a Senior Business Development & Strategic manager to lead the development and success of partnerships and business development of Adtech. The role thrives at the intersection of advertising, data, technology, and agency relationships. Key...


  • Stanford, United States Recruiting from Scratch Full time

    About the Role:Recruiting from Scratch is seeking a highly skilled Front-end Engineer to join our team. As a Front-end Engineer, you will be responsible for designing and building user interfaces, collaborating with design staff, AI researchers, and systems team members to craft the technical direction of the system.Key Responsibilities:Design and build user...


  • Stanford, United States Jerry Full time

    You could work anywhere. Why us? Join a pre-IPO startup with capital, traction and runway ($240M funded | 40X revenue growth in 4 years | $2T market size) Work closely with brilliant leaders and team mates from companies like McKinsey, Bain, BCG, Better, Nerdwallet etc. Disrupt a massive market and take us to a $5B business in the next few years Be immersed...