Data Engineering Team Lead

18 hours ago


San Francisco, California, United States Perplexity AI Full time

Perplexity AI is seeking a seasoned technical director to oversee the growth and scalability of our data engineering team. The ideal candidate will lead the design, creation, and deployment of systems that power product experiences across a growing tech stack.

The exponential increase in data at Perplexity AI necessitates the investment in a robust data engineering team responsible for building reusable tools for instrumentation, ingestion, and retrieval.

Key Responsibilities
  • Provide visionary leadership to multiple layers of a rapidly expanding product.
  • Establish and maintain standards for reliability, code quality, testing, and maintenance.
  • Oversee onboarding and ensure high-quality code for a growing team of engineers.
  • Collaborate closely with data science and machine learning teams to create reusable data sources.
  • Work closely with infrastructure, full-stack, and frontend teams to implement logging and build reusable tooling.
  • Develop rigorous interview pipelines and work closely with recruiting to source top talent.
Requirements
  • Demonstrate expertise in designing scalable and reusable systems and processes.
  • Able to identify technical debt constructively.
  • Able to resolve complex engineering blockers effectively.
  • Strong organizational skills for managing and delivering parallel technical projects.
  • Proven experience working with multiple small teams of engineers.
  • Experience leveraging open-source and in-house solutions strategically.
  • Familiarity with AI/ML capabilities and limitations.
  • Minimum 8 years of engineering experience.
  • At least 4 years of engineering management experience.
Nice to Have
  • Experience building data platforms for real-time indexing and retrieval.
  • Proficiency in AWS, Databricks, and Snowflake.
Compensation

The base salary for this role is $275,000.

We offer a comprehensive compensation package including equity, benefits, and cash bonuses.



  • San Francisco, California, United States Perplexity AI Full time

    Perplexity AI OverviewAt Perplexity AI, we are revolutionizing the way people search and interact with the internet. Our conversational answer engine has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices.We have raised significant funding from some of the most...


  • San Francisco, California, United States Peregrine Technologies Full time

    About Peregrine TechnologiesPeregrine Technologies is a leading provider of innovative software solutions for public safety agencies across the United States. With a strong foundation in technology and a passion for making a difference, we empower our customers to improve operations and make better decisions in the moments that matter.We are a team of public...


  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.


  • San Francisco, California, United States WEX Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. The ideal candidate will have extensive experience in designing and implementing cloud-based data solutions, with a strong focus on scalability, performance, and data governance.The Data Engineering Lead will be responsible for leading the design and...


  • San Francisco, California, United States Federal Reserve Bank Full time

    Job OverviewThe Federal Reserve Bank of San Francisco seeks a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing cloud-based data and AI solutions that meet the needs of our business stakeholders. This is an excellent opportunity to work with...


  • San Francisco, California, United States Advanced Engineering Group LLC Full time

    Company Overview: Advanced Engineering Group LLC is a leading technology firm that seeks highly motivated and enthusiastic engineers to join our product development team. Our technology stack primarily includes Java/Javascript, and while experience with these languages is beneficial, it's not essential.Job Description: We're looking for an exceptional Data...


  • San Francisco, California, United States Windfall Data, Inc. Full time

    Windfall Data, Inc. is seeking a seasoned data professional to play a pivotal role in developing and scaling our foundational predictive models.This is a highly impactful position where you will influence the core of our data product offerings and collaborate with cross-functional teams to maintain the highest standards of model performance.We're on a...


  • San Francisco, California, United States eTeam Inc. Full time

    eTeam Inc. is seeking a talented Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and managing large-scale data pipelines and workflows using Trino SQL/Spark SQL warehoused in HDFS datasets.We offer a competitive salary of $120,000 - $150,000 per year, depending on...

  • Data Engineer Lead

    7 days ago


    San Francisco, California, United States Tekfortune Inc Full time

    Job Summary: Tekfortune Inc is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations. We are looking for an experienced GCP Data Engineer to fill this 12+ month contract position. The successful candidate will provide technical leadership and contribute to the definition,...

  • Technical Lead

    2 days ago


    San Francisco, California, United States Discord Full time

    Job DescriptionWe are seeking a highly skilled Technical Lead - Data Engineering to join our team and help us build and maintain the data infrastructure that powers our platform. As a Technical Lead, you will be responsible for overseeing the development and implementation of data solutions that meet the needs of our business.You will work closely with our...


  • San Francisco, California, United States Tekfortune Inc Full time

    **Job Title:** Enterprise Data Engineering Lead**Job Summary:**Tekfortune Inc is seeking an experienced enterprise data engineering lead to join our team. As a key contributor, you will design and implement PI systems, components, and interfaces, and lead our data engineering efforts to drive business growth.We offer a competitive salary package starting at...


  • San Francisco, California, United States Scale AI Full time

    Job DescriptionWe are seeking a highly experienced and skilled Data Science Team Lead to join our team at Scale AI. The successful candidate will lead a talented group of research engineers and machine learning engineers in delivering scalable, production-ready solutions for our GenAI Data Engine.The ideal candidate will have a strong background in deep...


  • San Francisco, California, United States Eppo, Inc Full time

    About Eppo, Inc.We are a pioneering company in the experimentation space, empowering businesses to make data-driven decisions. Our cutting-edge platform combines the modern data stack with high-velocity experimentation, enabling customers to unlock new insights and drive growth.Job OverviewThis role is perfect for a seasoned software engineer who is...


  • San Francisco, California, United States DoorDash USA Full time

    **About DoorDash USA**We are a technology company at heart, using data to fuel our mission of connecting people with the food they love. Our Data Engineering team plays a critical role in this mission, building scalable database solutions for various use cases.About the Role:We are seeking a highly experienced Staff Software Engineer, Data to join our Data...


  • San Francisco, California, United States Splunk Inc. Full time

    Job Summary:Splunk Inc. is seeking an experienced Software Engineering Team Lead to join our Lakehouse team. This role will involve leading the development of new query capabilities for the Splunk platform, extending its ability to search and analyze data from various sources.About Us:We're a company that's passionate about making machine data accessible,...


  • San Francisco, California, United States Refuel AI Full time

    Refuel AI is looking for an experienced Data Scientist Team Lead to spearhead the direction of our engineering team as we scale. Our platform enables enterprises to clean, enrich, and label their data at superhuman accuracy using state-of-the-art LLMs. As a key member of our team, you will work closely with our machine learning and product teams to design...


  • San Francisco, California, United States WEX Full time

    About the Role">We are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. As a key member of our organization, you will play a critical role in designing and implementing industry-leading data solutions that meet the needs of our business. The ideal candidate will have extensive experience working with AWS services, Snowflake, and...


  • San Francisco, California, United States OpenAI Full time

    About the CompanyAt OpenAI, we're dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.The roleWe're looking for a seasoned Data Engineer to help drive our product analytics and growth. The ideal...

  • Data Engineer Lead

    3 days ago


    San Francisco, California, United States Unity Technologies Full time

    Job DescriptionThis is an exciting opportunity to work with our global and cross-functional teams to create meaningful data products and drive technical solutions. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines and services to enable data-driven insights and power BI, ML, experimentation, and user-facing...


  • San Francisco, California, United States Quantum Technologies. LLC Full time

    Quantum Technologies. LLC is seeking a Director of Data Science for an immediate opportunity in San Francisco.The ideal candidate will be a proven leader, with deep analysis and programming skills and have an exemplary understanding of statistics and hypothesis testing.Key Responsibilities:Lead the data scientist team to deliver AI/ML based products.Work...