Centralized Data Engineer for Large Language Models

3 weeks ago


San Francisco, California, United States a16z Full time

At a16z, we believe that data is the backbone of informed decision-making and effective support for our portfolio companies. Our centralized data organization builds and manages the infrastructure that supports our data lake, data pipelines, data ingestion, and data visualizations. We leverage cutting-edge General Artificial Intelligence (GenAI) alongside traditional data & analytics to empower our firm.

The Role

We are seeking a highly skilled Full Stack Engineer to join our team in developing applications for our large language model (LLM) projects. As a key member of our centralized data organization, you will work across the entire stack, from front-end development to backend systems, ensuring seamless integration and functionality. Your ability to move up and down the stack as needed will be critical in delivering robust and user-friendly applications.

Your primary responsibilities will include:

  • Designing, developing, and maintaining front-end applications using modern frameworks and tools
  • Building and optimizing backend services and APIs to support front-end functionalities
  • Working with LLMs and building robust applications that leverage GenAI
  • Collaborating with cross-functional teams to gather requirements and translate them into technical solutions
  • Implementing best practices for code quality, performance, and security across the stack
  • Developing and integrating with third-party tools, such as Slack, to enhance user experiences
  • Working with data analytics pipelines and workflows to ensure seamless data integration and processing

To succeed in this role, you should possess:

  • 6+ years of experience in full-stack development, with a strong focus on both front-end and backend technologies
  • Experience working with LLMs, either in a work or hobby capacity, preferred
  • Proficiency in front-end frameworks
  • Proven ability to build and maintain RESTful APIs and integrate with third-party services
  • Experience with database technologies such as SQL
  • Familiarity with data analytics pipelines, workflows, and platforms such as Databricks
  • Excellent problem-solving skills and the ability to work independently in a fast-paced environment
  • Strong communication skills and the ability to collaborate effectively with cross-functional teams
  • Knowledge of cloud platforms and services, such as AWS, Azure, Google Cloud, Databricks
  • Experience with building chat-based applications preferred
  • Familiarity with containerization technologies such as Docker preferred

This role is eligible to participate in the a16z Carry program and various discretionary bonus programs as well as benefit and perquisite plans including health, dental, vision, disability, life insurance, 401K plan, vacation, and sick leave.

a16z culture emphasizes doing first-class business in a first-class way. We take a long view of relationships, believing in the future and betting the firm accordingly. We celebrate diversity, recognizing that it makes us stronger. We hire candidates of any race, color, ancestry, religion, sex, national origin, sexual orientation, gender identity, age, marital or family status, disability, Veteran status, and any other status.

Our estimated salary range for this role is between $225,000-$263,000, based on industry standards and the location.



  • San Francisco, California, United States a16z Full time

    At a16z, we are seeking a highly skilled Data Engineer to join our team in building applications for large language model projects. As a key member of our centralized data organization, you will play a pivotal role in developing applications that leverage cutting-edge GenAI.The ideal candidate will have 6+ years of experience in full-stack development, with...


  • San Francisco, California, United States Perplexity AI Full time

    Leveraging Expertise in Large Language ModelsAre you an expert in large language models and conversational AI? Do you thrive in fast-paced environments where no two days are alike? We're Perplexity AI, a cutting-edge company dedicated to revolutionizing the conversational AI landscape. As a seasoned Large Language Model Engineer, you will play a pivotal role...


  • San Francisco, California, United States Supernormal Technologies, Inc. Full time

    About Supernormal Technologies, Inc.We are a pioneering company in the field of artificial intelligence, dedicated to transforming spoken communication for individuals, teams, and organizations. Our mission is to harness the power of large language models to revolutionize the way people interact and collaborate. At Supernormal Technologies, Inc., we value...


  • San Francisco, California, United States Slack Full time

    About SalesforceWe are the Customer Company, inspiring the future of business with AI+ Data +CRM. Our mission is to help companies across every industry blaze new trails and connect with customers in a whole new way.As a Data Science Engineer, you will craft and implement machine learning and generative AI powered features that leverage our data to make a...


  • San Francisco, California, United States OpenAI Full time

    Research Engineer, Data ProcessingAbout the Company:OpenAI is an artificial intelligence research and deployment company dedicated to ensuring that general-purpose AI benefits all of humanity.About the Role:We are seeking a highly skilled Research Engineer to build AI systems that can perform previously impossible tasks or achieve unprecedented levels of...


  • San Francisco, California, United States salesforce Full time

    Job Description:We are seeking a highly experienced Software Architect to lead the development and implementation of large language models at Salesforce. This role requires a deep understanding of Salesforce architecture, software quality assurance, and the ability to assess and optimize large language models for delivering accurate, safe, and high-quality...


  • San Francisco, California, United States Scale AI, Inc. Full time

    Scale AI, Inc.We are seeking a highly skilled Machine Learning Engineer to join our team at Scale AI, Inc. as a key member of our research and development efforts in large language models. This is an exciting opportunity to work with the industry's leading foundation model labs, design next generation data pipelines, and contribute technically and...


  • South San Francisco, California, United States Genentech Full time

    About GenentechGenentech fosters diversity, equity, and inclusion, representing the communities we serve. With a strong commitment to innovation, our team is dedicated to understanding people's varied healthcare needs. We believe that collaboration and exceptional care are key to our success.About the RoleWe are seeking an experienced Principal Engineer to...


  • San Francisco, California, United States RemoteWorker CA Full time

    At RemoteWorker CA, we are on the forefront of AI innovation. As an AI Innovator in Large Language Models, you will be part of our team that builds and ships state-of-the-art scalable architecture and AI/ML solutions for our award-winning mobile app.We partner with product, tech, and design teams to deliver app features that delight customers with dynamic...

  • Technical Lead

    3 days ago


    San Francisco, California, United States Rippling Full time

    Rippling is a leading provider of unified workforce platforms, offering businesses a comprehensive solution for managing HR and IT processes. We are seeking an experienced Senior Staff Machine Learning Engineer to join our team and contribute to the advancement of our organization's machine learning capabilities.About the RoleWe are looking for a highly...

  • Senior AI Scientist

    3 days ago


    San Francisco, California, United States Capital One Full time

    Job SummaryWe are seeking a highly skilled Senior AI Scientist to lead our efforts in developing large language models. As a member of our AI Foundations team, you will partner with cross-functional teams to deliver AI-powered platforms and solutions that change how customers interact with their money. You will leverage a broad stack of technologies to...


  • San Francisco, California, United States Courteasy Full time

    Job Title: Leading Large Language Model ExpertAbout Court Easy AI:Court Easy AI is a pioneering AI company that is leveraging cutting-edge technology to automate the legal industry. We are seeking an experienced professional to join our team as a Leading Large Language Model Expert.Compensation Package: $150,000 - $200,000 per yearJob Summary:In this role,...

  • AI Engineer

    3 weeks ago


    San Francisco, California, United States Databricks Inc. Full time

    About the RoleWe are seeking an experienced AI Engineer to join our team in developing large language models. As a key member of our platform engineering group, you will be responsible for designing and implementing the infrastructure that powers our generative AI platform.Your primary focus will be on building out our ML model development lifecycle,...


  • San Francisco, California, United States HireIO Inc Full time

    Job OpportunityWe are looking for a talented Large Scale Model Developer to join our team in the USA/California/SF Bay Area/San Jose. This role comes with a salary of $160,000 per year.ResponsibilitiesDevelop and optimize large-scale language models to extreme levels.Construct data, tune instructions, align preferences, and optimize models.Implement relevant...


  • San Jose, California, United States HireIO Inc Full time

    HireIO Inc is seeking an experienced Large Scale Model Trainer and Engineer to join our team. In this role, you will be responsible for developing and deploying large-scale language models and optimizing enterprise applications.About the JobThis is a challenging and rewarding role that requires a strong background in machine learning, with experience in...


  • San Francisco, California, United States Jobot Full time

    Career Opportunity: As an AI Framework Engineer, you will be part of a talented team working on cutting-edge machine learning projects. Your expertise in large language models and/or GenAI will drive the development of our innovative product.


  • San Francisco, California, United States HireIO Inc Full time

    We are looking for a highly skilled Large Scale Model Developer to join our team at HireIO Inc. In this role, you will be responsible for the research and application of large-scale models, exploring new applications and solutions for related technologies in the fields of search, recommendation, advertising, content creation, and customer service.The...


  • San Jose, California, United States HireIO Inc Full time

    HireIO Inc is a forward-thinking company that prioritizes innovation and cutting-edge technology.We are currently seeking a highly skilled Senior Large Language Model Developer to join our team. The estimated salary for this position is $140,000 - $160,000 per year.About the Role:The main responsibilities of this position include:Developing and optimizing...


  • San Francisco, California, United States salesforce Full time

    We are seeking a highly skilled Data Scientist to join our Search Relevance team at Salesforce. As part of this role, you will design and develop 'intelligence' features on our outstanding search service, which serves millions of requests daily on a diverse corpus of data including structured, unstructured and social feeds.The ideal candidate will have at...


  • San Francisco, California, United States Jobot Full time

    We're looking for an expert AI Framework Engineer to drive innovation in our cutting-edge platform for developers building Generative AI applications.About the JobThe successful candidate will have a solid foundation in AI development, with expertise in programming languages commonly used in AI, such as Python, R, or Java.Portfolios showcasing successful...