Software Engineer, GenAI Model Evaluation and Development

4 weeks ago


San Francisco, California, United States Scale AI Full time
About the Role

At Scale AI, we're at the forefront of the AI revolution, and we're looking for a talented Software Engineer to join our GenAI Safety & Evaluation product team. As a key member of our team, you'll play a critical role in building a world-class customer-facing model evaluation platform that enables customers to easily launch new evaluation workflows, deep dive into evaluation results, and use these insights to drive model development roadmaps.

About the Team

Our team is passionate about ensuring that AI models are safe, aligned, and highly useful. We're working closely with researchers from Scale's Safety, Evaluations, and Alignment Lab (SEAL) on productization of novel research and with Scale's expert red team, which supports AI safety via rigorous model testing trusted by the White House, major enterprises, and leading model developers.

About the Opportunity

This is an exciting opportunity to shape the way that models across the industry are evaluated, impacting billions of people around the world. As a Software Engineer on our team, you'll have the chance to build something impactful from the ground up and drive millions of dollars in revenue. You'll also get widespread exposure to the forefront of the AI race as Scale sees it in enterprises, startups, governments, and large tech companies.

About You

We're looking for a natural entrepreneurial engineer who can take an ambiguous scope and lead the execution of outcomes. You'll own large new areas within our product, work across backend, frontend, and interacting with LLMs and/or other ML models, deliver experiments at a high velocity and level of quality to engage our customers, and work across the entire product lifecycle from conceptualization through production. You'll also be able to multi-task and learn new technologies quickly and collaborate with cross-functional teams to define, design, and ship new product features and experiences.

What We Offer

We offer a competitive compensation package, including a base salary, equity, and benefits. Our benefits include comprehensive health, dental, and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend. We're committed to equal employment opportunity and are an affirmative action employer and inclusive and equal opportunity workplace. We're also committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.
  • Senior GenAI Engineer

    3 weeks ago


    San Francisco, California, United States DynPro Inc. Full time

    Only LOCAL to San Francisco Bay Area, CAResponsibilitiesDevelop GenAI applications using NLP techniques and Open AI , and validate outputs using APIs.Enable various GenAI business use cases utilizing client infrastructure with a focus on security and governance.Ability to develop complex applications in LLM, including developing chatbotsIntegrate generative...


  • San Jose, California, United States Opsin Full time

    Job SummaryWe are seeking a highly skilled Staff Software Engineer to join our team at Opsin. As a key member of our engineering team, you will be responsible for building and maintaining our GenAI security platform.About the RoleIn this role, you will work closely with our team to develop architecture and product features, ensuring the security and...


  • San Jose, California, United States SiMa Technologies Full time

    Job Title: Director, Business DevelopmentJob Description:SiMa Technologies is accelerating the efficiency, effectiveness, and ease of use of AIML and GenAI applications at the edge. Our team is building the AIML and Generative AI Silicon to Software tech stack to push the boundaries of model development at the edge for any framework, any network, any model,...


  • San Francisco, California, United States Genai Works Full time

    About the TeamThe Genai Works Health AI team is dedicated to developing safe and effective AI models for healthcare applications. Our mission is to improve global health outcomes by creating trustworthy AI models that assist medical professionals and enhance patient care.About the RoleWe are seeking a highly skilled Research Scientist to contribute to the...

  • Research Scientist

    4 weeks ago


    San Francisco, California, United States Databricks Full time

    About DatabricksDatabricks is a leading data and AI platform that enables data teams to solve complex problems and drive business outcomes.We are committed to empowering data teams to achieve their goals and make a meaningful impact.Job DescriptionWe are seeking a highly skilled Research Scientist to join our GenAI team. As a Research Scientist, you will be...


  • San Francisco, California, United States Genai Works Full time

    We're looking for a talented and experienced Product Designer to join our AI team at Genai Works and drive the creation of new AI-powered experiences.As an AI Experience Designer, you'll be an integral part of a collaborative team, contributing to both strategic vision and design execution.Key responsibilities include crafting exceptional AI experiences,...


  • San Francisco, California, United States Raz Talent Full time

    The OpportunityWe're seeking a highly skilled Senior Software Development Engineer to join our team at Raz Talent. As a key member of our engineering team, you'll work closely with our CTO to develop and productize advanced AI technologies.This is an exceptional opportunity to be part of a well-capitalized and dynamic environment, where you'll have the...


  • San Francisco, California, United States DigitalOcean Full time

    Transform the GenAI Space with UsWe are seeking a Senior Product Manager to lead the development of our groundbreaking GenAI platform, focusing on creating the simplest, most accessible GenAI solution in the market. As a key member of our team, you will play a pivotal role in shaping the future of AI at DigitalOcean.Key Responsibilities:Drive Product Vision:...


  • San Jose, California, United States Hewlett Packard Enterprise Development LP Full time

    Revolutionize Cloud Computing with HPEHewlett Packard Enterprise is seeking a talented Senior Cloud Developer, AI/GenAI/ML to join our Hybrid Cloud team and work on our OpsRamp platform. As a key member of our team, you will play a crucial role in building a large-scale, enterprise-ready platform that powers a hybrid edge-to-cloud world.Our platform enables...


  • San Francisco, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Software Development Engineer to join our team at Amazon. As a key member of our engineering team, you will be responsible for designing, building, and maintaining state-of-the-art systems for training and evaluating our best-in-class models.As a Senior Software Development Engineer, you will work closely...

  • Data Model Evaluator

    3 weeks ago


    San Francisco, California, United States CUBES Corporate Governance Full time

    CUBES Corporate Governance is seeking a highly skilled professional to fill the role of Data Model Evaluator.This position involves ensuring the accuracy and effectiveness of our models used in various business processes.The ideal candidate will have a strong background in data analysis and modeling, with a keen eye for detail and the ability to work...


  • San Francisco, California, United States Databricks Full time

    At Databricks, we are dedicated to empowering data teams to tackle the world's most complex challenges, from threat detection to medical breakthroughs.We achieve this by creating and operating the world's leading data and AI platform, allowing our customers to focus on high-impact initiatives central to their missions.The Mosaic AI organization drives AI...


  • San Francisco, California, United States Raz Talent Full time

    The OpportunityThis is an exciting chance to be part of a pioneering team at a well-capitalized GenAI company that has achieved remarkable growth. As one of the early engineers, you'll work closely with the CTO to develop and productize AI solutions that can handle complex tasks for businesses of all sizes.Key ResponsibilitiesDesign and implement AI-powered...

  • Software Engineer

    3 weeks ago


    San Francisco, California, United States ZIP Full time

    About the RoleAt Zip, we're pushing the boundaries of AI innovation to drive business growth. As a Software Engineer on our AI Lab team, you'll be responsible for building new AI use cases and iterating on existing solutions.Your Responsibilities Develop new AI use cases leveraging machine learning and GenAI technologies. Collaborate with cross-functional...


  • San Francisco, California, United States Triunity Software Full time

    Job Title : Java Developer Focused on Core Java Spring/Spring Boot/Spring BatchAt Triunity Software, we are seeking a skilled Java Developer to join our team. As a Java Developer, you will be responsible for designing, developing, testing, and deploying Java-based software applications using the Java Spring and Spring Batch frameworks.Key Responsibilities:...


  • San Francisco, California, United States Databricks Full time

    Job Description:As a Research Scientist on the GenAI Team at Databricks, you will be responsible for advancing the scientific frontier by creating new techniques that go beyond the state of the art in deep learning. You will work together on a collaborative team of researchers with diverse backgrounds and technical training. Your goal will be to make our...


  • San Francisco, California, United States Jerry Full time

    About the OpportunityWe are seeking a seasoned Principal Product Manager to lead the development and implementation of our GenAI prompt engineering platform, Propelix. This role will sit at the intersection of go-to-market and product, driving customer success and satisfaction for our early customers.ResponsibilitiesOwn and execute the implementation process...


  • San Francisco, California, United States Snap Full time

    Job Description:At Snap, we're looking for a skilled Software Engineering Manager to join our Model Serving Infrastructure Team. As a key member of our team, you'll be responsible for evaluating, testing, and debugging your work to ensure high-quality results. Key Responsibilities:Evaluate, test, and debug your work to ensure high-quality results.Experience...


  • San Francisco, California, United States Mind Full time

    About the teamMind Company's mission is to develop innovative neural interfaces that enable seamless communication between humans and computers. Our Research Team is responsible for designing and training machine learning models that translate brain data into useful forms.About the roleAs a Software Development Engineer, you will be working on all our...


  • San Jose, California, United States Adobe Full time

    About the RoleWe are seeking a highly skilled Firefly Model Architect to join our team at Adobe. As a Firefly Model Architect, you will be responsible for architecting novel large-scale foundation models in Generative AI, conducting innovative research and development, and developing applications based on the foundation models for Adobe products.Key...