Software Engineer, GenAI Model Quality
2 months ago
About Scale
At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.
About Data Engine
Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.
About our Quality team
Generating high-quality data is the core problem our business solves. Our Quality team focuses on building web-based applications that help measure our contributors' quality. As a Software Engineer on the team, you'll focus on building systems that monitor and flag quality issues with large-scale data collections. You will invest in Benchmark testing, ML models, heuristics, and other evaluation strategies to measure contributors' quality on a variety of Gen AI tasks.
Responsibilities:
- Own large areas within our product
- Build features end-to-end: front-end, back-end, system design, debugging and testing
- Deliver experiments at a high velocity and level of quality to engage our customers
- Work across the entire product lifecycle from conceptualization through production
- Influence the culture, values, and processes of a growing engineering team
- Inspire and mentor less experienced engineers
- Collaborate with cross-functional teams to define, design, and ship new product features and experiences.
Requirements:
- At least 3 years of relevant experience is preferred
- Track record of shipping high-quality products and features at scale
- Desire to work in a very fast-paced environment
- Ability to turn business and product ideas into engineering solutions
- Excellent problem-solving skills, and be able to work independently or as part of a team.
- Excited to join a dynamic, hybrid team in either San Francisco or New York City
-
Software Engineer for Frontier AI
6 days ago
San Francisco, California, United States Genai Works Full timeAbout Genai WorksGenai Works is a pioneering technology company that leverages artificial intelligence to drive innovation and push the boundaries of human understanding.As a member of our Human Data team, you'll play a critical role in delivering high-quality data to drive frontier model performance. You'll collaborate with other teams to develop new...
-
Senior Software Engineer, GenAI Model Evaluation
3 weeks ago
San Francisco, United States Scale AI, Inc. Full timeAbout JobSoftware is eating the world, but AI is eating software. We live in unprecedented times - AI has the potential to exponentially augment human intelligence. As the world adjusts to this new reality, leading tech companies are racing to build LLMs at billion dollar scale, while large enterprises figure out how to add it to their products. To ensure...
-
Senior Data Engineer
7 days ago
San Francisco, California, United States Genai Works Full timeAbout Genai WorksGenai Works is a leading innovator in the field of artificial intelligence, dedicated to creating intelligent systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.We are a small, highly motivated team focused on engineering excellence and committed to fostering a culture of collaboration,...
-
Software Engineer, GenAI Model Quality
4 weeks ago
San Francisco, CA, United States Scale AI, Inc. Full timeAbout Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to...
-
GenAI Model Enhancement Expert
2 weeks ago
San Francisco, California, United States Databricks Full timeAbout the OpportunityWe are excited to offer a unique opportunity for a Research Scientist to join our GenAI Team at Databricks. As a key member of our team, you will be responsible for advancing the scientific frontier in deep learning and creating new techniques that push beyond the state-of-the-art.Key ResponsibilitiesDevelop and implement novel research...
-
Senior Software Engineer, GenAI Model Quality
2 months ago
San Francisco, United States Scale AI, Inc. Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...
-
San Francisco, California, United States Tbwa ChiatDay Inc Full timeSenior Fullstack Software Engineer, GenAI QualityAbout ScaleWe are accelerating the development of AI applications to fuel advancements in generative AI, defense applications, and autonomous vehicles. Our recent Series F round has paved the way for Artificial General Intelligence (AGI).About Data EngineWe power the world's most advanced LLMs and generative...
-
Software Engineer, GenAI Violations
2 months ago
San Francisco, United States Scale AI, Inc. Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...
-
Senior GenAI Engineer
2 weeks ago
San Francisco, California, United States Amazon Full timeAbout the Position:">We are seeking a Senior GenAI Specialist Solutions Architect to join our team at Amazon. This role will be responsible for designing and implementing cloud-based solutions that leverage Generative AI (GenAI) technologies.">As a Senior GenAI Specialist Solutions Architect, you will work closely with our engineering teams to develop...
-
Machine Learning Engineer
7 days ago
San Francisco, California, United States Genai Works Full timeJoin Our MissionAt Genai Works, we're driven by a shared vision to use AI for the betterment of humanity. Our team of experts is dedicated to pushing the boundaries of what's possible with AI technology.We believe in fostering a culture of collaboration, innovation, and mutual respect. If you're a talented AI engineer looking for a dynamic work environment,...
-
AI / ML Engineer
2 months ago
San Francisco, United States Seven Seven Software Full timeAI / ML (Artificial Intelligence , Machine Learning) Engineer 1. Experience in engineering and deploying Generative AI models, specifically focusing on Retrieval-Augmented Generation (RAG) systems and multi-agent workflows. 2. Strong software engineering foundation in developing and implementing state-of-the-art generative techniques and designing advanced...
-
San Francisco, United States Scale AI, Inc. Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...
-
AI Systems Developer
6 days ago
San Francisco, California, United States Genai Works Full timeAbout Genai WorksWe're a cutting-edge tech company driven by innovation and a passion for pushing the boundaries of artificial intelligence. Our mission is to develop intelligent systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.At Genai Works, we foster a culture of collaboration, creativity, and continuous...
-
Senior Software Engineer, GenAI Model Quality
4 weeks ago
San Francisco, CA, United States Scale AI, Inc. Full timeAbout Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to...
-
GenAI Cloud Expert
2 weeks ago
San Francisco, California, United States Amazon Full timeCompany Overview:Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. As a pioneer in cloud computing, we continue to innovate and provide robust products and services to power businesses worldwide. Our commitment to diversity and inclusion fosters a culture that empowers employees to be proud of their...
-
Senior Software Engineer, GenAI Violations
2 months ago
San Francisco, United States Scale AI, Inc. Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...
-
GenAI Technical Lead
2 weeks ago
San Francisco, California, United States Amazon Full timeJob Summary:">The Senior GenAI Engineer will be responsible for leading the development and implementation of GenAI solutions on Amazon Web Services (AWS), leveraging expertise in large language models, distributed training and inference, model evaluation, and fine-tuning techniques.">This role requires deep technical experience working with technologies...
-
Software Engineer, GenAI Outlier
2 months ago
San Francisco, United States Scale AI, Inc. Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...
-
Software Engineer, GenAI Violations
4 weeks ago
San Francisco, CA, United States Scale AI, Inc. Full timeAbout Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to...
-
Audio GenAI Research Engineer
1 week ago
San Francisco, California, United States Adobe Full timeCompany OverviewAt Adobe, we're passionate about empowering people to create beautiful and powerful images, videos, and apps. We're on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity.SalaryWe pay competitively, with an estimated annual salary of...
