Quality Assurance Engineer for Generative AI

3 days ago


New York, New York, United States Diverse Lynx Full time

At Diverse Lynx LLC, we are seeking a highly skilled Quality Assurance Engineer for Generative AI. This role is responsible for ensuring the quality and reliability of our AI systems. The ideal candidate will have a strong background in Quality Engineering and experience with automation tools and techniques.

The estimated salary for this position is $140,000 - $170,000 per year, depending on location and experience. As a member of our team, you will be responsible for developing comprehensive test plans, conducting various types of testing, and automating tests to improve efficiency and reliability.

Key Responsibilities:

  • Develop and implement automation frameworks for Large Language Models
  • Integrate LLM automation tests into CI/CD pipelines
  • Conduct unit testing, component testing, and multi-component testing
  • Automate tests using various tools and techniques

Requirements:

  • 8+ years of proven work experience in Quality Engineering
  • Strong programming skills in languages such as Python, Java or similar
  • Experience with popular testing tools and frameworks (e.g. Selenium, JUnit, TestNG)
  • Knowledge of NLP concepts and techniques
  • Familiarity with CI/CD pipelines and version control systems (e.g. Jenkins, Git)


  • New York, New York, United States Scale AI Full time

    About Scale AIWe accelerate the development of AI applications at Scale AI. Our mission is to help organizations build and deploy AI faster across every industry.Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through human data generation, model evaluation, safety, and alignment. As a Software Engineer on our...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...


  • New York, New York, United States Scale AI Full time

    About ScaleWe are accelerating the development of AI applications to make a significant impact across every industry. Our mission is to transform how organizations build and deploy AI. We power the world's most advanced LLMs, generative models, and computer vision models, trusted by top companies like OpenAI, Meta, and Microsoft.Job DescriptionYou will be...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent funding, we're accelerating the abundance of frontier data to pave the road to Artificial General...

  • AI Systems Engineer

    3 weeks ago


    New York, New York, United States Scale AI Full time

    Job Title: AI Systems EngineerAt Scale AI, we're pushing the boundaries of artificial intelligence to transform industries and improve lives. As an AI Systems Engineer, you'll be instrumental in designing and developing cutting-edge AI systems that power the world's most advanced LLMs and generative models.Your Role:* Design and develop foundational...


  • New York, New York, United States Scale AI Full time

    About Scale AIAt Scale, our mission is to accelerate the development of AI applications that transform industries and improve lives. Our data foundry powers some of the world's most advanced LLMs and generative models through innovative approaches like Reinforcement Learning with Human Feedback (RLHF) and human data generation.About Our Horizontal Task...


  • New York, New York, United States BRIA AI Full time

    About BRIA AIWe are pioneers in visual generative AI, delivering cutting-edge solutions for commercial use. Our technology ensures superior quality, copyright protection, and safe content usage.Our platform revolutionizes visual communication by enabling developers and AI researchers to create custom models and AI-native apps and services using our...


  • New York, New York, United States Scale AI Full time

    About ScaleScale AI is transforming the way organizations build and deploy AI applications. Our mission is to accelerate the development of AI across every industry.We power the world's most advanced LLMs, generative models, and computer vision models. Trusted by leading companies like OpenAI, Meta, and Microsoft, as well as government agencies and...

  • AI Safety Engineer

    3 days ago


    New York, New York, United States Dynamo AI Full time

    Job DescriptionAt Dynamo AI, our mission is to empower every organization to harness AI's transformative potential with confidence and control. Our solutions enable customers to ensure AI safety and compliance while delivering top-tier AI innovations.We are seeking a highly talented and experienced Lead Software Engineer to lead the development of our ML...


  • New York, New York, United States Scale AI Full time

    **About Us** We believe the transition from traditional software to AI is one of the most important shifts of our time. Our mission is to make that happen faster across every industry, and our team is transforming how organizations build and deploy AI. Our products power the world's most advanced LLMs, generative models, and computer vision models. We are...

  • Senior AI Developer

    4 days ago


    New York, New York, United States Scale AI Full time

    **About Scale** We accelerate the development of AI applications. As a leading AI data foundry, we help fuel advancements in AI, including generative AI, defense applications, and autonomous vehicles. Our recent Series F round has enabled us to accelerate the abundance of frontier data to pave the road to Artificial General Intelligence (AGI). We're also...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale, our mission is to accelerate the development of AI applications. With 8 years of experience as a leading AI data foundry, we've helped drive advancements in AI, including generative AI, defense applications, and autonomous vehicles.We're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI)...


  • New York, New York, United States Scale AI Full time

    Platform Engineer RoleWe're looking for a skilled Platform Engineer to join our team at Scale. As a member of our engineering team, you'll have the opportunity to work on cutting-edge AI projects and develop your skills in areas like cloud platforms, data science, and distributed systems.ResponsibilitiesDesign and implement foundational platforms and systems...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale, we believe that the transition from traditional software to artificial intelligence is one of the most significant shifts of our time. Our mission is to accelerate this process across every industry, and our team is transforming how organizations build and deploy AI. SolutionsOur products power the world's most advanced large language...


  • New York, New York, United States Scale AI Full time

    Scale AI seeks highly skilled Senior Software Engineers to join its dynamic Federal Engineering team. As a part of this team, you will play a critical role in delivering high-impact AI-powered mission solutions for government customers.Key ResponsibilitiesDesign and implement scalable backend systems for Federal customers, leveraging Scale's modern and...

  • AI Software Architect

    4 weeks ago


    New York, New York, United States Lightning AI Full time

    Exciting Opportunity at Lightning AIAbout UsLightning AI is revolutionizing the development of artificial intelligence products. Our platform simplifies AI development, making it accessible to everyone-from solo researchers to large enterprises.We empower innovators to focus on solving real-world problems by removing the complexity of building and deploying...


  • New York, New York, United States Scale AI Full time

    About Scale">At Scale, our mission is to accelerate the development of AI applications. As a leading AI data foundry, we help fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. We are committed to making the transition from traditional software to AI one of the most important shifts of our...


  • New York, New York, United States Scale AI Full time

    Join Our TeamAt Scale AI, we're committed to making the transition from traditional software to AI a reality. Our mission is to accelerate AI development across industries.We power the world's most advanced LLMs, generative models, and computer vision models. Trusted by leading companies like OpenAI, Meta, and Microsoft, as well as government agencies and...


  • New York, New York, United States Magnus Technology Solutions Full time

    Job Title: Senior Generative AI EngineerLocation: New York, NYJob Type: Full TimeWork Authorization: Visa Independent OnlyWe are seeking a skilled Senior Generative AI Engineer to join our team at Magnus Technology Solutions.Estimated Salary: $120,000 - $180,000 per year, depending on experience.About the RoleThe ideal candidate will have extensive...

  • AI Engineering Leader

    4 weeks ago


    New York, New York, United States Consumer Reports Full time

    Lead AI/ML Engineer OpportunityWe are seeking a highly skilled Lead AI/ML Engineer to join our Data Office and drive the execution of a strategic multi-year roadmap focused on generative AI. As a key member of our team, you will leverage emerging data technologies and applied AI/ML techniques/frameworks to build reliable, scalable, and maintainable...