Quality Assurance Engineer for Generative AI

4 weeks ago


New York, New York, United States Synechron Full time

About the Role

We are seeking a highly skilled Quality Assurance Engineer to join our team at Synechron. As a Quality Assurance Engineer for Generative AI, you will be responsible for ensuring the quality and reliability of our AI systems.

Responsibilities

  • Develop comprehensive test plans and strategies for Generative AI implementations.
  • Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions.
  • Collaborate with stakeholders to identify testing requirements and priorities.
  • Identify and document defects, issues, and risks related to Generative AI implementations.
  • Work closely with developers and program managers to prioritize and resolve issues in a timely manner.
  • Develop and maintain automated test scripts and frameworks for efficient and effective testing.
  • Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations.
  • Stay up to date with new testing approaches, tools, and test strategies.

Requirements

  • 8+ years of proven work experience in Quality Engineering.
  • Hands-on experience in prompt engineering concepts.
  • Proven experience in developing and implementing automation frameworks for Large Language Models.
  • Strong programming skills in languages such as Python, Java, or similar.
  • Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG).
  • Knowledge of NLP (Natural Language Processing) concepts and techniques.
  • Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git).
  • Strong problem-solving and analytical skills.
  • Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java.
  • Proficiency in usage of PostgreSQL and Vector databases (ReDis) or large datasets.
  • Team player with good communication skills to work effectively in a global team.

About Synechron

Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. We believe in the power of digital to transform businesses for the better.

What We Offer

  • A highly competitive compensation and benefits package.
  • A multinational organization with 55 offices in 20 countries and the possibility to work abroad.
  • Laptop and a mobile phone.
  • 10 days of paid annual leave (plus sick leave and national holidays).
  • Maternity & Paternity leave plans.
  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
  • Retirement savings plans.
  • A higher education certification policy.
  • Commuter benefits (varies by region).
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
  • Cutting edge projects at the world's leading tier-one banks, financial institutions and insurance firms.
  • A flat and approachable organization.
  • A truly diverse, fun-loving and global work culture.


  • New York, New York, United States Scale AI Full time

    About ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...


  • New York, New York, United States Scale AI Full time

    About Scale AIScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make AI more accessible and efficient for organizations across various industries.About Data EngineOur Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF, human data generation,...


  • New York, New York, United States Scale AI Full time

    About Scale AIAt Scale AI, we're accelerating the development of AI applications. Our mission is to make AI accessible to every industry, and our team is transforming how organizations build and deploy AI.About the RoleWe're seeking a skilled Software Engineer to join our AI Growth team. As a key member of our team, you'll be responsible for building and...


  • New York, New York, United States Scale AI Full time

    Job Title: Director of Operations, Generative AIScale AI is seeking a highly skilled Director of Operations to lead our Generative AI business unit. As a key member of our team, you will be responsible for overseeing the development and delivery of datasets for our customers.Key Responsibilities:Lead cross-functional projects with diverse stakeholders,...


  • New York, New York, United States Scale AI Full time

    About ScaleScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make the transition from traditional software to AI happen faster across every industry. We power the world's most advanced LLMs, generative models, and computer vision models, trusted by companies like OpenAI, Meta, and Microsoft, as well...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...

  • AI/ML Engineer

    3 weeks ago


    New York, New York, United States Artian AI Full time

    About Artian AIArtian AI is an innovative tech startup focused on developing cutting-edge AI platforms for enterprise workflows. Our team has deep expertise in AI/ML and building robust agent-based workflows and multi-agent systems in mission-critical enterprises.We are seeking an experienced AI/ML Engineer to accelerate the development of our AI platform....


  • New York, New York, United States Citigroup Inc Full time

    Job SummaryCitigroup Inc. is seeking a highly skilled Generative AI Platform Engineer to join our team. As a key member of our Common Platform Engineering team, you will be responsible for designing and building high-quality, highly reliable software platforms that leverage the power of Generative AI.Key Responsibilities:Design and build scalable software...

  • AI Quality Director

    4 weeks ago


    New York, New York, United States invisible-technologies Full time

    Director of AI ExcellenceAbout Invisible Technologies:Invisible Technologies is a pioneering company that combines human creativity and intuition with cutting-edge technology to create a future rich in impact and meaning. We believe that human involvement is essential in unlocking the full potential of AI, ensuring it is developed with greater accuracy,...

  • AI UX/UI Engineer

    4 weeks ago


    New York, New York, United States Arena AI Full time

    About the RoleIn this position, you will be working closely with internal teams and external customers to design and build novel user interfaces across our product suite. Your focus will be on enabling our users to understand the impact and performance of our deployed machine learning systems in new and novel ways.As an AI UX/UI Engineer, you will be...


  • New York, New York, United States Scale AI Full time

    At Scale AI, we're expanding our team to accelerate the development of AI applications. As a Director of Operations, you'll lead the team that builds and delivers datasets for our customers for one of the Gen AI verticals.This is a demanding role, and as a Director of Operations, you should be prepared to wear many hats such as Operator, Product Manager, and...


  • New York, New York, United States Synechron Full time

    Job Description: We are seeking a highly skilled Generative AI Engineer - Azure Open AI to join our team at Synechron. As a key member of our cloud engineering team, you will be responsible for designing, developing, and deploying AI-based cloud and hybrid applications on Azure. Key Responsibilities: Translate business requirements into viable AI solutions...


  • New York, New York, United States invisible-technologies Full time

    About the Role:We are seeking a highly experienced AI Quality Excellence Lead to join our team at Invisible Technologies. As a key member of our operations management, you will be responsible for driving excellence and innovation in our AI training processes.Job Description:The AI Quality Excellence Lead will oversee the quality assurance process, ensuring...


  • New York, New York, United States Pfizer Full time

    Pharmacovigilance AI Quality Oversight LeadROLE SUMMARYThe Pharmacovigilance AI Quality Oversight Lead is responsible for overseeing the strategic development and implementation of quality plans, establishing guidelines, and managing oversight governance to ensure the quality and reliability of AI systems that may affect pharmacovigilance.This involves...


  • New York, New York, United States Glow Networks Full time

    Job Title: Generative AI Application DeveloperJob Summary:We are seeking a talented Generative AI Application Developer to join our team at Glow Networks. As a key member of our team, you will be responsible for developing and testing Generative AI and ML solutions that focus on technology improvements.Responsibilities:Collaborate with cross-functional teams...

  • AI Research Scientist

    4 weeks ago


    New York, New York, United States WerQ AI Full time

    Job Title: AI Research ScientistAt WerQ AI, we are dedicated to creating innovative AI solutions that enhance workplace productivity and efficiency. We are seeking an AI Research Scientist to contribute to our mission by conducting cutting-edge research and developing advanced algorithms in the field of artificial intelligence.Key Responsibilities:Conduct...


  • New York, New York, United States Citigroup Full time

    Job SummaryCitigroup is seeking a highly skilled Generative AI Platform Engineer to join our Common Platform Engineering team. As a key member of this team, you will be responsible for designing and building high-quality, highly reliable software platforms that meet the needs of our users across the bank.Key ResponsibilitiesDesign and build high-quality,...


  • New York, New York, United States Citigroup Full time

    Job SummaryWe are seeking a highly skilled Generative AI Platform Engineer to join our team at Citigroup. As a key member of our Common Platform Engineering team, you will be responsible for designing and building high-quality, highly reliable software platforms that meet the needs of our users across the bank.Key Responsibilities:Design and build...


  • New York, New York, United States Diverse Lynx Full time

    Job Description:As a Quality Assurance Automation Engineer at Diverse Lynx, you will be responsible for ensuring the quality and reliability of AI systems developed under the EDM GENAI project.Key Responsibilities: Conduct various types of testing, including unit testing, component testing, and multi-component testing. Automate tests to improve efficiency...

  • AI Engineering Lead

    4 weeks ago


    New York, New York, United States Normal Computing Full time

    Your Role in Our Mission:As an AI Engineer Lead at Normal Computing, you will play a pivotal role in leading and managing projects from concept to production, mentoring team members, and influencing the strategic direction of our AI initiatives.Knowledge of semiconductor design and manufacturing is a plus.Responsibilities:Lead AI projects from concept to...