Quality Assurance Engineer with Generative AI

4 weeks ago


New York, New York, United States Synechron Full time
Job Title: Quality Assurance Engineer with Generative AI

At Synechron, we are seeking a highly skilled Quality Assurance Engineer to join our team and contribute to the development of our Generative AI systems. As a Quality Assurance Engineer, you will be responsible for ensuring the quality and reliability of our AI systems, working closely with the development team and key stakeholders to understand project requirements and develop comprehensive test plans.

Responsibilities:
  • Develop and execute test strategies and plans for Generative AI implementations
  • Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions
  • Collaborate with stakeholders to identify testing requirements and priorities
  • Identify and document defects, issues, and risks related to Generative AI implementations
  • Work closely with developers and program managers to prioritize and resolve issues in a timely manner
  • Develop and maintain automated test scripts and frameworks for efficient and effective testing
  • Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations
  • Stay up to date with new testing approaches, tools, and test strategies
Requirements:
  • 8+ years of proven work experience in Quality Engineering
  • Hands-on experience in prompt engineering concepts and integrating LLM automation tests into continuous integration and continuous deployment pipelines
  • Proven experience in developing and implementing automation frameworks for Large Language Models
  • Strong programming skills in languages such as Python, Java, or similar
  • Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG)
  • Knowledge of NLP (Natural Language Processing) concepts and techniques
  • Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git)
  • Strong problem-solving and analytical skills
  • Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java
  • Proficiency in usage of PostgreSQL and Vector databases (ReDis) or large datasets
  • Team player with good communication skills to work effectively in a global team
What We Offer:
  • A highly competitive compensation and benefits package
  • A multinational organization with 55 offices in 20 countries and the possibility to work abroad
  • Laptop and a mobile phone
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & Paternity leave plans
  • A comprehensive insurance plan including: medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • Cutting edge projects at the world's leading tier-one banks, financial institutions and insurance firms
  • A flat and approachable organization
  • A truly diverse, fun-loving and global work culture

Synechron is an equal opportunity employer and welcomes applications from diverse candidates. We are committed to fostering an inclusive culture that promotes equality, diversity, and respect for all employees. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply.



  • New York, New York, United States Synechron Inc. Full time

    Job SummaryWe are seeking a highly skilled Quality Assurance Engineer to join our team at Synechron Inc. in a challenging role that involves ensuring the quality and reliability of our Generative AI systems. As a Quality Assurance Engineer, you will work closely with our development team to understand project requirements and develop comprehensive test...


  • New York, New York, United States Scale AI Full time

    About Scale AIScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make AI more accessible and efficient for organizations across various industries.About Data EngineOur Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF, human data generation,...


  • New York, New York, United States Scale AI Full time

    Scale AI: Director of Operations for Generative AIScale AI is at the forefront of the AI revolution, and we're seeking a seasoned Director of Operations to lead our Generative AI business unit. As a key member of our team, you'll be responsible for driving the growth and success of our AI operations.Key Responsibilities:Lead cross-functional projects with...


  • New York, New York, United States Scale AI Full time

    Scale AI Job DescriptionScale AI is seeking a highly skilled Director of Operations to lead our Generative AI business unit. As a key member of our team, you will be responsible for overseeing the development and delivery of datasets for our customers.Key Responsibilities:Lead cross-functional projects with diverse stakeholders, including Engineering, Ops,...


  • New York, New York, United States Fireworks AI Full time

    About Fireworks AIWe're building the future of generative AI infrastructure at Fireworks AI. Our platform offers high-quality models and fast, scalable inference.Our team has been independently benchmarked to have the fastest LLM inference and has gained traction with innovative research projects, such as function calling and multi-modal models.We're backed...

  • AI Software Engineer

    4 weeks ago


    New York, New York, United States Slingshot AI Full time

    About the RoleAs an AI engineer at Slingshot AI, you'll be part of a dynamic team that's pushing the boundaries of artificial intelligence. Your primary focus will be on developing and implementing cutting-edge language models that drive our end-user product forward. You'll work closely with our product team to design, develop, and deploy AI-powered...


  • New York, New York, United States Scale AI Full time

    Fraud Product Manager, Generative AIAt Scale AI, we're pushing the boundaries of AI development by building the Generative AI Data Engine. We're seeking a Fraud Product Manager to join our team and help us prevent fraudulent activities on our platform. As a Fraud Product Manager, you'll work closely with cross-functional teams to develop innovative solutions...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We're a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...


  • New York, New York, United States Scale AI Full time

    About ScaleScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make the transition from traditional software to AI happen faster across every industry. We power the world's most advanced LLMs, generative models, and computer vision models, trusted by companies like OpenAI, Meta, and Microsoft, as well...


  • New York, New York, United States Scale AI Full time

    About the RoleWe are seeking a highly skilled and experienced Director of Operations to lead our Generative AI business unit. As a key member of our team, you will be responsible for overseeing the day-to-day operations of the unit, ensuring that we deliver high-quality products and services to our customers.Key ResponsibilitiesLead cross-functional projects...


  • New York, New York, United States Scale AI Full time

    About the RoleAt Scale AI, we're looking for an experienced AI/ML Infrastructure Engineer to join our team. As a key member of our Machine Learning Infrastructure team, you'll be responsible for building and maintaining our Training Platform. This is a unique opportunity to work with cutting-edge technology and contribute to the development of AI...

  • AI/ML Engineer

    2 weeks ago


    New York, New York, United States Artian AI Full time

    About Artian AIArtian AI is an innovative tech startup focused on developing cutting-edge AI platforms for enterprise workflows. Our team of experts has deep expertise in AI/ML and has built and deployed robust agent-based workflows and multi-agent systems in mission-critical enterprises. We are excited about the initial applications in financial services,...

  • AI Engineer

    1 month ago


    New York, New York, United States Basis AI Full time

    About BasisBasis is an innovative AI platform revolutionizing the accounting world by providing accountants with a team of AI assistants. Our mission is to automate time-consuming, manual work, freeing up accountants to focus on high-value tasks.Job OverviewWe are seeking an exceptional undergraduate senior to join our team as an Intern for the school year....

  • AI Systems Engineer

    3 days ago


    New York, New York, United States Liquid AI Full time

    About Liquid AILiquid AI is a foundation model company headquartered in Boston, Massachusetts.Our MissionWe aim to build capable and efficient general-purpose AI systems at every scale.Our GoalWe strive to create AI systems that solve problems at every scale, enabling users to build, access, and control their AI solutions.Our VisionWe envision a future where...

  • AI/ML Engineer

    3 weeks ago


    New York, New York, United States Artian AI Full time

    Job Opportunity at Artian AIWe are seeking an experienced AI/ML Engineer to accelerate the development of our innovative AI platform. As part of a small cross-functional team, you will be working across components and services to drive our journey.Requirements:Master's (MS) or Doctorate (PhD) in Computer Science or closely related fieldSolid understanding of...

  • Chief AI Architect

    1 month ago


    New York, New York, United States Solomon AI Full time

    About Solomon AIWe are a fast-growing tax AI company backed by Bessemer Venture Partners, revolutionizing the workflows of tax professionals with AI solutions.The RoleAs Head of AI at Solomon AI, you will lead the development of cutting-edge AI systems and design new AI-native features for our customers. Your expertise in machine learning research and...

  • Software Engineer

    3 weeks ago


    New York, New York, United States Artian AI Full time

    Job Opportunity at Artian AIWe are seeking an experienced Software Engineer to accelerate the development of our innovative AI platform. As part of a small cross-functional team, you will be working across components and services and be immersed in a plethora of Gen AI technologies including LLM prompt engineering, vector databases, and frameworks for...


  • New York, New York, United States Glow Networks Full time

    Job OverviewLocation: Remote (Candidates must be physically located in the Eastern Time Zone)Essential Skills: Prompt Engineering, RAG, ChatBot, CI/CD, Docker, Testing, Vector DB's, etc.Role Summary:We are looking for a proficient Generative AI Solutions Engineer with a strong background in software development to enhance our capabilities. In this role, you...


  • New York, New York, United States C3 AI Full time

    AI Solutions ArchitectC3 AI is seeking an experienced professional to join our AI Solution Architecture team (post-sales) in a customer-facing role. As an AI Solutions Architect, you will design, develop, and deploy custom and pre-built Enterprise AI applications using the C3 AI Platform.The ideal candidate will have a passion for acquiring, analyzing, and...

  • AI Engagement Manager

    3 weeks ago


    New York, New York, United States C3 AI Full time

    Job Title: AI Engagement ManagerC3 AI is seeking a highly skilled AI Engagement Manager to collaborate with executive stakeholders to define use cases, transform them into specifications, lead solution configuration and deployment at scale, drive adoption and ensure realization of business value.Key Responsibilities:Collaborate with customers to craft...