AI QA Engineer

5 days ago

Niskayuna, New York, United States GE Vernova Full time $120,000 - $200,000 per year

Job Description Summary
GE Vernova is seeking a highly skilled AI QA Engineer to lead the development of benchmark frameworks for AI systems & use cases deployed. This role is critical to ensuring the accuracy, reliability, safety, and compliance of AI models driving innovation at GE Vernova. The ideal candidate will design and implement rigorous testing frameworks tailored for AI use cases unique to GE Vernova.

Job Description

  • Design, develop, and execute comprehensive benchmark frameworks to evaluate AI use cases, prompt performance, robustness, across diverse array of use cases.
  • Develop automated testing suites to validate AI functionalities such as prediction accuracy, response consistency, case handling, bias detection, and model degradation over time.
  • Collaborate closely with Prompt Engineers, AI Agent Engineers and product owners to define quality standards, acceptance criteria, and key performance indicators (KPIs) for AI deployments.
  • Conduct quantitative and qualitative evaluations of AI outputs ensuring alignment with business objectives, regulatory standards, and ethical AI principles.
  • Monitor AI use cases performance in production, systematically identify issues, and recommend improvements to maintain high standards of AI quality and safety.
  • Document testing methodologies, framework designs, quality metrics, and ensure thorough reporting to stakeholders.
  • Support continuous improvement initiatives by incorporating feedback loops and new benchmarking techniques as AI technologies evolve.
  • Provide training and mentorship on AI testing best practices within GE Vernova's Prompt engineering and AI Agent Engineering team.
  • Stay current with emerging AI technologies, contribute to platform and tooling improvements, and share knowledge within the team.

Required Qualifications And Skills

  • Master's degree in Computer Science, AI Engineering, Data Science, or related field.
  • 3+ years of experience in software quality assurance with at least 2 years focused on AI/ML systems.
  • Proven track record designing and implementing AI benchmark frameworks or quality assurance strategies.
  • Strong programming skills in Python and experience with automated testing frameworks (e.g., pytest, Selenium).
  • Familiarity with RAG systems, vector databases, and GenAI architectures.
  • Deep understanding of machine learning models, LLMs, and AI validation methodologies.
  • Experience with AI fairness, bias detection, and responsible AI practices.
  • Knowledge of cloud environments (AWS, Azure, or GCP), containerization, and deployment pipelines.
  • Ability to analyze complex datasets and performance metrics quantitatively and qualitatively.
  • Strong communication skills with ability to document and present technical information clearly.
  • Hands-on experience with LLMs, prompt engineering, and natural language processing (NLP).
  • Knowledge of agent orchestration platforms and multi-agent systems (e.g., AutogenAI, LangGraph, MCP protocol).

GE Vernova offers a great work environment, professional development, challenging careers, and competitive compensation. GE Vernova is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law.

GE Vernova will only employ those who are legally authorized to work in the United States for this opening. Any offer of employment is conditioned upon the successful completion of a drug screen (as applicable).

Relocation Assistance Provided:
Yes

  • Sr. AI Agent Engineer

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $111,200 - $185,400

    Job Description SummaryWe are seeking a highly motivated and talented Sr AI Agent Engineer to join our dynamic team. The successful candidate will be responsible for creating and optimizing prompts for LLMs, collaborating with domain experts and end users to develop software solutions that address both internal and external needs. This position offers a...

  • Research - AI/Computer Vision Fellow Internship

    6 days ago

    Niskayuna, New York, United States GE Aerospace Full time $1,000 - $2,000

    Job Description SummaryJob DescriptionGE Aerospace Research is looking for an innovative intern to help shape the Future of Flight We are exploring new advancements in the Artificial Intelligence and Computer Vision team around AI safety and explainability, causal discovery, network encoding, transfer learning, language models, material property forecasting,...

  • Prompt Engineering Intern

    7 days ago

    Niskayuna, New York, United States GE Vernova Full time $60,000 - $120,000 per year

    Job Description SummaryGE Vernova is embracing cutting-edge technologies to streamline operations, improve customer experiences, and drive growth. As part of this vision, we are building a dedicated team to leverage Generative AI and redefine how we engage with our industry. The ultimate goal of the team is to automate prompting, develop a framework for...

  • Technical Program Manager

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $111,000 - $185,000

    Job Description SummaryThe Technical Program Manager (TPM) is the execution driver for the AI Foundry, responsible for the end-to-end delivery of complex AI solutions. You will act as the critical bridge between product vision and engineering reality, translating business requirements into actionable technical plans. You will partner with Product Managers,...

  • Senior Engineer

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $111,200 - $185,400

    Job Description SummaryAs a GE Vernova accelerator, GE Vernova Advanced Research is driving strategy and leading research & development efforts to execute on the business's mission to help power the energy transition. We forge the collaborations and help invent the technologies required to electrify and decarbonize for a zero-carbon future.Representing...

  • Senior Enterprise Architect

    7 hours ago

    Niskayuna, New York, United States GE Vernova Full time $161,000 - $242,000

    Job Description SummaryThe Senior Generative AI Enterprise Architect is a strategic leader responsible for defining and implementing enterprise-wide strategies to harness the power of generative AI technologies. This role involves designing and overseeing the integration of AI solutions into core business processes and IT ecosystems to drive innovation and...

  • Senior Product Manager

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $152,000 - $254,000

    Job Description SummaryThe Product Manager for GenAI at GE Vernova plays a crucial role in the development and execution of GenAI-powered products that transform business processes. This role is essential to our mission of pioneering AI-driven innovation and enhancing user experiences across the enterprise.The Product Manager will work with across GE Vernova...

  • Summer 2026 Enterprise Reporting

    4 days ago

    Niskayuna, New York, United States Momentive Full time $60,000 - $120,000 per year

    Job Title:Summer 2026 Enterprise Reporting & Analytics – Data Science InternSummary:The Data Science Intern will collaborate with business and IT teams to support data-driven initiatives within the Enterprise Reporting & Analytics (ER&A) team. During the internship, the intern will engage in translating business needs into analytical requirements,...

  • Research Scientist

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $88,600 - $147,600

    Job Description SummaryAs a GE Vernova accelerator, GE Vernova Advanced Research is driving strategy and leading research & development efforts to execute on the business's mission to help power the energy transition. We forge the collaborations and help invent the technologies required to electrify and decarbonize for a zero-carbon future.Representing...

  • Lead Scientist

    6 days ago

    Niskayuna, New York, United States GE Vernova Full time $98,400 - $164,000

    Job Description SummaryAs a GE Vernova accelerator, GE Vernova Advanced Research is driving strategy and leading research & development efforts to execute on the business's mission to help power the energy transition. We forge the collaborations and help invent the technologies required to electrify and decarbonize for a zero-carbon future.Representing...