Senior AI QE Engineer

3 days ago

West Palm Beach, Florida, United States NLB Services Full time

Job Role: Senior AI QE Engineer

Location : West Palm Beach, Florida (Onsite)

Full Time

Job Description:

Role Summary

We are looking for a
Senior AI Quality Engineer
with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.

Core Experience

  • 6–10 years as a Software Engineer, SDET, or Automation Engineer.
  • Strong coding skills in Python, TypeScript, or Java.
  • Hands-on experience developing automation scripts, tools, or frameworks.
  • Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.
  • Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.
  • Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).

AI / ML Technologies integration

  • Practical experience with AI/ML frameworks:
  • LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.
  • Experience with ML/DL libraries such as:
  • Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.
  • Ability to work with embeddings, similarity search, and content evaluation metrics.

GenAI & AI Agent integrations

  • Ability to integrate or build GenAI components, including RAG pipelines or agent-based workflows.
  • Support model evaluation tasks such as:
  • Output quality checks
  • Hallucination detection
  • Prompt validation
  • Regression checks for model updates

Automation & Quality Engineering

  • Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.
  • Ability to design and execute automated tests for:
  • Functional
  • Integration
  • API
  • Basic performance & reliability testing
  • Hands-on experience testing RESTful APIs and building automated API suites.

Cloud, DevOps & CI/CD

  • Exposure to deploying AI or automation solutions on AWS.
  • Working knowledge of CI/CD pipelines, including:
  • Automated testing
  • Model validation steps
  • Versioning & artifact management

SDLC & Collaboration

  • Strong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.
  • Ability to collaborate with Developers, Data Scientist, and QE teams, clearly communicating progress, risks, and results.
  • Skilled in documenting and tracking defects and participating in defect triage.

  • Senior AI Quality Engineer

    3 days ago

    West Palm Beach, Florida, United States Synstack Technologies Full time

    Job Role: Senior AI QE EngineerLocation : West Palm Beach, FloridaJob Description:Role SummaryWe are looking for aSenior AI Quality Engineerwith strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system...

  • Civil Engineer

    7 days ago

    West Palm Beach, Florida, United States Engage Engineer Search Full time $65,000 - $85,000 per year

    Civil Engineer EIT – Forensic Engineering West Palm Beach, FL | In-Office (1 day) + Field (3–4 days on swing stage construction) $65K–$72K (entry-level) | Up to $85K (with experience) Full Benefits | Half-Day Fridays***accepting local candidates only***About the CompanyJoin a specialized forensic engineering firm that blends technical expertise with...

  • Senior Frontend Engineer

    7 days ago

    West Palm Beach, Florida, United States Harnham Full time $140,000 - $160,000 per year

    Senior Frontend EngineerLocation:Onsite in West Palm Beach, FLCompensation:$140,000 – $160,000 base + equityAbout the CompanyA rapidly growing AI and cloud technology company is building intelligent, emotionally aware user interfaces that power next-generation human–AI interaction.The company's mission is to make artificial intelligence feel intuitive,...

  • Senior Data Engineer – Data Quality Engineering

    1 week ago

    West Palm Beach, Florida, United States ServiceNow Full time $140,700 - $239,200 per year

    Company DescriptionIt all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...

  • Senior Data Engineer – Data Quality Engineering

    3 days ago

    West Palm Beach, Florida, United States ServiceNow Full time $140,700 - $239,200

    Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...

  • Senior Machine Learning Engineer – Remote 1x a Month

    19 hours ago

    West Palm Beach, Florida, United States Oliver James Full time

    Title: Sr. ML EngineerLocation: Palm Beach, Florida (Hybrid) or REMOTEType: Full-Time OpportunityPay Range: Up to $145,000Eligibility: U.S. Citizenship or Green Card requiredExperience in insurance, particularly in Commercial or Specialty (Property & Casualty) lines, preferred.No third partiesOverviewThe Senior Machine Learning Engineer will play a strategic...

  • Senior Site Reliability Engineer, Core Cloud Engineering

    5 days ago

    West Palm Beach, Florida, United States Vultr Full time

    Who We AreVultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud...

  • Agentic AI Architect – Portfolio-Wide

    7 days ago

    West Palm Beach, Florida, United States VDS Consulting Group Full time $200,000 - $500,000 per year

    Agentic AI Architect – Portfolio-WideValue Driven Solutions invites visionary Contract Agentic AI Architects to design bespoke, portfolio-spanning frameworks that propel PE-backed companies toward autonomous intelligence, fusing reasoning, planning, tool-use, and memory to automate complex decisions like portfolio-wide capex allocation or cross-company...

  • Staff Security Engineer

    2 weeks ago

    West Palm Beach, Florida, United States ServiceNow Full time $120,000 - $180,000 per year

    Company DescriptionIt all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...

  • GTM Strategic Planning, Senior Manager

    1 week ago

    West Palm Beach, Florida, United States ServiceNow Full time $120,000 - $250,000 per year

    Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...