AI/ML Software QA Lead

1 day ago

Austin, Texas, United States Nesco Resource Full time

Summary:
The Quality Assurance Manager oversees full end-to-end testing for enterprise applications, data-driven systems, and AI-enabled solutions. This position leads a team of analysts and engineers, ensuring detailed test planning, execution, and defect resolution throughout the software lifecycle. The role requires deep expertise in QA methodologies, AI/ML testing practices, and cross-functional collaboration across engineering, product, and data teams.

KEY RESPONSIBILITIES:

  • Lead, mentor, and grow a QA team with a focus on AI/ML testing.
  • Build and execute test plans for AI models, data pipelines, and application features.
  • Oversee manual and automated testing across multiple projects and integrated systems.
  • Partner with engineering, product, and data science to define acceptance criteria and test strategies.
  • Support deployments across Dev, QA, and Production environments.
  • Maintain test environments, test data, and required infrastructure.
  • Identify and mitigate quality risks, including AI-specific risks such as bias, data leakage, and adversarial threats.
  • Track QA metrics (coverage, defect leakage, RAG status) and report to stakeholders.
  • Drive continuous improvement in QA processes, automation, and tooling.
  • Ensure compliance with ethical AI standards, data privacy requirements, and regulatory expectations.
  • Collaborate with automation teams to enhance automated test suites.
  • Support production validation and provide user support when needed.

SKILLS & EXPERIENCE:

  • 5+ years of QA leadership experience within software, data, or AI/ML environments.
  • Strong understanding of AI/ML testing concepts (model evaluation, fairness/bias, supervised/unsupervised learning).
  • Hands-on experience with automation frameworks and scripting.
  • Advanced SQL skills and comfort validating data workflows.
  • Proficiency with QA methodologies, SDLC processes, and MLOps practices.
  • Experience coordinating offshore/nearshore development or testing teams.
  • Excellent communication, documentation, and stakeholder engagement skills.
  • Highly organized, detail-oriented, and effective in fast-paced environments.

TOOLS & TECHNOLOGIES:

  • ALM/QA Tools: Azure DevOps, TFS, MTM, HPQC or similar
  • Automation: Selenium, UiPath, comparable frameworks
  • ML/AI Testing: MLflow, TFX, PyCaret, pytest
  • Cloud/Automation: Azure AI services, Power Automate
  • Collaboration: SharePoint
  • General: MS Office Suite

**Nesco Resource offers a comprehensive benefits package for our associates, which includes a MEC (Minimum Essential Coverage) plan that encompasses Medical, Vision, Dental, 401K, and EAP (Employee Assistance Program) services.

Nesco Resource provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.**

  • ML/AI Engineers

    5 days ago

    Austin, Texas, United States Adidev Technologies Full time $120,000 - $200,000 per year

    Role: ML/AI Engineers(This role is open to US Citizens, Green Card holders, GC-EAD only. We do not sponsor visas.)Summary: Adidev is looking for an adept Machine Learning Engineer to take the helm in deploying advanced machine learning models, with a special emphasis on Generative AI. In this role, you will craft and refine AI-driven solutions, turning...

  • AI/ML Engineer

    1 week ago

    Austin, Texas, United States Jobs via Dice Full time $200,000 - $250,000 per year

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Synergent Tech Solutions, is seeking the following. Apply via Dice todayRole: AI/ML EngineerLocation : Austin, TX (Onsite)Duration : Long TermSkills: AI/ML, Google Cloud Platform, Python, SQL and experience in SDLC projectsJob Description:8+ years experience...

  • AI/ML Engineer

    3 hours ago

    Austin, Texas, United States Jobs via Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Rivago infotech inc, is seeking the following. Apply via Dice todayRole: AI/ML EngineerLocation: Austin TX (100% Onsite)Job Description:8+ years experience asWork and collaborate with data science and engineering teams to deploy and scale models and...

  • Python AI/ML Engineer

    1 day ago

    Austin, Texas, United States Jobs via Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Rivago infotech inc, is seeking the following. Apply via Dice todayRole: Python AI/ML EngineerLocation: Austin TX (100% Onsite) - No flexibilitySkills: AI/ML, MLOps, Google Cloud Platform, Python, SQL and experience in SDLC projectsJob Description:10+ years...

  • AI/ML Architect

    7 days ago

    Austin, Texas, United States Wipro Full time $80,000 - $158,000 per year

    Job description:AI/ML ArchitectOverview:As an AI/ML Lead / Architect you will design and implement advanced language models that power customer service automation, personalized shopping experiences, and operational insights. You will build, fine-tune, and deploy solutions such as chatbots, voice assistants, search optimization, and sentiment analysis. Your...

  • Senior AI/ML Engineer

    1 week ago

    Austin, Texas, United States TestingXperts Full time

    Role:AI/ML EngineerLocation:Austin, TX (100% Onsite)Type:Full Time / Contract to HireWe're looking for an experiencedAI/ML Engineerwith a strong background in building, deploying, and scaling machine learning models in production environments. The ideal candidate will work closely with data science and engineering teams to operationalize complex ML solutions...

  • Python AI/ML Engineer

    2 days ago

    Austin, Texas, United States E-Solutions Full time

    MUST BE VERY STRONG IN PYTHON HANDS-ON CODING. THERE WILL CODING TEST ON PYTHON SKILL DURING ALL INTERVIEW ROUNDS."Must be legally authorized to work in US without need for employer sponsorship now or at any time in the future."Role: Python AI/ML EngineerLocation: Austin TX (100% Onsite) - No flexibility, need relocation confirmation from candidate along...

  • Applied ML Manager

    7 days ago

    Austin, Texas, United States Syndesus Full time $150,000 - $200,000 per year

    About the Job About Our Client Our client is revolutionizing healthcare by streamlining knowledge workflows with AI. They reduce administrative burdens and elevate outcomes, empowering professionals to focus on what truly matters — improving lives. They're growing fast and looking for bold, driven teammates to join them. The Opportunity Our client is...

  • AI Software Development Manager

    1 week ago

    Austin, Texas, United States General Motors Full time $120,000 - $200,000 per year

    Job DescriptionThe Role:As an AI Software Engineer Leader on the Enterprise AI team, you will play a critical role in shaping GM's future through high-impact AI systems. You will be responsible for managing a team of skilled engineers developing AI technologies and integrating them into GM's core platforms. You'll be a hands-on leader focused on working with...

  • Software Engineer

    4 days ago

    Austin, Texas, United States Apple Full time $120,000 - $180,000 per year

    Do you want to make a positive impact on the direction of new, key technologies in consumer products while pioneering the future of intelligent quality assurance? We're seeking a creative and motivated Software Engineer to join our Product Systems Quality team, working to ensure world-changing Mac and Home products are delivered at the highest quality to...