AI Quality Director

4 weeks ago


New York, New York, United States invisible-technologies Full time

Director of AI Excellence

About Invisible Technologies:

Invisible Technologies is a pioneering company that combines human creativity and intuition with cutting-edge technology to create a future rich in impact and meaning. We believe that human involvement is essential in unlocking the full potential of AI, ensuring it is developed with greater accuracy, quality, safety, reliability, and fairness. Our unique process orchestration engine merges artificial and human intelligence with automation to remove operational bottlenecks and pave the way for growth and innovation in our clients.

Key Responsibilities:

As the Director of AI Excellence, you will lead and accelerate our AI training and enablement efforts across key enterprise relationships. Partnering with leading companies, including some of the world's top AI researchers, you will own, build, and strengthen client relationships by fundamentally owning the quality assurance processes. This entails ensuring the highest standards of data quality are maintained throughout our AI training endeavors, driving excellence and innovation in every aspect of our operations.

Together, you will refine and champion excellence in expert training processes and deploy cutting-edge operations and best practices across enterprise companies. Constantly innovating, you will iterate on AI training methods to ensure the evolution of client AI models through human-generated data. Your primary responsibilities include:

  • Tracking Patterns and Updating Best Practices: Monitor developments in AI data quality assessment and measurement, updating best practices accordingly. Disseminate new learnings to teams to ensure consistency across projects.
  • Generating Standardized Documentation: Develop standardized documentation for AI data quality processes, ensuring clarity and consistency in quality assessment methodologies.
  • Communication, Reporting, and Cross-Cutting: Foster effective communication channels for reporting on AI data quality metrics. Collaborate cross-functionally to address overarching quality issues and streamline processes.
  • Strategic Client Relationship Management: Partner with researchers and managers in working with clients to define needs, map processes, and ensure alignment with client goals. Manage strategic client accounts, including tech giants and multiple mid-sized companies to customize our efforts to their needs.
  • Complex Operations & Team Management: Facilitate dissemination to an Operations team of hundreds, including Operations Managers, Operations Analysts, and AI trainers. Oversee hiring, staffing, and development, ensuring exceptional performance above internal and external KPI expectations.
  • Systems Thinking: Identify areas for process improvement and efficiency gains, implementing solutions to critical issues. Collaborate with product managers to develop new technologies and frameworks to enhance operations.
  • Business Ownership: Develop strategies to drive growth and profitability. Maintain client health in service and unit economics, providing guidance and leadership to operators.

Skills and Qualifications:

  • More than 5 years of experience in operations management, quality controls, process building.
  • Excellent communication skills, both verbal and written. Client-facing capacity is a plus.
  • Strong management and leadership skills, with experience managing organizations of at least 30+ people.
  • Familiarity with AI concepts or exposure to AI-related industries.
  • Technical backgrounds or recent (


  • New York, New York, United States Scale AI Full time

    At Scale AI, we're expanding our team to accelerate the development of AI applications. As a Director of Operations, you'll lead the team that builds and delivers datasets for our customers for one of the Gen AI verticals.This is a demanding role, and as a Director of Operations, you should be prepared to wear many hats such as Operator, Product Manager, and...


  • New York, New York, United States Scale AI Full time

    Job Title: Director of Operations, Generative AIScale AI is seeking a highly skilled Director of Operations to lead our Generative AI business unit. As a key member of our team, you will be responsible for overseeing the development and delivery of datasets for our customers.Key Responsibilities:Lead cross-functional projects with diverse stakeholders,...


  • New York, New York, United States Scale AI Full time

    About ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...


  • New York, New York, United States invisible-technologies Full time

    Director of AI Data QualityAbout Invisible:We are Invisible Technologies, a company dedicated to merging human creativity and technology to create a future rich in impact and meaning. Our unique approach ensures AI is developed with greater accuracy, quality, safety, reliability, and fairness. This people-first approach underpins our AI training and...


  • New York, New York, United States Scale AI Full time

    About Scale AIAt Scale AI, we're accelerating the development of AI applications. Our mission is to make AI accessible to every industry, and our team is transforming how organizations build and deploy AI.About the RoleWe're seeking a skilled Software Engineer to join our AI Growth team. As a key member of our team, you'll be responsible for building and...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave...


  • New York, New York, United States Scale AI Full time

    About Scale AIScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make AI more accessible and efficient for organizations across various industries.About Data EngineOur Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF, human data generation,...


  • New York, New York, United States Scale AI Full time

    About ScaleScale AI is a leading AI data foundry that accelerates the development of AI applications. Our mission is to make the transition from traditional software to AI happen faster across every industry. We power the world's most advanced LLMs, generative models, and computer vision models, trusted by companies like OpenAI, Meta, and Microsoft, as well...


  • New York, New York, United States Aegistech Full time

    Aegistech is a leader in automation and AI/ML to transform risk management. We are seeking a Director of AI Platform Engineering to join our ML team within the Data Science organization. The ideal candidate is an innovative, hands-on coder with previous experience developing large-scale platforms utilizing data engineering, machine learning and cloud...


  • New York, New York, United States Forhyre Full time

    Job Title:AI Cloud Solutions DirectorJob Description:Forhyre is a leading technology solutions provider that specializes in developing and implementing AI-driven cloud solutions for businesses across various industries. Our company is committed to delivering innovative and scalable AI solutions that help our clients optimize their operations and achieve...


  • New York, New York, United States Pfizer Full time

    Pharmacovigilance AI Quality Oversight LeadROLE SUMMARYThe Pharmacovigilance AI Quality Oversight Lead is responsible for overseeing the strategic development and implementation of quality plans, establishing guidelines, and managing oversight governance to ensure the quality and reliability of AI systems that may affect pharmacovigilance.This involves...


  • New York, New York, United States Welocalize Full time

    Business Development DirectorWelocalize is seeking a Business Development Director to join our team. As a key member of our Commercial Team, you will be responsible for generating new leads, closing new business, and up-selling within our current client accounts.Key Responsibilities:Develop an effective understanding of Welocalize's business and...


  • New York, New York, United States invisible-technologies Full time

    About the Role:We are seeking a highly experienced AI Quality Excellence Lead to join our team at Invisible Technologies. As a key member of our operations management, you will be responsible for driving excellence and innovation in our AI training processes.Job Description:The AI Quality Excellence Lead will oversee the quality assurance process, ensuring...

  • Product Director

    4 weeks ago


    New York, New York, United States New York Life Insurance Company Full time

    Product Director - AI and Data StrategyAs a Product Director at New York Life Insurance Company, you will lead the development and execution of AI and data strategies to drive business growth and improve customer experiences. This role requires a strong understanding of data governance, data science, and analytics, as well as experience working with...


  • New York, New York, United States Columbia University Full time

    Job SummaryThe Columbia University Department of Biomedical Informatics seeks a highly experienced and skilled Executive Director of AI Initiatives to provide strategic and tactical support to the Department Chair. This critical role will ensure the successful operation of DBMI in leading departmental, school-wide, and university-wide initiatives.Key...


  • New York, New York, United States Columbia University Full time

    Job SummaryColumbia University Department of Biomedical Informatics (DBMI) seeks a dynamic and experienced Executive Director of AI Initiatives to support the Department Chair. This critical role will provide both strategic and tactical support to ensure the successful, efficient, and effective operation of DBMI in leading departmental, school-wide, and...


  • New York, New York, United States PitchBook Data Full time

    About the RoleWe are seeking a highly experienced Senior Director of Engineering, AI and Machine Learning to lead our global AI and machine learning initiatives. As a key member of our Product and Engineering team, you will be responsible for guiding distributed teams across multiple regions to build robust, scalable AI/ML solutions that power our products...


  • New York, New York, United States NBCUniversal Full time

    About the RoleNBCUniversal is seeking a highly skilled Director of Product, Generative AI to lead the development of innovative AI-powered products and services. As a key member of the Peacock team, you will be responsible for defining and executing a strategic vision for AI-powered capabilities across the business.Key ResponsibilitiesDefine a strategy for...


  • New York, New York, United States Columbia University Full time

    Job SummaryThe Columbia University Department of Biomedical Informatics (DBMI) is seeking a highly experienced and skilled Executive Director of AI Initiatives to provide strategic and tactical support to the Department Chair.This critical role will serve as a trusted advisor, bridging high-level strategy with day-to-day operations, and contributing to the...


  • New York, New York, United States Synechron Full time

    About the RoleWe are seeking a highly skilled Quality Assurance Engineer to join our team at Synechron. As a Quality Assurance Engineer for Generative AI, you will be responsible for ensuring the quality and reliability of our AI systems.ResponsibilitiesDevelop comprehensive test plans and strategies for Generative AI implementations.Design and execute test...