Director Of AI Quality

5 months ago


New York, United States invisible-technologies Full time

Director of AI Data Quality

About Invisible:

Invisible Technologies is dedicated to fusing human creativity and intuition with cutting-edge technology to create a future rich in impact and meaning. We firmly believe that human involvement is essential in unlocking the full potential of AI, ensuring it is developed with greater accuracy, quality, safety, reliability, and fairness. This people-first approach underpins our unique process orchestration engine, a platform that merges artificial and human intelligence with automation to remove operational bottlenecks and pave the way for growth and innovation in our clients.

Key Responsibilities:

As the Director of AI Data Quality, you will lead and accelerate our AI training and enablement efforts across key enterprise relationships. Partnering with leading companies, including some of the world’s top AI researchers, you will own, build, and strengthen client relationships by fundamentally owning the quality assurance processes. This entails ensuring the highest standards of data quality are maintained throughout our AI training endeavors, driving excellence and innovation in every aspect of our operations.

Together, you will refine and champion excellence in expert training processes and deploy cutting-edge operations and best practices across enterprise companies. Constantly innovating, you will iterate on AI training methods to ensure the evolution of client AI models through human-generated data. Your primary responsibilities include:

Tracking Patterns and Updating Best Practices: Monitor developments in AI data quality assessment and measurement, updating best practices accordingly. Disseminate new learnings to teams to ensure consistency across projects.Generating Standardized Documentation: Develop standardized documentation for AI data quality processes, ensuring clarity and consistency in quality assessment methodologies.Communication, Reporting, and Cross-Cutting: Foster effective communication channels for reporting on AI data quality metrics. Collaborate cross-functionally to address overarching quality issues and streamline processes.Strategic Client Relationship Management: Partner with researchers and managers in working with clients to define needs, map processes, and ensure alignment with client goals. Manage strategic client accounts, including tech giants and multiple mid-sized companies to customize our efforts to their needs.Complex Operations & Team Management: Facilitate dissemination to an Operations team of hundreds, including Operations Managers, Operations Analysts, and AI trainers. Oversee hiring, staffing, and development, ensuring exceptional performance above internal and external KPI expectations.Systems Thinking: Identify areas for process improvement and efficiency gains, implementing solutions to critical issues. Collaborate with product managers to develop new technologies and frameworks to enhance operations.Business Ownership: Develop strategies to drive growth and profitability. Maintain client health in service and unit economics, providing guidance and leadership to operators.

Skills and Qualifications:

More than 5 years of experience in operations management, quality controls, process building. Excellent communication skills, both verbal and written. Client-facing capacity is a plus.Strong management and leadership skills, with experience managing organizations of at least 30+ people.Familiarity with AI concepts or exposure to AI-related industries.Technical backgrounds or recent (

  • New York, New York, United States Scale AI Full time

    About Scale AIWe accelerate the development of AI applications at Scale AI. Our mission is to help organizations build and deploy AI faster across every industry.Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through human data generation, model evaluation, safety, and alignment. As a Software Engineer on our...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...


  • New York, New York, United States Snorkel AI Full time

    Job Summary">We are looking for a seasoned Product Marketing Manager to lead our product marketing efforts for Snorkel Flow. This individual will be responsible for driving product awareness, adoption, and revenue growth through effective product marketing strategies.">The successful candidate will have a strong background in product marketing, AI, and...


  • New York, New York, United States Scale AI, Inc. Full time

    About the RoleYou will lead cutting-edge research in AI agent architectures and autonomous systems development, overseeing research initiatives and collaborating with engineering teams to bring innovations to production. The role involves designing scalable evaluation frameworks to measure and optimize agent performance across billions of tasks, driving...


  • New York, New York, United States Scale AI Full time

    **About Scale** We accelerate the development of AI applications. As a leading AI data foundry, we help fuel advancements in AI, including generative AI, defense applications, and autonomous vehicles. Our recent Series F round has enabled us to accelerate the abundance of frontier data to pave the road to Artificial General Intelligence (AGI). We're also...


  • New York, New York, United States Scale AI Full time

    Transform AI Across IndustriesWe are Scale AI, and we believe that the transition from traditional software to AI is one of the most important shifts of our time. Our mission is to make that happen faster across every industry.As a Strategic Product Manager, you will work with a cross-functional team to drive technical partnership with leading researchers...

  • AI Software Architect

    3 weeks ago


    New York, New York, United States Lightning AI Full time

    Exciting Opportunity at Lightning AIAbout UsLightning AI is revolutionizing the development of artificial intelligence products. Our platform simplifies AI development, making it accessible to everyone-from solo researchers to large enterprises.We empower innovators to focus on solving real-world problems by removing the complexity of building and deploying...


  • New York, New York, United States Dynamo AI Full time

    As a leading provider of AI solutions, Dynamo AI seeks a seasoned professional to drive the development of our cloud-based ML services. This critical role requires a deep understanding of AI safety and compliance principles and experience in designing and deploying scalable, distributed systems.Key ResponsibilitiesDevelop and lead a high-performing...


  • New York, United States Fireworks AI Full time

    Here at Fireworks, we're building the future of generative AI infrastructure. Fireworks offers the generative AI platform with the highest-quality models and the fastest, most scalable inference. We've been independently benchmarked to have the fastest LLM inference and have been getting great traction with innovative research projects, like our own function...


  • New York, United States Fireworks AI Full time

    Here at Fireworks, we're building the future of generative AI infrastructure. Fireworks offers the generative AI platform with the highest-quality models and the fastest, most scalable inference. We've been independently benchmarked to have the fastest LLM inference and have been getting great traction with innovative research projects, like our own function...


  • New York, New York, United States Scale AI Full time

    About Scale">At Scale, our mission is to accelerate the development of AI applications. As a leading AI data foundry, we help fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. We are committed to making the transition from traditional software to AI one of the most important shifts of our...


  • New York, New York, United States Scale AI Full time

    Join Our TeamAt Scale AI, we're committed to making the transition from traditional software to AI a reality. Our mission is to accelerate AI development across industries.We power the world's most advanced LLMs, generative models, and computer vision models. Trusted by leading companies like OpenAI, Meta, and Microsoft, as well as government agencies and...

  • AI Strategy Director

    2 weeks ago


    New York, New York, United States Tokio Marine HCC Full time

    About Tokio Marine HCCTokio Marine HCC is a leading provider of specialty insurance and reinsurance solutions. We are committed to delivering innovative and tailored solutions to our customers, and we are seeking a highly skilled individual to join our team as an AI Strategy Director.Salary InformationThe salary for this role is estimated to be between...


  • New York, New York, United States Dynamo AI Full time

    Job Summary:We are looking for a Machine Learning Service Director to lead the development of our cloud-based ML services. As a key member of our team, you will be responsible for designing, developing, and deploying high-performance, secure, and reliable ML services.About the Position:This is an exciting opportunity to join a dynamic team that is shaping...


  • New York, New York, United States Ataraxis AI Full time

    About Ataraxis AIAtaraxis AI is a pioneering startup at the intersection of multi-modal AI, oncology, and precision medicine. We are developing cutting-edge diagnostic tools to support physicians in selecting optimal treatments for their patients.We are a team of AI researchers, medical doctors, and operators advised by renowned experts in their fields,...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For years, we have been the leading AI data foundry, helping fuel advancements in AI, including generative AI, defense applications, and autonomous vehicles. With recent investments, we're accelerating the abundance of frontier data to pave the road to Artificial General...


  • New York, United States BRIA AI Full time

    About BRIA AI:At BRIA AI, we are pioneers in visual Generative AI, delivering cutting-edge, responsible solutions for commercial use. Built on the largest licensed dataset and developed with industry leaders, our technology ensures superior quality, copyright protection, and safe content usage. Our platform revolutionizes visual communication by enabling...


  • New York, NY, United States C3 AI Full time

    Endless inspiration, meaningful work, talented team C3 AI is opening a new software development center in Guadalajara, Mexico. Software engineers in this center will help design, develop and maintain performant and scalable full-stack enterprise AI applications to solve what was previously unsolvable. Senior Software Engineer, Full-Stack C3 AI is looking for...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent funding, we're accelerating the abundance of frontier data to pave the road to Artificial General...


  • New York, New York, United States BRIA AI Full time

    About BRIA AIWe are a pioneering force in visual Generative AI, delivering cutting-edge solutions for commercial use. Our technology ensures superior quality, copyright protection, and safe content usage.