AI Data Evaluation Specialist

4 days ago

Atlanta, GA, United States Outlier Full time

Become part of a dynamic community dedicated to revolutionizing AI. Earn competitive pay of up to $15 USD/hr with opportunities for additional rewards based on the quality of your work.

At Outlier, we are passionate about enhancing the intelligence and safety of AI models. As a subsidiary of Scale AI, we've gained recognition for connecting experts with premier AI labs to provide high-quality training data for large language models (LLMs). We believe that AI's performance is directly linked to the quality of the data used for training, which is why we engage contributors from around the globe who help refine AI models through expert human feedback. This valuable data has driven advancements in AI for leading labs and LLM developers.

We offer a cutting-edge remote work platform designed for our freelance contributors, providing them with a supportive experience based on reliability, transparency, and flexibility.

Your Role

If you are fluent in English and eager to contribute your insights to the latest AI technologies, we want to hear from you

  • Utilize a user-focused approach to create realistic data that reflects actual AI usage scenarios.
  • Apply structured methods using rubrics to address user requirements effectively.
  • Assess AI outputs by reviewing and evaluating responses from large language models.
  • Contribute to a variety of projects based on your unique skill set and experience.

What We Seek

  • Education: A Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills: Proficiency in crafting complex prompts and evaluating nuanced AI reasoning.
  • Strong Writing Skills: Ability to write clearly, concisely, and engagingly to explain your evaluations and critiques.
  • Attention to Detail: A strong commitment to accuracy and the capability to evaluate the technical qualities of model outputs.

Bonus Qualifications:

  • Background in literature, creative writing, history, philosophy, theology, or similar fields.
  • Experience in writing or editorial roles (e.g., content strategists, technical writers, editors).
  • Genuine interest in AI, machine learning, or innovative tech tools.

Compensation and Benefits

Earn up to $15 USD/hr, with weekly payments made via PayPal and AirTM.

Compensation varies based on quality, accuracy, and time invested. Enjoy complimentary access to our Model Playground, where you can engage with leading large language models at no cost.

Flexible Work Schedule: Manage your time as you wish with no set contracts or rigid hours. Most experts typically commit between 5 to 10 hours a week, with the option to work up to 40 hours from home.

Join a Global Community of Experts: Connect with a worldwide network of professionals contributing to advanced AI tools.

Disclaimer: Lower rates may apply for non-core tasks, such as initial project onboarding or during overtime phases. Incentive payments may be available for certain projects, so please review the payment terms for each opportunity.

Equal Opportunity Employer: Outlier is dedicated to creating a diverse and inclusive workplace. We strongly encourage applicants from all backgrounds to apply and celebrate the diversity within our team.

  • Data Scientist

    1 week ago

    Atlanta, GA, United States Cisco Full time

    Data Scientist The application window is expected to close on: 12/05/2025 Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received. Members of the Operations Organization at select locations will generally be expected to follow a hybrid work model, which includes two days of in-office attendance each...

  • AI Engineer

    2 weeks ago

    Atlanta, GA, United States NTT DATA Full time

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AI Engineer to join our team in Atlanta, Georgia (US-GA), United States (US). As a AI Engineer with NTT DATA, you will be at the...

  • AI Engineer

    2 weeks ago

    Atlanta, GA, United States NTT DATA Full time

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AI Engineer to join our team in Atlanta, Georgia (US-GA), United States (US). As a AI Engineer with NTT DATA, you will be at the...

  • AI for Data Governance Product Lead

    2 days ago

    Atlanta, GA, United States Compunnel Full time

    Job Summary We are seeking an experienced AI for Data Governance Product Lead to execute the strategy and roadmap for enterprise data governance and AI-driven automation products. This role combines product management expertise with technical skills in AI agent development, enabling governance adoption and automation across platforms such as Collibra,...

  • Data Scientist

    2 weeks ago

    Atlanta, GA, United States Inizio Partners Full time

    About the job Data Scientist - Gen AI Job Title: Data Scientist - GenAI (Manager)Location: Atlanta, GAWork Experience: 10+ YearsOpen for both Contract and FTEJob Summary: We are seeking an accomplished and forward-thinking Data Science Manager with expertise in Generative AI to lead our Data Science team. In this role, you will drive the strategy,...

  • Oncology Data Specialist

    1 day ago

    Atlanta, GA, United States Tech Stars Group LLC Full time

    About the job Oncology Data Specialist Oncology Data SpecialistJob Description We are seeking experienced professionals with an oncology data background to join our Oncology Strategy team. In this role, you will review and validate patient-level findings generated by our AI/clinical decision support system. The work involves accessing patient charts,...

  • Oncology Data Specialist

    5 days ago

    Atlanta, GA, United States Tech Stars Group LLC Full time

    About the job Oncology Data Specialist Oncology Data SpecialistJob Description We are seeking experienced professionals with an oncology data background to join our Oncology Strategy team. In this role, you will review and validate patient-level findings generated by our AI/clinical decision support system. The work involves accessing patient charts,...

  • Oncology Data Specialist

    2 days ago

    Atlanta, GA, United States Tech Stars Group LLC Full time

    About the job Oncology Data Specialist Oncology Data SpecialistJob Description We are seeking experienced professionals with an oncology data background to join our Oncology Strategy team. In this role, you will review and validate patient-level findings generated by our AI/clinical decision support system. The work involves accessing patient charts,...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States Orcaworks.ai Full time

    Location: Hybrid / Atlanta, GAExperience Level: Entry-level (Master's preferred)About OrcaWorks AIAt OrcaWorks AI, we're building next-generation AI systems that empower businesses to make data-driven decisions with intelligence and speed. We're seeking passionate Data Engineers who love solving real-world data challenges and want to be part of a growing...

  • Data Engineer

    6 days ago

    Atlanta, GA, United States Orcaworks.ai Full time

    Location: Hybrid / Atlanta, GAExperience Level: Entry-level (Master's preferred)About OrcaWorks AIAt OrcaWorks AI, we're building next-generation AI systems that empower businesses to make data-driven decisions with intelligence and speed. We're seeking passionate Data Engineers who love solving real-world data challenges and want to be part of a growing...