Content Rater

Role: Content Rater

Location: Alpharetta, GA (onsite)

About the Role

As a content annotator, you need to identify and rating various types of content (audio, video, text, and photos) as per the defined policies and guidelines. The responsibility includes review and rating user/AI-generated content, providing written explanation, along with ensuring that it adheres to the client provided guidelines.

Roles and Responsibilities

• Evaluate and rate various content types, including audio, video, text, and photos.
• Assess AI generated responses for accuracy, factuality, relevance, helpfulness, language usage, and alignment with user intent.
• Conduct research & fact-checking by comparing AI-generated response with other generally available sources (ex: Web search, social media, 3rd party materials) and identify key differences and trends,
• Conduct side-by-side comparisons and identify key differences between responses.
• Rate and stack rank responses & provide clear reasoning while ensuring adherence to guidelines
• Ensure consistency in rating decisions.
• Supporting internal training
• Conducting QA/Peer reviews
• Attend customer calls/calibration sessions/calls
• Supporting other projects outside of your core project, as and when required,
• Re-writing prompts or responses

Skills Requirements & Qualifications

• University Degree (preferred) with 2-5 years of relevant work experience
• Work experience that is inclusive of journalism, literature, writing or other comparable experience
• Basic level computer handling skills (along with a typing speed of 25-30 words per minute)
• Comfortable with G suite, especially Google Sheets
• Excellent in verbal & writing skills with the ability to present reasoning in a clear, concise, and logical manner
• Understanding of various AI models and their capabilities.
• Knowledge of established guidelines and best practices for content rating.
• Experience in evaluating and comparing content from different sources.
• Detail oriented, rigorous, analytical skills to assess content factuality, relevance, and alignment with user intent.
• Research skills to evaluate content accuracy and identify trustworthy sources.
• Critical thinking skills to identify biases, inconsistencies, and limitations in AI-generated responses.
• Attention to detail to review content for grammar, style, and adherence to ethical standards.

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ADA_Accomodations@TechMahindra.com.