Lead Annotator

Job DescriptionJob Description

Title: Lead Data Annotation

Location: Alpharetta, GA (ONSITE)

Duration: 12 Months

Pay Range: $42/hr to $52hr (As per experience)

Position Description
The mission of the Research team is to make companies research and its team of analysts available to institutional clients through a Research Portal web site and chat tools including AI-driven chat. To make this vast amount of information more accessible, we have built a variety of tools including a search engine, a machine-learning-driven search intent classifier, an LLM-driven question-answering system, and an ontology/taxonomy, all supported by reference data about companies, industries, and our analysts. Global Research is building a team of SMEs and LLM/NLP experts to support this. The Lead Annotator will be a member of this team.

Responsibilities:

• We are looking for a candidate with experience as an annotator for AI and NLP-products, including the annotation of complex datasets to train and refine AI models and to support the ongoing operations and maintenance of such models.
• The Lead Annotator will work a diverse set of products and projects focused on multiple different uses of large language models – Q&A, summarization, red lining etc.
• Candidate will lead a team of 2-4 people
• Candidate will be working with data scientists and developers
• Develop and refine annotation framework and guidelines.
• Oversee the annotation of datasets, ensuring accuracy and consistency.
• Implement quality measures and metrics to maintain high standards of data labeling and annotations.
• Participate in hands-on annotation work.
• Design and customize tools to enhance efficiency and ensure quality annotations.
• Train and mentor junior annotators.
• Collaborate with team to align annotation strategies with project goals and product missions.
• Create and maintain consistent and actionable reporting of annotations.
• Monitor and report on the progress of annotation projects.

Requirements:

• Knowledge of NLP/LLM- Q&A
• Familiarity with relevant technical skills that deal with machine learning and evaluation
• Proven experience in data annotation and LLMs (at least 3 years)
• Proven team management abilities (at least 1 year)
• Ability with annotation (develop new projects and participate in other projects)
• Ideal: financial services experience
• Bachelor is required
• You have a deep understanding of language models and will stay updated on the developments in the AI and language modeling space, in particular as they pertain to the financial services industries.

**Pride Global offers eligible employee’s comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), a 401(k)-retirement savings, life & disability insurance, an employee assistance program, identity theft protection, legal support, auto and home insurance, pet insurance, and employee discounts with some preferred vendors. **

#CB
#LI-MS-9

Company DescriptionRussell Tobin is an equal-opportunity employer and values diversity in the workplace. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.Company DescriptionRussell Tobin is an equal-opportunity employer and values diversity in the workplace. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

---