Annotation Judge

3 weeks ago

seattle, United States Mathys+Potestio The Creative Party® Full time

We are looking for an NLP Annotation Judge for our real-estate tech client in Seattle, WA. for a 12-month, full-time contract.


Description

Annotation Judge to join Human In The Loop Operations team and contribute to growing set of Natural Language Processing (NLP) projects. The Annotation Judge will play a crucial role in fine-tuning and calibrating AI/ML processes that handle verbal interactions, between home buyers and real estate agents for example.


Will work directly with experienced Operations Managers and Natural Language experts. You will be responsible for ensuring the quality of a number of possible elements related to our projects, from the accuracy and humanlike traits of automated chatbots answers, to the classification of elements of a conversation annotated automatically or the review of search results based on understanding of complex users queries.


Responsibilities:

• Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.

• Provide feedback to ML/NLP engineers to improve accuracy and overall quality

• Collaborate with internal teams to optimize model performance based on annotated data.

• Help develop and maintain annotation guidelines and best practices.

• Provide training data to ML/NLP engineers to establish Ground Truth data.

• Provide input/examples on Training content.

• Identify gaps in training content and suggest improvements.


Basic Qualifications:

• Bachelor's degree in English, Linguistics or a related field.

• Excellent attention to detail and analytical skills.

• Ability to work effectively in a collaborative team environment.

• Experience with tools and software used for NLP annotation is a plus.


Preferred Qualifications :

• Experience or demonstrated interest in linguistics

• Experience working on NLP projects with a focus on chatbots, text classification, and named entity recognition

• Experience with copywriting, UX authoring, content development around voice and brand guidelines.

• Experience with Machine-generated Speech evaluation, Prompt Engineering, Search Results Evaluation, Search Query Categorization

• Experience following complex processes

• Ability to work both independently and with a team to achieve a goal.



The pay for this W-2 position ranges from $17.00-$19.00 per hour. This position may be eligible for PTO, health and dental insurance, and/or 401(k) benefits upon meeting certain length of service and hours requirements.


Mathys+Potestio values applicants of all backgrounds and experiences. We do not discriminate based on race, color, national or ethnic origin, ancestry, age, religion or religious creed, disability or handicap, sex or gender, gender identity and/or expression, sexual orientation, military or veteran status, genetic information, or any other characteristic protected under applicable federal, state, or local law.

  • Annotation Judge

    2 months ago

    Seattle, United States Mathys+Potestio The Creative Party® Full time

    We are looking for an NLP Annotation Judge for our real-estate tech client in Seattle, WA. for a 12-month, full-time contract.DescriptionAnnotation Judge to join Human In The Loop Operations team and contribute to growing set of Natural Language Processing (NLP) projects. The Annotation Judge will play a crucial role in fine-tuning and calibrating AI/ML...

  • Annotation Judge

    2 months ago

    Seattle, United States Mathys+Potestio The Creative Party® Full time

    We are looking for an NLP Annotation Judge for our real-estate tech client in Seattle, WA. for a 12-month, full-time contract.DescriptionAnnotation Judge to join Human In The Loop Operations team and contribute to growing set of Natural Language Processing (NLP) projects. The Annotation Judge will play a crucial role in fine-tuning and calibrating AI/ML...

  • Annotation Judge

    4 weeks ago

    seattle, United States Mathys+Potestio The Creative Party® Full time

    We are looking for an NLP Annotation Judge for our real-estate tech client in Seattle, WA. for a 12-month, full-time contract.DescriptionAnnotation Judge to join Human In The Loop Operations team and contribute to growing set of Natural Language Processing (NLP) projects. The Annotation Judge will play a crucial role in fine-tuning and calibrating AI/ML...

  • NLP Annotation Judge

    1 month ago

    Seattle, United States JobsRUs.com Full time

    JobsRUs.com is seeking to hire an NLP Annotation Judge for our client!Benefits Available!Weekly Pay!Pay Rate - $21.50/hrJob DescriptionThe AI team is harnessing the power of Generative AI to build services and product experiences for a seamless and convenient real estate transaction experienceThe AI Platform team is building platform services that enable...

  • NLP Annotation Judge

    4 weeks ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 10 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Judge

    1 week ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 10 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Judge

    2 months ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 12 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 12 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Judge

    1 week ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 12 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 12 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Judge

    6 days ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 10 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Judge

    6 days ago

    Seattle, United States RTA US Full time

    Job DescriptionJob DescriptionRussell Tobin & Associates is currently seeking an NLP Annotation Judge, 12 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: Remote, PST HoursDuration: 12 Months Contract until Jul 2025Major responsibilities:Review and/or...

  • NLP Annotation Specialist

    4 weeks ago

    Seattle, Washington, United States RTA US Full time

    Job DescriptionRTA US is currently seeking an NLP Annotation Judge for a 10-month contract role. This position involves reviewing and evaluating annotated data to ensure it meets quality standards and project requirements.Key Responsibilities:Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.Collaborate with...

  • NLP Annotation Specialist

    4 weeks ago

    Seattle, Washington, United States Localizationacademy Full time

    About Localization AcademyWe are a leading digital engineering solutions company that specializes in creating and managing software platforms and products that drive growth and deliver exceptional experiences to consumers and employees. Our expertise in engineering, cloud, data, experience design, and talent solutions accelerates transformation and impact...

  • NLP Annotation Specialist

    7 days ago

    Seattle, Washington, United States Localizationacademy Full time

    About the Role:We are seeking an experienced NLP Annotation Judge to join our team. As a key member of our AI/ML team, you will play a crucial role in fine-tuning and calibrating AI/Machine learning processes that handle verbal interactions, such as those between home buyers and real estate agents.You will work closely with experienced Operations Managers,...

  • AI Data Quality Assurance Expert

    4 weeks ago

    Seattle, Washington, United States RTA US Full time

    Job DescriptionRTA US is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: RemoteDuration: 10 Months ContractKey Responsibilities:Review and/or evaluate annotated data to ensure it meets quality standards and project...