Linguistics or English Graduate

3 days ago


Remote, Oregon, United States TEEMA Full time
Job Title

TEEMA is seeking a highly skilled Linguistics or English Graduate to join our Human In The Loop Operations team as an Annotation Judge. As a key member of our team, you will play a crucial role in fine-tuning and calibrating AI/ML processes that handle verbal interactions.

You will work directly with experienced Operations Managers and Natural Language experts to ensure the quality of annotated data, from the accuracy and humanlike traits of automated chatbot answers to the classification of elements of a conversation annotated automatically or the review of search results based on understanding of complex user queries.

As an Annotation Judge, you will be responsible for:

  • Reviewing and/or evaluating annotated data to ensure it meets quality standards and project requirements.
  • Providing feedback to ML/NLP engineers to improve accuracy and overall quality.
  • Collaborating with internal teams to optimize model performance based on annotated data.
  • Helping develop and maintain annotation guidelines and best practices.
  • Providing training data to ML/NLP engineers to establish Ground Truth data.
  • Providing input/examples on Training content.
  • Identifying gaps in training content and suggesting improvements.

BASIC QUALIFICATIONS

Bachelor's degree in English, Linguistics or a related field.

Excellent attention to detail and analytical skills.

Ability to work effectively in a collaborative team environment.

Experience with tools and software used for NLP annotation is a plus.

PREFERRED QUALIFICATIONS

Experience or demonstrated interest in linguistics.

Experience working on NLP projects with a focus on chatbots, text classification, and named entity recognition.

Experience with copywriting, UX authoring, content development around voice and brand guidelines.

Experience with Machine-generated Speech evaluation, Prompt Engineering, Search Results Evaluation, Search Query Categorization.

Experience following complex processes.

Ability to work both independently and with a team to achieve a goal.



  • Remote, Oregon, United States TEEMA Full time

    Job OpportunityWe are seeking a highly skilled Annotation Judge to join our Human In The Loop Operations team and contribute to our growing set of Natural Language Processing (NLP) projects.Key ResponsibilitiesReview and evaluate annotated data to ensure it meets quality standards and project requirements.Provide feedback to ML/NLP engineers to improve...


  • Remote, Oregon, United States Yorkville University Full time

    About Yorkville UniversityYorkville University is a private institution that offers a range of academic programs, including the Master of Arts in Counselling Psychology. We are committed to providing students with a high-quality education that prepares them for successful careers in the field of counselling psychology.Job DescriptionWe are seeking a...


  • Remote, United States Kelly Services Full time

    Job DescriptionJob DescriptionAt Kelly® Professional & Industrial, we are passionate about helping you find a job that works for you! We are assisting our client, an industry leader in the interpreting field, to find a few skilled ASL Interpreters to join their team. We currently have weekend and short weekday morning shifts available. Individuals that...


  • Remote, United States Dexcom Full time

    The Company Dexcom Corporation (NASDAQ DXCM) is a pioneer and global leader in continuous glucose monitoring (CGM). Dexcom began as a small company with a big dream: To forever change how diabetes is managed. To unlock information and insights that drive better health outcomes. Here we are 25 years later, having pioneered an industry. And we're just...