Data Annotator

3 weeks ago

Seattle, United States eTeam Full time

Job Title: Annotation Lead

Location: San Francisco, CA - Remote

Pay Rate: $50/hr on w2

Duration: 12 months


Job Description: The Team Lead will play a crucial role in establishing processes and supervising a team of NLP Annotation Experts and Annotation Judges to fine-tune and calibrate AI/ML tools in the real estate space. Will work directly with ML Engineers, Data Scientist, Software Developers and Natural Language experts. In collaboration with an Operations Manager, this person along with the team will be responsible for ensuring the quality of a number of possible elements related to our projects. From the accuracy and humanlike traits of automated chatbots answers, to the classification of elements of a conversation annotated automatically or the review of search results based on understanding of complex users queries.

In addition to coordinating with multiple annotation judges, will play an essential role in defining clear guidelines which may be used by non-native English speakers. Attention to detail and natural curiosity for language subtleties will be essential for the long-term scaling of our solutions.

RESPONSIBILITIES

Review and/or evaluate annotated data to ensure it meets quality standards and project requirements, and lead teams doing the same.

Provide feedback and guidance to ML/NLP engineers to improve accuracy.

Collaborate with NLP engineers and data scientists to optimize model performance based on annotated data.

Develop and maintain annotation guidelines and best practices.

Provide training data to ML/NLP engineers to establish Ground Truth data.

Provide input/examples on Training content, and lead training sessions with Annotation Judges

Identify gaps in training content and suggest improvements.


MINIMUM QUALIFICATIONS:

Bachelor's degree in English, Linguistics or a related field.

Experience working on NLP projects with a focus on transcriptions, localization, translation.

Experience leading teams, coordinating and leading meetings, conducting trainings, and delivering feedbacks.

Excellent attention to detail and analytical skills.

Interpersonal leadership skills and the ability to work effectively in a collaborative team environment.

Experience with tools and software used for NLP annotation is a plus.

Experience following or managing complex processes, and working both independently and with a team to achieve a goal.


PREFERRED QUALIFICATIONS

Experience with copywriting, UX authoring, content development around voice and brand guidelines.

Experience with Machine-generated Speech evaluation, Search Results Evaluation, Search Query Categorization.

Proven experience creating annotation or evaluation guidelines which encourage efficient work.

  • AIML - Annotations Account & Program Manager, Data Operations

    2 weeks ago

    Seattle, Washington, United States Apple Full time

    SummaryThe AIML Data Operations team is a fast paced, dynamic environment. In this role you will engage with teams across Apple's ecosystem with the ultimate goal of delivering high-quality annotated data. You will be responsible for capturing initial requirements, following through on all program commitments from our cross-functional operations and...

  • Annotation Lead

    2 weeks ago

    Seattle, United States Concordis Full time

    Job DescriptionJob DescriptionLocation: Seattle, WA12 -month contract through Concordis Compensation: $34 – $38 hourly / Full BenefitsFully Remote from any U.S. Time Zone / 40 hours per weekU.S. Citizen or Green Card RequiredJob Description: Natural Language Processing LeadWe are seeking a Natural Language Processing Lead for a 12+ month contract...

  • Senior Computational Linguist

    2 days ago

    Seattle, United States Defined.ai Full time

    DescriptionWho is Defined.ai? Well, from a technical point of view, we leverage the power of a global crowd to provide some of the world’s biggest companies with the high-quality data they need to power their artificial intelligence. We’re instrumental to the progression and development of artificial intelligence and we couldn’t be prouder or more...

  • Senior Computational Linguist

    17 hours ago

    Seattle, United States Defined.ai Full time

    DescriptionWho is Defined.ai? Well, from a technical point of view, we leverage the power of a global crowd to provide some of the world’s biggest companies with the high-quality data they need to power their artificial intelligence. We’re instrumental to the progression and development of artificial intelligence and we couldn’t be prouder or more...

  • Clinical Informatician

    1 day ago

    Seattle, United States Truveta Full time

    Clinical Informatician (Contract) Truveta is the world's first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta' s ambitious vision requires an...

  • Senior Software Engineer

    1 week ago

    Seattle, United States Truveta Full time

    Senior Software Engineer - UX (Contract Position) Truveta is the world's first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta' s ambitious...

  • Senior Software Engineer

    1 week ago

    Seattle, Washington, United States Truveta Full time

    Senior Software Engineer – UX (Contract Position) Truveta is the world's first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta' s ambitious...

  • Software Engineer IV

    2 days ago

    Seattle, United States BCforward Full time

    Software Engineer IV BCforward is currently seeking a highly motivated Software Engineer IV for Onsite.Position Title: Software Engineer IV Location: Seattle, WA (Onsite) Anticipated Start Date: ASAP Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Duration: 12 Months....

  • Policy Program Manager, TMT

    7 days ago

    Seattle, United States Amazon.com Services LLC Full time

    We are seeking an experienced policy manager to own strategy and implementation of Creators’ policies. You will be responsible for developing and maintaining policies that protect associates and influencers, Amazon's brand, and end-customers. You will be a trusted advisor to TSS, business teams, and legal teams on high-visibility escalations. You will...