Annotation Lead

3 weeks ago

Seattle, United States Concordis Full time
Job DescriptionJob DescriptionLocation: Seattle, WA
12 -month contract through Concordis
Compensation: $34 – $38 hourly / Full Benefits
Fully Remote from any U.S. Time Zone / 40 hours per week
U.S. Citizen or Green Card Required

Job Description: Natural Language Processing Lead
We are seeking a Natural Language Processing Lead for a 12+ month contract opportunity. You will be working with a Seattle, WA based client that is a leader in the online real estate marketplace. Their brands focus on all stages of the home lifecycle: renting, buying, selling, financing and home improvement. They are committed to empowering consumers with unparalleled data, inspiration, and knowledge around homes, and connecting them with the right local professionals to help.
The Team Lead will play a crucial role in establishing processes and supervising a team of NLP Annotation Experts and Annotation Judges to fine-tune and calibrate AI/ML tools in the real estate space.
  • Will work directly with ML Engineers, Data Scientist, Software Developers and Natural Language experts.
  • In collaboration with an operations Manager, this person along with the team will be responsible for ensuring the quality of a number of possible elements related to our projects.
  • From the accuracy and humanlike traits of automated chatbots answers, to the classification of elements of a conversation annotated automatically or the review of search results based on understanding of complex users queries.
  • In addition to coordinating with multiple annotation judges, will play an essential role in defining clear guidelines which may be used by non-native English speakers.
  • Attention to detail and natural curiosity for language subtleties will be essential for the long-term scaling of our solutions.
RESPONSIBILITIES
  • Review and/or evaluate annotated data to ensure it meets quality standards and project requirements, and lead teams doing the same.
  • Provide feedback and guidance to ML/NLP engineers to improve accuracy.
  • Collaborate with NLP engineers and data scientists to optimize model performance based on annotated data.
  • Develop and maintain annotation guidelines and best practices.
  • Provide training data to ML/NLP engineers to establish Ground Truth data.
  • Provide input/examples on Training content, and lead training sessions with Annotation Judges
  • Identify gaps in training content and suggest improvements.
MINIMUM QUALIFICATIONS: 
  • Experience leading annotation teams, NLU teams, or human-in-the-loop teams with project management experience.
  • Minimum 5 years of NLP experience, with at least 2 years of lead/supervisory experience.
  • Preferred: Previous experience as an NLP annotator.
  • Able to provide solutions as this is a new space
  • Lead a team of at least 4 Data Annotators.
  • Mix of hands-on expertise and management (starting at 10-20% management, increasing over time).
  • Oversee project deadlines and ensure timely delivery.
  • Preferred: Bachelor's degree in English, Linguistics or a related field.
  • Experience working on NLP projects with a focus on transcriptions, localization, translation.
  • Experience leading teams, coordinating and leading meetings, conducting trainings, and delivering feedback.
  • Excellent attention to detail and analytical skills.
  • Interpersonal leadership skills and the ability to work effectively in a collaborative team environment.
  • Experience with tools and software used for NLP annotation is a plus.
  • Experience following or managing complex processes, and working both independently and with a team to achieve a goal.
     
PREFERRED QUALIFICATIONS 
  • Experience with copywriting, UX authoring, content development around voice and brand guidelines.
  • Experience with Machine-generated Speech evaluation, Search Results Evaluation, Search Query Categorization.
  • Proven experience creating annotation or evaluation guidelines which encourage efficient work.


  • Annotation Lead

    4 days ago

    Seattle, United States Concordis Full time

    Job DescriptionJob DescriptionLocation: Seattle, WA12 -month contract through Concordis Compensation: $34 – $38 hourly / Full BenefitsFully Remote from any U.S. Time Zone / 40 hours per weekU.S. Citizen or Green Card RequiredJob Description: Natural Language Processing LeadWe are seeking a Natural Language Processing Lead for a 12+ month contract...

  • Annotation Lead

    1 day ago

    Seattle, United States Concordis Full time

    Job DescriptionJob DescriptionLocation: Seattle, WA12 -month contract through Concordis Compensation: $34 – $38 hourly / Full BenefitsFully Remote from any U.S. Time Zone / 40 hours per weekU.S. Citizen or Green Card RequiredJob Description: Natural Language Processing LeadWe are seeking a Natural Language Processing Lead for a 12+ month contract...

  • Senior UX Designer

    6 days ago

    Seattle, United States POP Full time

    Job DescriptionJob DescriptionWe are looking for a Senior User Experience Designer who enjoys collaborating with strategists, creatives and technologists to shape great brand experiences. You understand the user-centered design process and are able to both conduct research and to design experiences with clients, customers and team members. Your key role is...

  • Senior UX Designer

    1 day ago

    Seattle, United States POP Full time

    Job DescriptionJob DescriptionWe are looking for a Senior User Experience Designer who enjoys collaborating with strategists, creatives and technologists to shape great brand experiences. You understand the user-centered design process and are able to both conduct research and to design experiences with clients, customers and team members. Your key role is...

  • AVP AI Platform Architecture

    2 days ago

    Seattle, United States CLevelCrossing Full time

    18,166 Job Information Deloitte AVP, AI Platform Architecture in Seattle Washington AVP, AI Platform Architecture Are you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities? If so, Deloitte & Touche LLP could be the place for you. Deloitte Risk and Financial Advisory helps clients manage...

  • Warehouse Associate- 2am-10:30am

    6 days ago

    Seattle, United States Essendant Full time

    ** Warehouse Associate- 2am-10:30am** **Job Category****:** Ind Contributor-NonExempt **Requisition Number****:** WAREH013319 Showing 1 location **Job Details** **Description** **Warehouse Associate (2am-10:30am)** ESSENDANT Inc. is a leading national distributor that fuels its customers growth with a vast product assortment, world-class fulfillment network...