Linguistic Annotation Specialist for AI Safety

2 weeks ago


Seattle, Washington, United States Apple Full time

Position Overview:

Role Identifier:

Are you interested in contributing to the evolution of cutting-edge generative AI technologies at Apple? We are seeking skilled data scientists and engineers to engage in groundbreaking initiatives that will shape the future of our products and the industry at large.

In this position, you will have the chance to address challenging issues in machine learning, with a particular emphasis on large language models (LLMs).

As part of the Apple HCMI/Responsible AI team, you will be involved in developing Apple's generative models that will enable a variety of innovative features, alongside long-term research in the generative AI domain.

Our current focus is on extensive generative models for both vision and language, especially concerning safety, robustness, and uncertainty within these models.

Role Responsibilities:

  • Collaborating with red teaming engineers to devise and implement project strategies, interfaces, and guidelines
  • Communicating and clarifying project guidelines and instructions for red team members and annotators
  • Acting as a liaison for feedback and inquiries from red team members and annotators back to data scientists
  • Prioritizing and scheduling projects to align with organizational objectives and timelines
  • Partnering with data scientists and red teaming engineers to translate findings into actionable recommendations for product engineering teams
  • Tracking and managing individual annotator performance metrics (accuracy, throughput, etc.) while providing constructive feedback and guidance for enhancement
Minimum Qualifications:
  • Proven experience in linguistic annotation tasks such as named entity recognition, part-of-speech tagging, constituency parsing, dependency parsing, or application-specific natural language parsing
  • Strong grasp of the English language (linguistics, syntax, grammar) and its applications in Natural Language Processing
  • Experience in crowd-based annotation projects
  • Background in developing, implementing, and articulating a comprehensive ontology or taxonomy system
  • Project management skills: Ability to work collaboratively with team members to prioritize competing projects, establish and maintain schedules for milestones and project completions, and communicate effectively with engineers, in-house annotators, and remote/crowd workers
Preferred Qualifications:
  • BS, MS, or PhD in Linguistics or a related field with 2+ years of experience as a linguistic annotator
  • Prior teaching experience
  • Familiarity with LLMs and current knowledge of potential issues associated with them
  • Interest in fairness and bias in generative AI systems, along with a strong desire to contribute to equitable technology
  • Enthusiasm for technology and an understanding of potential pitfalls
Compensation & Benefits:

At Apple, base salary is just one component of our comprehensive compensation package, which is determined within a specified range. This allows for growth as you develop within your role. The base salary range for this position is between $166,600 and $296,300, depending on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become shareholders through participation in our discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit awards and can purchase Apple stock at a discount through the Employee Stock Purchase Plan.


Additional Benefits:

Employees receive comprehensive medical and dental coverage, retirement benefits, a variety of discounted products and free services, and reimbursement for certain educational expenses related to career advancement at Apple, including tuition.

This role may also be eligible for discretionary bonuses or commission payments as well as relocation assistance. Learn more about Apple Benefits.

Equal Opportunity Statement:

Apple is an equal opportunity employer committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

Learn more about your EEO rights as an applicant.

  • Seattle, Washington, United States Apple Full time

    Position Overview:Role Identifier: Are you interested in contributing to the evolution of generative AI technologies at Apple? We are seeking skilled data scientists and engineers to engage in groundbreaking initiatives that will shape the future of our products and the industry at large.In this position, you will have the chance to address challenging...


  • Seattle, Washington, United States Apple Full time

    About the RoleWe are seeking a highly skilled AI Linguistic Annotation Engineer to join our team at Apple. As a member of our HCMI/Responsible AI group, you will play a critical role in building the next generation of generative AI applications.Key ResponsibilitiesWork with red teaming engineers to develop and create red teaming project strategies,...


  • Seattle, Washington, United States Mathys+Potestio The Creative Party® Full time

    About the RoleWe are seeking a highly skilled NLP Annotation Specialist to join our Human In The Loop Operations team at Mathys+Potestio / The Creative Party®. As an NLP Annotation Specialist, you will play a crucial role in fine-tuning and calibrating AI/ML processes that handle verbal interactions between home buyers and real estate agents.Key...


  • Seattle, Washington, United States RTA US Full time

    Job DescriptionRTA US is currently seeking an NLP Annotation Judge for a 10-month contract role. This position involves reviewing and evaluating annotated data to ensure it meets quality standards and project requirements.Key Responsibilities:Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.Collaborate with...


  • Seattle, Washington, United States Lion People Global Full time

    Position: Senior Linguistic Data SpecialistLocation: RemoteContract Type: TemporaryAbout Lion People Global:We are at the forefront of providing high-quality data solutions to some of the largest enterprises worldwide, enhancing their artificial intelligence capabilities. Our innovative approach harnesses the collective expertise of a global community,...


  • Seattle, Washington, United States Lion People Global Full time

    Job OverviewPosition SummaryAt Lion People Global, we harness the capabilities of a diverse global workforce to deliver top-tier data solutions for leading enterprises, driving advancements in artificial intelligence. Our commitment to innovation and excellence fuels our passion for being at the forefront of a transformative industry.We are a team of...


  • Seattle, Washington, United States Defined Full time

    DescriptionWho is Well, from a technical point of view, we leverage the power of a global crowd to provide some of the world's biggest companies with the high-quality data they need to power their artificial intelligence. We're instrumental to the progression and development of artificial intelligence and we couldn't be prouder or more inspired to be...


  • Seattle, Washington, United States Lion People Global Full time

    Contract Type: TemporaryPosition OverviewAbout Lion People Global:We harness the capabilities of a worldwide community to deliver top-notch data essential for driving advancements in artificial intelligence for leading corporations. Our contributions are pivotal in the evolution of AI, and we take immense pride in being part of a transformative industry.On a...


  • Seattle, Washington, United States RTA US Full time

    Job DescriptionJob Summary:Russell Tobin & Associates (RTA US) is seeking a highly skilled NLP Annotation Specialist to join our team. As a key member of our team, you will be responsible for reviewing and evaluating annotated data to ensure it meets quality standards and project requirements.Key Responsibilities:Review and evaluate annotated data to ensure...


  • Seattle, Washington, United States JobsRUs Full time

    Position Overview:JobsRUs is in search of an NLP Quality Assurance Specialist to support our client.Benefits:Pay Rate - $21.50/hrAvailability required between 10am-2pm PST.About Us:At the core of our operations lies artificial intelligence and machine learning, which drive our services from personalized recommendations to automated interactions. We are...

  • Linguist III

    2 months ago


    Seattle, Washington, United States Iron Systems Full time

    Iron Systems is an innovative, customer-focused provider of custom-built computing infrastructure platforms such as network servers, storage, OEM/ODM appliances & embedded systems. For more than 15 years, customer have trusted us for our innovative problem solving combined with holistic design, engineering, manufacturing, logistic and global support...


  • Seattle, Washington, United States Localizationacademy Full time

    About Localization AcademyWe are a leading digital engineering solutions company that specializes in creating and managing software platforms and products that drive growth and deliver exceptional experiences to consumers and employees. Our expertise in engineering, cloud, data, experience design, and talent solutions accelerates transformation and impact...


  • Seattle, Washington, United States RTA US Full time

    Job DescriptionRTA US is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote. Apply today for immediate consideration.Hourly Pay: $17 to $20 W2Location: RemoteDuration: 10 Months ContractKey Responsibilities:Review and/or evaluate annotated data to ensure it meets quality standards and project...

  • AI/ML Engineer

    5 days ago


    Seattle, Washington, United States Apple Full time

    About the RoleWe are seeking a highly skilled AI/ML Engineer to join our team at Apple, focusing on the development of generative AI applications. As a key member of our HCMI group, you will work on building and deploying large-scale generative models for vision and language, with a strong emphasis on safety, robustness, and uncertainty.Key...


  • Seattle, Washington, United States Apple Full time

    Position Overview:Role Identifier: Are you interested in contributing to the evolution of generative AI technologies at Apple? We are seeking talented scientists and engineers to engage in pioneering projects that will shape the future of our products and the wider community.In this position, you will have the chance to address cutting-edge challenges in...

  • AI Ontologist

    4 days ago


    Seattle, Washington, United States Apple Full time

    About the RoleWe are seeking an experienced AI Ontologist to join our Siri team at Apple. As an AI Ontologist, you will play a critical role in designing and building the standards for Siri's internal meaning representation, enabling the development of groundbreaking technology for machine learning, natural language understanding, and artificial...


  • Seattle, Washington, United States Apple Full time

    Position Overview:Role Number: Are you interested in contributing to the development of cutting-edge generative AI applications at Apple? We are seeking talented scientists and engineers to engage in groundbreaking projects that will shape the future of Apple, our offerings, and the wider community.In this position, you will have the chance to address...


  • Seattle, Washington, United States RTA US Full time

    Job Opportunity: Speech and Language AnnotatorAbout the Role:RTA US is seeking a skilled Speech and Language Annotator to join our team. As a Speech and Language Annotator, you will play a crucial part in improving the quality and accuracy of audio experiences by transcribing and annotating speech data.Key Responsibilities:Transcription & Annotation: Provide...


  • Seattle, Washington, United States RTA US Full time

    Job OverviewRTA US is currently seeking a NLP Quality Assurance Specialist for a contract role. This position involves working remotely and requires alignment with PST hours.Compensation: $17 to $20 per hour (W2)Contract Duration: 12 MonthsKey Responsibilities:Assess and evaluate annotated datasets to ensure compliance with quality benchmarks and project...


  • Seattle, Washington, United States Aston Carter Full time

    About the RoleAston Carter is seeking a skilled Speech and Language Annotator to join our team. As a Speech and Language Annotator, you will play a critical role in supporting the development of speech and language technology.Key ResponsibilitiesProvide high-quality transcription and annotation services for speech data.Translate established guidelines into...