AIML - Linguistic Annotation Engineer, Safety & Red Teaming

1 month ago

Cambridge, United States Apple, Inc. Full time
Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly focused on LLM's. As a member of the Apple HCMI/Responsible AI group, you will be working on Apple's generative models that will power a wide array of new features, as well as longer term research in the generative AI space. Our team is currently interested in large generative models for vision and language, with particular interest on safety, robustness, and uncertainty in models.

Description

Apple Intelligence is powered by high quality, detailed linguistic annotations. This role is instrumental in coordinating and documenting annotation projects with human annotators, data scientists, and machine learning engineers. Responsibilities include: - Working with red teaming engineers to develop and create red teaming project strategies, interfaces, and guidelines - Relaying and interpreting project guidelines and instructions for red teamers and annotators - Serving as an interface for feedback and questions from red teamers and annotators back to data scientists - Prioritizing and scheduling projects to align with organizational goals and timelines - Working with data scientist and red teaming engineers to distill findings into recommendations for product engineering teams - Monitoring and managing individual annotator performance metrics (accuracy, throughput, etc.) while providing feedback and guidance for improvement

Minimum Qualifications

  • Prior experience in linguistic annotation tasks including: Named-entity recognition, part-of-speech tagging, constituency parsing, dependency parsing, or application-specific natural language parsing
  • Strong understanding of English language (linguistics, syntax, grammar) and its applications to Natural Language Processing
  • Experience working on crowd-based annotations projects
  • Experience developing, implementing, and communicating a sophisticated ontology or taxonomy system
  • Project management expertise: Ability to collaborate with team members to prioritize competing projects, set and maintain a schedule for milestones and project completions, communicate with all levels of engineers, in-house annotators, and remote/crowd-workers


Preferred Qualifications

  • BS, MS, or PhD in Linguistics or similar field and 2+ years experience as linguistic annotator
  • Prior Teaching experience
  • Experience interacting with LLMs (even if just for fun) and up-to-date knowledge of the kinds of issues that can occur with LLMs
  • Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable
  • Curiosity about tech and the way in which things can go wrong


  • Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.

  • AIML - Linguistic Annotation Engineer, Safety & Red Teaming

    1 month ago

    Cambridge, Massachusetts, United States Apple, Inc. Full time

    Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly...

  • Senior Operations Manager

    7 hours ago

    Cambridge, Massachusetts, United States GlaxoSmithKline Full time

    Job Title: Senior Operations Manager - AIMLWe are seeking a highly skilled Senior Operations Manager to join our Artificial Intelligence and Machine Learning (AIML) team. The successful candidate will be responsible for driving forward key projects that interface with clinical trials, supporting the Head of AIML operations and the AIML Director in mobilizing...

  • Senior Operations Manager AIML

    9 hours ago

    Cambridge, Massachusetts, United States GSK LLP Full time

    Job Title: Senior Operations Manager AIMLWe are seeking a highly skilled Senior Operations Manager to join our Artificial Intelligence and Machine Learning (AIML) team. The successful candidate will be responsible for driving forward key projects that interface with clinical trials, working closely with the AIML leadership to mobilize R&D's people, time, and...

  • AIML - ML Data Scientist, Safety & Red Teaming

    1 month ago

    Cambridge, Massachusetts, United States Apple, Inc. Full time

    Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly...

  • AIML - ML Data Scientist, Safety & Red Teaming

    1 month ago

    Cambridge, United States Apple, Inc. Full time

    Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly...

  • Operations Manager AIML

    1 month ago

    Cambridge, Massachusetts, United States GlaxoSmithKline Full time

    Site Name: London The Stanley Building, Cambridge 300 Technology SquarePosted Date: Aug The Operations Manager is a key role in operations with a purpose to work with the artificial intelligence-machine learning (AIML) group to support in driving forward key projects and initiatives. The AIML group is working in an exciting and exploratory space focusing on...

  • Senior Scientist, AMP-Seq Team Lead

    4 months ago

    Cambridge, United States Intellia Therapeutics Full time

    Why Join Intellia?Our mission is to develop curative genome editing treatments that can positively transform the lives of people living with severe and life-threatening diseases.Beyond our science, we live our four core values: One, Explore, Disrupt, Deliver and feel strongly that you can achieve more at Intellia. We have a single-minded determination to...

  • Senior Scientist, AMP-Seq Team Lead

    2 months ago

    Cambridge, Massachusetts, United States Intellia Therapeutics Full time

    Why Join Intellia?Our mission is to develop curative genome editing treatments that can positively transform the lives of people living with severe and life-threatening diseases.Beyond our science, we live our four core values: One, Explore, Disrupt, Deliver and feel strongly that you can achieve more at Intellia. We have a single-minded determination to...

  • AIML - Sr Engineering Program Manager, Machine Learning FM

    1 week ago

    Cambridge, United States APPLE GROVE TREATMENT CENTER Full time

    AIML - Sr Engineering Program Manager, Machine Learning FM Apple Published 30 Aug 2024 Share this job Cambridge, MA, USA Full Time Share this job Role Highlights Objective-C Speech Recognition NLU Project Management Data Management Program Management Release Management foundation model AI Agile Security Search Tools, Libraries and Frameworks Description...

  • Research Associate, AMP-Seq

    1 month ago

    Cambridge, Massachusetts, United States Intellia Therapeutics Full time

    Why Join Intellia?Our mission is to develop curative genome editing treatments that can positively transform the lives of people living with severe and life-threatening diseases.Beyond our science, we live our four core values: One, Explore, Disrupt, Deliver and feel strongly that you can achieve more at Intellia. We have a single-minded determination to...

  • Environmental Safety Specialist

    1 week ago

    Cambridge, Massachusetts, United States Safety Partners, Inc. Full time

    Opportunity for an Environmental Health & Safety Compliance OfficerWe are seeking a committed Environmental Health & Safety Compliance Officer to enhance our team. In this pivotal role within our forward-thinking organization, you will be instrumental in developing and sustaining Environmental Health & Safety (EHS) initiatives for a variety of clients in the...

  • Environmental Safety Specialist

    1 week ago

    Cambridge, Massachusetts, United States Safety Partners, Inc. Full time

    Exciting Opportunity as an Environmental Safety Compliance OfficerWe are seeking a committed Environmental Safety Compliance Officer to become a vital part of our organization. In this role, you will be instrumental in developing and upholding Environmental Health & Safety (EHS) initiatives for a variety of clients in the life sciences and technology...

  • AIML - Sr Engineering Program Manager, Machine Learning Expansion

    1 week ago

    Cambridge, Massachusetts, United States Apple Full time

    **About Apple**Apple is a leading technology company known for its innovative products and commitment to diversity and inclusion. We strive to create groundbreaking experiences that change lives for the better.**Job Title: Engineering Program Manager****Job Summary:**We are seeking an experienced Engineering Program Manager to lead the development of our...

  • Engineering Team Lead

    2 weeks ago

    Cambridge, Massachusetts, United States ICONSTAFF Full time

    Job OverviewICONSTAFF is dedicated to enhancing healthcare through innovative technology solutions. We are seeking a seasoned Engineering Team Lead to oversee our platform engineering division. The ideal candidate will be an integral part of our engineering leadership and will guide a diverse team of frontend, backend, and data engineers. A proven history of...

  • Engineering Team Lead

    3 weeks ago

    Cambridge, United States Massachusetts Institute of Technology Full time

    ```html ENGINEERING TEAM LEAD MIT Quest for Intelligence - Systems Engineering Team To lead and supervise a team that is building and maintaining artificial intelligence and machine learning (ML) computational platforms designed to advance Quest missions research, compose and benchmark models of natural intelligence, and assess the utility of systems in...

  • Bioinformatics Data Engineer

    4 weeks ago

    Cambridge, United States Greenfield Source Full time

    In this entry-level role you will work on-site at least 3-4 days per week, providing data engineering and software development to interdisciplinary projects ranging from basic research & discovery to clinical sample processing and iterative biological analysis. Motivated by the chance to help decipher fundamental biological processes that directly impact...

  • Engineering Team Lead

    1 month ago

    Cambridge, United States Massachusetts Institute of Technology Full time

    Job Description ENGINEERING TEAM LEAD, MIT Quest for Intelligence - Systems Engineering Team, to lead and supervise a team that is building and maintaining artificial intelligence and machine learning (ML) computational platforms designed to advance Quest missions research, compose and benchmark models of natural intelligence, and assess the utility of...

  • Senior Electrical Engineer

    3 weeks ago

    Cambridge, United States Sense Full time

    Job DescriptionJob DescriptionProduct Development | Cambridge, MA, United StatesOur mission at Sense is to make all homes intelligent by keeping people informed about what's happening in their homes, and helping to make homes safer, more efficient, and more reliable.At Sense, we are serious about having a real impact on climate change.Sense was founded...

  • Medical Assistant

    50 minutes ago

    Cambridge, Massachusetts, United States Cambridge Health Alliance Full time

    Job Summary:The Medical Assistant - Clinical Support Professional is an essential member of the clinical team, ensuring the delivery of effective and safe care to our patients and families. Key responsibilities include:Managing the flow of patients through the clinic to ensure efficient and timely care.Rooming patients and preparing them for medical...

  • Senior Electrical Engineer

    1 week ago

    Cambridge, United States Sense Full time

    Job DescriptionJob DescriptionProduct Development | Cambridge, MA, United StatesOur mission at Sense is to make all homes intelligent by keeping people informed about what's happening in their homes, and helping to make homes safer, more efficient, and more reliable.At Sense, we are serious about having a real impact on climate change.Sense was founded...