AIML - Linguistic Annotation Engineer, Safety & Red Teaming

1 month ago

Cambridge, Massachusetts, United States Apple, Inc. Full time
Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly focused on LLM's. As a member of the Apple HCMI/Responsible AI group, you will be working on Apple's generative models that will power a wide array of new features, as well as longer term research in the generative AI space. Our team is currently interested in large generative models for vision and language, with particular interest on safety, robustness, and uncertainty in models.

Description

Apple Intelligence is powered by high quality, detailed linguistic annotations. This role is instrumental in coordinating and documenting annotation projects with human annotators, data scientists, and machine learning engineers. Responsibilities include: - Working with red teaming engineers to develop and create red teaming project strategies, interfaces, and guidelines - Relaying and interpreting project guidelines and instructions for red teamers and annotators - Serving as an interface for feedback and questions from red teamers and annotators back to data scientists - Prioritizing and scheduling projects to align with organizational goals and timelines - Working with data scientist and red teaming engineers to distill findings into recommendations for product engineering teams - Monitoring and managing individual annotator performance metrics (accuracy, throughput, etc.) while providing feedback and guidance for improvement

Minimum Qualifications
  • Prior experience in linguistic annotation tasks including: Named-entity recognition, part-of-speech tagging, constituency parsing, dependency parsing, or application-specific natural language parsing
  • Strong understanding of English language (linguistics, syntax, grammar) and its applications to Natural Language Processing
  • Experience working on crowd-based annotations projects
  • Experience developing, implementing, and communicating a sophisticated ontology or taxonomy system
  • Project management expertise: Ability to collaborate with team members to prioritize competing projects, set and maintain a schedule for milestones and project completions, communicate with all levels of engineers, in-house annotators, and remote/crowd-workers
Preferred Qualifications
  • BS, MS, or PhD in Linguistics or similar field and 2+ years experience as linguistic annotator
  • Prior Teaching experience
  • Experience interacting with LLMs (even if just for fun) and up-to-date knowledge of the kinds of issues that can occur with LLMs
  • Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable
  • Curiosity about tech and the way in which things can go wrong
  • Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.

  • AIML - ML Data Scientist, Safety & Red Teaming

    4 weeks ago

    Cambridge, Massachusetts, United States Apple, Inc. Full time

    Would you like to play a part in building the next generation of generative AI applications at Apple? We're looking for data scientists and engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. In this role, you'll have the opportunity to tackle innovative problems in machine learning, particularly...

  • Operations Manager AIML

    4 weeks ago

    Cambridge, Massachusetts, United States GlaxoSmithKline Full time

    Site Name: London The Stanley Building, Cambridge 300 Technology SquarePosted Date: Aug The Operations Manager is a key role in operations with a purpose to work with the artificial intelligence-machine learning (AIML) group to support in driving forward key projects and initiatives. The AIML group is working in an exciting and exploratory space focusing on...

  • Senior Scientist, AMP-Seq Team Lead

    2 months ago

    Cambridge, Massachusetts, United States Intellia Therapeutics Full time

    Why Join Intellia?Our mission is to develop curative genome editing treatments that can positively transform the lives of people living with severe and life-threatening diseases.Beyond our science, we live our four core values: One, Explore, Disrupt, Deliver and feel strongly that you can achieve more at Intellia. We have a single-minded determination to...

  • Research Associate, AMP-Seq

    1 month ago

    Cambridge, Massachusetts, United States Intellia Therapeutics Full time

    Why Join Intellia?Our mission is to develop curative genome editing treatments that can positively transform the lives of people living with severe and life-threatening diseases.Beyond our science, we live our four core values: One, Explore, Disrupt, Deliver and feel strongly that you can achieve more at Intellia. We have a single-minded determination to...

  • Environmental Safety Specialist

    5 days ago

    Cambridge, Massachusetts, United States Safety Partners, Inc. Full time

    Opportunity for an Environmental Health & Safety Compliance OfficerWe are seeking a committed Environmental Health & Safety Compliance Officer to enhance our team. In this pivotal role within our forward-thinking organization, you will be instrumental in developing and sustaining Environmental Health & Safety (EHS) initiatives for a variety of clients in the...

  • Environmental Safety Specialist

    5 days ago

    Cambridge, Massachusetts, United States Safety Partners, Inc. Full time

    Exciting Opportunity as an Environmental Safety Compliance OfficerWe are seeking a committed Environmental Safety Compliance Officer to become a vital part of our organization. In this role, you will be instrumental in developing and upholding Environmental Health & Safety (EHS) initiatives for a variety of clients in the life sciences and technology...

  • AIML - Sr Engineering Program Manager, Machine Learning Expansion

    5 days ago

    Cambridge, Massachusetts, United States Apple Full time

    **About Apple**Apple is a leading technology company known for its innovative products and commitment to diversity and inclusion. We strive to create groundbreaking experiences that change lives for the better.**Job Title: Engineering Program Manager****Job Summary:**We are seeking an experienced Engineering Program Manager to lead the development of our...

  • Engineering Team Lead

    2 weeks ago

    Cambridge, Massachusetts, United States ICONSTAFF Full time

    Job OverviewICONSTAFF is dedicated to enhancing healthcare through innovative technology solutions. We are seeking a seasoned Engineering Team Lead to oversee our platform engineering division. The ideal candidate will be an integral part of our engineering leadership and will guide a diverse team of frontend, backend, and data engineers. A proven history of...

  • Aquatic Safety Supervisor

    2 weeks ago

    Cambridge, Massachusetts, United States City of Cambridge Full time

    ABOUT THE DEPARTMENT:The Department of Human Service Programs (DHSP) is dedicated to enhancing the quality of life for residents through a variety of services and programs. Our initiatives cater to a diverse range of community members, from infants to seniors, and encompass various sectors including education, housing, and employment.ABOUT THE ROLE:Under the...

  • Mechatronics Engineer

    2 weeks ago

    Cambridge, Massachusetts, United States Verve, Inc. Full time

    Welcome to Verve, Inc. - Become Part of Our Innovative TeamAt Verve, Inc., we are on the lookout for skilled professionals to assist in the development of cutting-edge wearable technologies aimed at enhancing the mobility and safety of individuals globally. Our primary initiative focuses on creating an interconnected wearable system that prioritizes safety...

  • Senior AI/ML Data Scientist – Natural Language Processing

    1 month ago

    Cambridge, Massachusetts, United States Merk Full time

    Job Requirements This posting has been created to pipeline talent for prospective roles that we anticipate will be needed in the future for our organization. By applying to this Pipeline Advertisement you will be submitting your interest to be contacted for future roles similar to what is described in the Pipeline Advertisement.The Senior AI/ML Data...

  • Research Fellow in Mechanical Engineering

    2 weeks ago

    Cambridge, Massachusetts, United States Massachusetts Institute of Technology Full time

    Position OverviewThe Postdoctoral Researcher in Mechanical Engineering within the Varanasi Research Group will be instrumental in pioneering the advancement of cutting-edge bio-interfaces and biopsy methodologies aimed at the early identification of ovarian cancer. This research group is dedicated to the development of novel surface and fluidic devices...

  • Mechanical Systems Engineer

    2 weeks ago

    Cambridge, Massachusetts, United States Verve Full time

    Company Overview:Verve is at the forefront of developing innovative wearable technologies aimed at enhancing the mobility and safety of individuals in various industries. Our flagship product is a sophisticated, lightweight wearable system designed for continuous use, which significantly enhances worker safety and overall experience. We are collaborating...

  • 2nd Class Fire Safety Technician

    1 week ago

    Cambridge, Massachusetts, United States EMCOR Government Services Full time

    About EMCOR Government Services:EMCOR Government Services (EGS) is a leader in providing facilities management and energy solutions across various sectors, ensuring optimal operational efficiency and safety.Position: 2nd Class FiremanRole Overview: Responsible for the operation, monitoring, and maintenance of boiler systems under the supervision of a...

  • Safety Operations Manager

    2 weeks ago

    Cambridge, Massachusetts, United States Spaulding Rehabilitation Hospital Full time

    About Spaulding Rehabilitation HospitalSpaulding Rehabilitation Hospital is in search of a Safety Operations Manager to enhance our team. The Safety Operations Manager will be tasked with supervising all safety and parking functions within the organization, ensuring the protection and well-being of our employees, patients, and visitors. This position entails...

  • Safety Specialist

    3 months ago

    Cambridge, Massachusetts, United States QData Full time

    Roles & Responsibilities Monitor manage and ensure delivery of projects in a deadline-driven environment. Author Technical SDLC deliverables Technical assistance for testing preparation and implementation of enhancements Contribute to the creation of operational support documentation Drive technical delivery and accountability of internal staff as well as...

  • Statistical Geneticist, Diabetes, Obesity and Complications

    3 months ago

    Cambridge, Massachusetts, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Manufacturing Engineer

    1 week ago

    Cambridge, Massachusetts, United States Draper Full time

    Position Overview:Draper is a distinguished, nonprofit research and development organization based in Cambridge, MA, dedicated to addressing significant national challenges through innovative solutions. Our team of over 2,000 professionals collaborates across various disciplines, ensuring that our contributions are not only effective but also vital to fields...

  • Control Systems Engineer

    2 weeks ago

    Cambridge, Massachusetts, United States Insight Global Full time

    About the RoleInsight Global is seeking a skilled Control Systems Engineer to join our dynamic team. This position is pivotal in the design and implementation of electrical systems across various sectors.Key ResponsibilitiesDesign, develop, and test electrical equipment and systems for a range of applications including commercial and industrial...

  • Technical Team Leader

    2 weeks ago

    Cambridge, Massachusetts, United States Broad Institute Full time

    Position Overview:The Broad Institute of MIT & Harvard is seeking a Technical Team Leader to oversee our engineering group. In this role, you will guide a team dedicated to the development, maintenance, and operation of Hail, a comprehensive suite of libraries, data systems, and services designed for the analysis of genomic sequencing data. The ideal...