Evaluation & Response Senior Specialist

4 weeks ago

Austin, United States Apple Full time

Evaluation & Response Senior Specialist

Austin,Texas,United States

Machine Learning and AI

Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. The people here at Apple don't just craft products - they build the kind of wonder thatʼs revolutionized entire industries. It's the diversity of those people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it. Siri offers a faster, easier way to get things done on your Apple devices, even before you ask. Millions of people now use Siri to send messages, play their favorite song or even take a selfie. The AIML Data Operations team is passionate about technology with a focus on enriching the customer experience. We are looking for an Evaluation and Response Senior Specialist that has high attention to quality and accuracy. You are creative and have a passion for detail with proven expertise in English language analysis.

**Key Qualifications**

+ Ability to leverage creative writing skills to craft engaging and informative responses that resonate with the target audience and maintain a consistent tone.

+ Experience working with language data (research, analysis, translation, review).

+ Aptitude for acquiring advanced technical skills, an eagerness to learn and take on new challenges.

+ Strong understanding of natural language processing and machine learning concepts.

+ Proven skills in researching and analyzing content to ensure accuracy.

+ Proven expertise in the English language with excellent comprehension and grammar skills.

+ Expertise with navigating systems, tools and changing workflows.

+ Attention to detail and critical thinking skills in evaluation of language context, tone and intent.

+ Ability to analyze and provide accurate reporting; with the ability to identify and communicate errors and inconsistencies in responses.

+ Familiarity with AI safety concerns, and the ability to recognize and mitigate harmful content.

+ Demonstrates flexibility and adaptability to changing workflows and responsibilities.

+ Ability to conduct root cause analysis on key error trends, summarize findings, recommend solutions, and coach and mentor junior specialists to improve data quality.

+ Minimum 1 year of experience in evaluating AI-generated content and working with large language models.

**Description**

As part of the team, you play a central role in enhancing data quality. As an Evaluation and Response Senior Specialist, you'll evaluate and analyze responses generated by our language models for accuracy, relevance, coherence, and appropriateness across various contexts and topics. In addition to achieving your production goals, you will collaborate with our AI research and engineering teams to provide insights and recommendations on improving model performance, including refining responses and addressing common shortcomings. You will assess responses for potential biases, harmful content, or inappropriate language, and implement measures to ensure the model's outputs align with safety and ethical guidelines. You'll provide ongoing evaluation feedback to guide model development and fine-tuning to improve user experience and model behavior. You will maintain high-quality standards for annotated data and ensure consistent evaluation metrics are applied. Your flexibility and the ability to prioritize tasks is essential. We focus on data quality, thinking creatively on how customers use our products and use this knowledge for improvements.

**Education & Experience**

Bachelor's degree English Literature or Journalism specialization preferred

**Additional Requirements**

+ Successful completion of a pre-employment assessment and background check

+ Successful completion of initial training and certification testing

**Apple Footer**

Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race,color,religion,sex,sexual orientation,gender identity,national origin,disability,Veteran status,or other legally protected characteristics. Learn more about your EEO rights as an applicant (Opens in a new window) .

Apple will not discriminate or retaliate against applicants who inquire about,disclose,or discuss their compensation or that of other applicants. United States Department of Labor. Learn more (Opens in a new window) .

Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you're applying for a position in San Francisco,review the San Francisco Fair Chance Ordinance guidelines (opens in a new window) applicable in your area.

Apple participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program (Opens in a new window) .

Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy Learn more (Opens in a new window) .

  • Evaluation & Response Senior Specialist

    1 month ago

    Austin, United States Apple Inc. Full time

    Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. The people here at Apple don't just craft products - they build the kind of wonder thatʼs revolutionized entire industries. It's the diversity of those people and their ideas that inspires the innovation that...

  • Evaluation & Response Senior Specialist

    3 weeks ago

    Austin, United States Apple Inc. Full time

    Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. The people here at Apple don't just craft products - they build the kind of wonder thatʼs revolutionized entire industries. It's the diversity of those people and their ideas that inspires the innovation that...

  • Leasing Specialist

    2 months ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    **LEASING SPECIALIST** We are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. ESSENTIAL FUNCTIONS - Greet prospective residents, communicate, and highlight the features of the property while...

  • Leasing Specialist

    2 weeks ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    **LEASING SPECIALIST** We are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. ESSENTIAL FUNCTIONS - Greet prospective residents, communicate, and highlight the features of the property while...

  • Leasing Specialist

    3 weeks ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Leasing Specialist

    2 months ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Leasing Specialist

    3 weeks ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Leasing Specialist

    7 days ago

    Austin, Texas, United States Apartment Managing Professionals, LTD Full time

    LEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team.Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin.ESSENTIAL FUNCTIONS Greet prospective residents, communicate, and highlight the features of the property while answering...

  • Senior Communications Specialist

    2 months ago

    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: The Texas Department of State Health Services (DSHS) Communications Team is looking for an experienced marketing professional to fill the Senior Communications Specialist position. This is a hybrid role with opportunities to work remotely and in-person at our office in Austin, Texas. The Senior Communications Specialist will work with...

  • Senior Communications Specialist

    3 weeks ago

    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: The Texas Department of State Health Services (DSHS) Communications Team is looking for an experienced marketing professional to fill the Senior Communications Specialist position. This is a hybrid role with opportunities to work remotely and in-person at our office in Austin, Texas. The Senior Communications Specialist will work with...

  • Leasing Specialist- Bridge at Southpark Meadows

    2 months ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Floating Leasing Specialist- Austin Area

    2 months ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Floating Leasing Specialist- Austin Area

    2 months ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Floating Leasing Specialist- Austin Area

    3 weeks ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Floating Leasing Specialist- Austin Area

    3 weeks ago

    Austin, United States Apartment Managing Professionals, LTD Full time

    Job DescriptionJob DescriptionLEASING SPECIALISTWe are looking for dynamic, friendly, and positive team members to join our team. Apartment Management Professionals (AMP) proudly manages first-rate communities in some of the most desirable locations throughout Austin. The ideal candidate enjoys working in a fast-paced environment, is creative, has a high...

  • Analytics & Evaluation Manager

    1 week ago

    Austin, United States Dept of Family & Protectve Svc Full time

    The Analytics and Evaluation Manager will be part of the Department of Family and Protective Services (DFPS) Office of Data and Systems Improvement (ODSI). The position will function as the manager of the Analytics and Evaluation (A&E) team with a focus on supporting child protective investigations, child protective services, and contracted services. ODSI...

  • Senior Communications Specialist

    2 weeks ago

    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: Information Specialist V Under the general direction of the Digital Communication Manager, this position performs senior, highly advanced communications-related work to build the DSHS brand and increase public and stakeholder knowledge and awareness of public health issues. In collaboration with DSHS programs and outside marketing...

  • Public Relations Specialist

    7 days ago

    Austin, United States Global Medical Response Full time

    **Job Description**: **Public Relations Specialist** **REMOTE** **$75000K - $80000K** GMR's Public Relations Specialist role is a member of the Marketing and Communications team reporting to the Director of Public Relations. **ESSENTIAL FUNCTIONS/DUTIES**: - The Public Relations Specialist will manage the daily PR needs and media requests for assigned...

  • Senior Environmental Project Manager

    3 weeks ago

    Austin, United States Earth Systems Response & Restoration Full time

    We are looking for a Senior Project Manager who will manage all aspects of a project from conception to close out. You will be working to ensure that all tasks are completed within scope and budget, working under all H&S regulations, and enhancing the client relationship. You must have experience in Environmental Consulting. As the Senior Project Manager,...

  • Senior Environmental Project Manager

    4 weeks ago

    Austin, United States Earth Systems Response & Restoration Full time

    We are looking for a Senior Project Manager who will manage all aspects of a project from conception to close out. You will be working to ensure that all tasks are completed within scope and budget, working under all H&S regulations, and enhancing the client relationship. You must have experience in Environmental Consulting. As the Senior Project Manager,...