Data Labeling Analyst

1 month ago


Menlo Park, United States Rose International Full time

Qualified candidates must be located in one of the following locations due to position being ONSITE:

Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA

**Urdu*

**This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic images, videos and writings, offensive or derogatory language, and other potential objectionable material, i.e. child exploitation, graphic violence, self-injury, animal abuse, and other content which may be considered offensive or disturbing.

Ability to work with graphic and objectionable content.**

Top 3 must-have HARD skills:

Fluent in Urdu

Very solid written and verbal *English* communication skills

Excellent writing, communication and collaboration skills, with the ability to work effectively with cross-functional teams

Experience with data annotation tools and techniques

2-3 Years of experience

Technical background will be beneficial in quickly onboarding to the role of red teamer

Good to have skills:

Linguistic training/Media education/Content Moderation

Experience with large language/image/video models

Ability to work independently with light touch guidance and oversight

Bachelor’s degree preferred

Client is seeking an Image & Video Model Red Teamer to join our Generative AI Media Safety team. Generative AI is a research to production organization focused on making significant progress in AI and being a bridge between AI research and client Platforms products. Individuals in this role are expected to be experienced in data annotation.

The successful candidate will be responsible for interacting with our (Text/Image) -> (Image/Video) model expressly to identify potential weaknesses and vulnerabilities to improve accuracy while increasing trust and safety of the model.

Responsibilities:

Execute plans to test the safety of our Text -> Image model.

Collaborate with the development team to design and execute probing text prompts, and provide feedback on the safety and quality of the image outputs and the probing methods

Stay up-to-date on the latest techniques and tools to ensure the model remains secure.

Story Behind the Need – Business Group & Key Projects:

Generative AI Media Safety team

Future contractors could be needed in the next 12-months depending on whether or not we scale the effort to other products research areas

We require our human labelers to be able to see our internal taxonomy of risks as well as our sensitive, unrealized model output and user data. Given the rapid cycles of model refinement, it is preferable for a trained workforce of CW’s can complete red team tasks on an ongoing basis after an initial training.

Compelling Story & Candidate Value Proposition:

You will work on one of the most advanced pieces of technology in the world today

Contribute to developing the latest generative AI products within the industry

Unique opportunity to gain experience within the generative AI space

Unique opportunity to contribute to making AI safe for people

Typical Day in the Role:

8 hours per day

Not expecting overtime, but in extreme cases it might be a possibility if breaking issues emerge

How will performance be measured:

Performance will be measured based on the number of attempts made by each CW to “break” the foundation model through an assigned prompt. We are expecting approximately 75 attempts per week will be made by each CW

When we refer to attempts, we mean attempts to cause our models to output undesirable results, either because they violate explicit policies or else because they fail to meet the safety bar for our products and services.

  • **Only those lawfully authorized to work in the designated country associated with the position will be considered.**

  • **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**

Benefits:

For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).



  • Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue, Washington DC, Austin TX, New York NY , San Francisco CA and Menlo Park CA** ENGLISH**The main function of a data labeling analyst is to create and manage labeling and change processes within...

  • Data Labeling Analyst

    1 month ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , Washington DC, San Francisco CA and Menlo Park CA** ENGLISH**The main function of a data labeling analyst is to create and manage labeling and change processes...

  • Data Labeling Analyst

    2 weeks ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA*** Chinese***This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic images,...

  • Data Labeling Analyst

    2 weeks ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY ,Washington DC, San Francisco CA and Menlo Park CA**Tagalog***This role may involve potential exposure to graphic and/or objectionable content including but not limited to...

  • Data Labeling Analyst

    2 weeks ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**Thai***This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic...


  • Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**Urdu***This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic images, videos...

  • Data Labeling Analyst

    2 weeks ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**Polish***This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic images,...

  • Data Labeling Analyst

    1 month ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**Polish***This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic...


  • Menlo Park, California, United States Rose International Full time

    About the RoleWe are seeking a highly skilled Data Labeling Specialist to join our team at Rose International. As a Data Labeling Specialist, you will play a critical role in ensuring the accuracy and safety of our AI models.Key ResponsibilitiesCollaborate with our development team to design and execute probing text prompts to test the safety of our Text ->...

  • Data Labeling Analyst

    4 weeks ago


    Menlo Park, United States Rose International Full time

    Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Bellevue WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**Turkish*Please submit candidates with attached pre-screen questions **This role may involve potential exposure to graphic and/or...


  • Menlo Park, California, United States Rose International Full time

    About the RoleWe are seeking a highly skilled Data Labeling Specialist to join our Generative AI Media Safety team at Rose International. As a key member of our team, you will play a critical role in ensuring the accuracy and safety of our AI models.ResponsibilitiesExecute plans to test the safety of our Text -> Image model.Collaborate with the development...

  • Data Labeling Analyst

    4 weeks ago


    Menlo Park, United States Rose International Full time

    •** Bengali**Qualified candidates must be located in one of the following locations due to position being ONSITE: Los Angeles CA, Seattle WA, Redmond WA, Austin TX, New York NY , San Francisco CA and Menlo Park CA**This role may involve potential exposure to graphic and/or objectionable content including but not limited to graphic images,...

  • Data Analyst

    4 weeks ago


    Menlo Park, California, United States Facebook Full time

    The Creative Audio Data Analyst will be responsible for designing, building, and measuring CA data dashboards to assist Creative Audio Leadership in driving strategy, performance and impact through key data insights.Data Analyst Responsibilities: Work as part of a project team to coordinate database development and determine project scope and...

  • Data Analyst

    4 weeks ago


    Menlo Park, United States Facebook Full time

    The Creative Audio Data Analyst will be responsible for designing, building, and measuring CA data dashboards to assist Creative Audio Leadership in driving strategy, performance and impact through key data insights.Data Analyst Responsibilities: Work as part of a project team to coordinate database development and determine project scope and...


  • Menlo Park, United States Meta Full time

    Summary: The Global Partnerships & Content organization at Meta works closely with the leading content creators and media entities in the world to build and grow innovative and meaningful content and community engagement experiences across a variety of product areas. The Strategy & Operations team within the Global Partnerships & Content organization is...


  • Menlo Park, California, United States Latham & Watkins Full time

    About Latham & WatkinsLatham & Watkins is a leading global law firm renowned for its exceptional client service, innovative approach, and commitment to excellence. Our firm's success is built on a foundation of core values: respect, innovation, and collaboration.About the RoleThe Information Governance Senior Analyst plays a critical role in our firm's...


  • Menlo Park, California, United States Latham & Watkins Full time

    About Latham & WatkinsLatham & Watkins is a leading global law firm renowned for its exceptional client service, innovative approach, and commitment to excellence. Our firm's success is built on a foundation of core values: respect, innovation, and collaboration.About the RoleThe Information Governance Senior Analyst is a critical member of Latham & Watkins'...


  • Villa Park, Illinois, United States Sara Lee Frozen Bakery,LLC Full time

    Job OverviewAbout Sara Lee Frozen BakerySara Lee Frozen Bakery is synonymous with exceptional taste and outstanding value in the frozen food sector, catering to both retail and foodservice markets. Our renowned brands, including Sara Lee, Chef Pierre, Van's, Bistro Collection, Superior on Main, and Cyrus O'Leary's, represent a legacy of quality.As we usher...

  • Data Analyst

    1 day ago


    Florham Park, New Jersey, United States Analytic Recruiting Inc. Full time

    About the CompanyLeading regional retail bank seeks an experienced Business Analyst to solve customer, product and marketing related business questions.Key Responsibilities:Translate analysis findings and technical topics, visualize data to explain results to a non-technical business audience and senior management.Identify new data capabilities to enable...

  • Data Analyst

    3 weeks ago


    Overland Park, United States TALENT Software Services Full time

    Are you an experienced Data Analyst with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Analyst to work at their company in Chicago, IL.Primary Responsibilities/Accountabilities:Design and implement reporting solutions, business analysis and data analysis to meet business...