AI Multimedia Generation Product Evaluator

6 days ago

Menlo Park, California, United States EPITEC Full time $80,000 - $96,000 per year

Job Title:
AI Multimedia Generation Product Evaluator

Contract Duration:
3 months, possible extension

Location:
Menlo Park, CA

Work Arrangement:
Remote

Pay Range:
$65-70/hour w/ 3 weeks of PTO and medical and dental insurance contributions

***Note:
No C2C or C2H arrangements possible for this role

Summary

We are seeking a highly motivated and detail-oriented individual to join our team as an AI Multimedia Generation Product Evaluator. In this role, you will support the evaluation of various AI multimedia generation products for images and videos. You will work closely with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement.

Responsibilities

  • Set up Halo tasks and run model inference
  • Enqueue new queues to Halo
  • Audit annotations from vendors
  • Build necessary tooling for managing evaluation datasets
  • Collaborate with model development teams to conduct offline evaluations and automate pipelines
  • Facilitate, set up queues, manage image radio data, and audit results
  • Ensure consistency and accuracy in measurements, involving programming and auditing tasks

Requirements

  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain
  • Ability to adapt to new code
  • General know-how
  • Flexibility in working hours
  • Nice-to-Have Skills:
  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge

Degrees/Certifications

  • Bachelor's preferred, not required

Must Have Skills

  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain

Nice to Have Skills

  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge

  • Quantitative AI UXR Lead

    6 days ago

    Menlo Park, California, United States Meta Full time $192,310 - $265,000 per year

    MRS (Modern Recommendation System) provides centralized models and technologies that Facebook Video, Facebook Feed, Instagram, and Threads use to make their ranking and recommendations better. Moving forward, we aim to evolve this technology and significantly improve what content is recommended to users via an AI first strategy to build AI inspired, AI...

  • AI Specialist

    4 days ago

    Menlo Park, California, United States Meta Full time $120,000 - $180,000 per year

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • AI Specialist

    1 day ago

    Menlo Park, California, United States Meta Full time $120,000 - $250,000 per year

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Associate Director/Director, AI Engineering

    6 days ago

    Menlo Park, California, United States BillionToOne Full time $200,000 - $441,802 per year

    Ready to redefine what's possible in molecular diagnostics?Join a team of brilliant, passionate innovators who wake up every day determined to transform healthcare. At BillionToOne, we've built something extraordinary—a culture where transparency fuels trust, collaboration drives breakthroughs, and every voice matters in our mission to make life-changing...

  • AI Specialist

    6 days ago

    Menlo Park, California, United States Meta Full time $120,000 - $180,000 per year

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Project Manager, Product Data Operations

    5 days ago

    Menlo Park, California, United States Meta Full time $143,000 - $202,000 per year

    This role is compelling due to its central role in driving the company's AI transformation, offering a unique opportunity to work on cutting-edge projects like integrating AI into operations and developing Synthetic Data as a Service. It provides a chance to directly influence the future of AI at Meta by designing AI-native labeling workflows and...

  • Staff Engineer: AI

    6 days ago

    Menlo Park, California, United States Pylon Full time $200,000 - $250,000 per year

    At Pylon, we're a small team building a very ambitious product in the mortgage space.At this early stage, we're looking for an engineer who can see the opportunity of what we're building towards and wants to have a hand in building it.We're in search of someone who finds difficult problems invigorating and fits well into a high-performing team built on...

  • Network Production Engineer

    4 days ago

    Menlo Park, California, United States Meta Full time $120,000 - $250,000 per year

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Product Manager, Cortex

    4 days ago

    Menlo Park, California, United States Robinhood Full time $191,000 - $225,000

    Join us in building the future of finance.Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you're ready to be at the epicenter of this historic cultural and financial shift, keep reading.About the team +...

  • Senior Product Manager

    5 days ago

    Menlo Park, California, United States Snowflake Full time $195,000 - $287,500 per year

    Snowflake is about empowering enterprises to achieve their full potential — and people too. With a culture that's all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology — and careers — to the next level.Come join us to play a leading role in Enterprise AI evolutionSnowflake...