Data Quality Expert for Large Language Models

2 days ago

Sunnyvale, California, United States US Tech Solutions Full time

Job Overview

We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.

About the Role

In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM modeling teams, and ensure that the data produced by expert content creators meets the highest quality standards.

Key Responsibilities

  • Ensure high-quality data during task development: define data requirements based on a deep understanding of the modeling team goals and study of model loss patterns; design detailed instructions for content creator teams, illustrating nuanced differences with clear examples; rapidly iterate with content-production vendors on small batches of data to arrive at desired data quality.
  • Measure and demonstrate data quality during data collection: drive processes to deliver benchmark datasets for assessing data quality; benchmark vendor data quality against competitor models; use quantitative techniques to analyze vendor-produced data to assure high quality and drive rater pool optimization; audit datasets for quality issues and develop tools for accelerating qualitative analysis.
  • Use modeling and experimentation techniques to demonstrate data impact and identify blind spots; communicate on data quality: send out regular reports to project stakeholders on data quality; track key metrics such as iteration time and vendor quality audit results.
  • Author best practices and guideline documents (e.g. guidelines for teams wanting to work with vendors for human data, best practices for instruction design, etc).

Requirements

To succeed in this role, you should have:

  • 3+ years of experience in Technical Writing, Quality Assurance or a related field.
  • Excellent writing and editing skills, with the ability to adapt to different styles and tones.
  • Strong analytical and problem-solving skills.
  • Ability to work independently and as part of a team.

Compensation and Benefits

We offer an estimated salary of $80,000 - $110,000 per year, depending on location and experience. Additionally, we provide a range of benefits, including health insurance, retirement plan, and paid time off.

About US Tech Solutions

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. We are committed to creating a diverse and inclusive workplace culture.

  • Data Quality Expert for Large Language Models

    2 weeks ago

    Sunnyvale, California, United States US Tech Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. As a key member of our team, you will play a critical role in ensuring the highest quality data is produced for our Large Language Model (LLM) projects.The ideal candidate will have a strong understanding of LLM processes, including Pre-training, RLHF,...

  • Data Quality Expert for LLM Modeling Teams

    2 weeks ago

    Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:We are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. The ideal candidate will have a strong understanding of Large Language Models (LLMs) and be able to ensure the highest quality standards in data production.Key Responsibilities:Collaborate with technical modeling teams and vendor leads to understand data...

  • Advanced AI Developer for Large Language Models

    2 weeks ago

    Sunnyvale, California, United States Amazon Full time

    **Job Overview:**We are seeking an experienced Advanced AI Developer to join our Amazon General Intelligence (AGI) team. As a key player in this role, you will be responsible for leading the development of novel algorithms and modeling techniques to advance the state of the art of large model training using cutting-edge hardware like NVIDIA GPUs.Key...

  • Data Science Expert for Retail Innovation

    2 weeks ago

    Sunnyvale, California, United States Walmart Global Tech Full time

    About the RoleWe are seeking a seasoned Data Science expert to join our personalization team at Walmart Global Tech. This is an exceptional opportunity to leverage your expertise in machine learning, computer vision, and data analysis to drive business growth through innovative solutions.The ideal candidate will have a strong background in Computer Science,...

  • Lead Language Expert for Voice-Enabled Technologies

    4 days ago

    Sunnyvale, California, United States Localizationacademy Full time

    Job SummaryWe are seeking a highly skilled Lead Language Expert to join our team at Localizationacademy. The successful candidate will be responsible for developing language components for various voice-enabled technologies and products.About the RoleThis is an exciting opportunity for a Linguist with native or near-native fluency in German to lead data...

  • Data Model Architect

    2 weeks ago

    Sunnyvale, California, United States Walmart Full time

    Company OverviewWe are Walmart, a leading international retailer with over 12,000 stores worldwide. Our mission is to save people money and time.Salary:$150,000 - $200,000 per yearJob DescriptionData Scientist RoleWe are seeking an experienced Data Scientist to lead in the research and development of state-of-the-art generative AI and large language models...

  • Senior AI Software Development Lead for Large Language Models

    2 weeks ago

    Sunnyvale, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior AI Software Development Lead to join our team at Amazon, where you will play a pivotal role in the development of industry-leading multi-modal and multi-lingual Large Language Models (LLMs). As a key member of our team, you will have the opportunity to lead the charge in developing mind-blowing algorithms...

  • Technical Data Expert

    8 hours ago

    Sunnyvale, California, United States Diverse Lynx Full time

    About the Role:Diverse Lynx LLC is seeking an experienced Technical Data Expert to join our team. As a key member of our organization, you will be responsible for working hand-in-hand with data owners to gather, interpret, and visualize data to answer specific questions. Your expertise in building efficient SQL queries and dynamic reports in Tableau and...

  • Data Science Engineer for Large-Scale Machine Learning

    2 weeks ago

    Sunnyvale, California, United States Grid Dynamics Full time

    As a Data Science Engineer at Grid Dynamics, you will play a crucial role in the development of cutting-edge data analytics platforms that handle massive amounts of data. We are seeking an experienced Machine Learning Architect to lead the design and implementation of advanced analytics solutions using bleeding-edge technologies like PRISM, SHAG, and Dark...

  • Data Engineer with GCP: Cloud Computing Expert

    2 weeks ago

    Sunnyvale, California, United States Inficare Full time

    Job Title: Data Engineer with GCP: Cloud Computing ExpertDescriptionWe are seeking a highly skilled Data Engineer to join our team at Inficare in Sunnyvale, CA. As a Senior Data Engineer, you will play a crucial role in designing and developing big data applications using the latest open source technologies.ResponsibilitiesDesign and develop big data...

  • Machine Learning Expert

    2 days ago

    Sunnyvale, California, United States Walmart Full time

    Data Science RoleWe're looking for an experienced Senior Data Scientist to join our Market Intelligence (MINT) team at Walmart Labs. As a key member of our analytics team, you'll be responsible for developing and deploying machine learning models that drive actionable insights for pricing, assortment, and marketing optimization across...

  • Data Transformation Expert

    2 weeks ago

    Sunnyvale, California, United States Walmart Full time

    Job OverviewWe are seeking a skilled Data Transformation Expert to join our team. This role will play a crucial part in shaping the future of retail, improving millions of lives around the world.About UsFifty years ago, Walmart started as a single mom-and-pop shop and transformed into the world's biggest retailer. Our commitment to helping customers save...

  • Large Model Deployment Engineer

    9 hours ago

    Sunnyvale, California, United States Apple Full time

    About the RoleAre you a seasoned Machine Learning Engineer looking to take your career to the next level? Do you have expertise in developing large-scale machine learning models and optimizing them for real-time performance? If so, we'd love to hear from you!In this role, you'll work closely with our cross-functional teams to develop and deploy cutting-edge...

  • Data Science Lead

    2 weeks ago

    Sunnyvale, California, United States CurieTech, Inc. Full time

    CurieTech Inc. Data Science Lead - AI InnovationFull-time position in Sunnyvale, CAWe are seeking an experienced Data Science Lead to join our team and drive innovation in Artificial Intelligence. As a key member of our organization, you will be responsible for designing, developing, and implementing machine learning models and algorithms.This includes...

  • AI Model Optimization Lead

    2 weeks ago

    Sunnyvale, California, United States Apple Full time

    Large Machine Learning Model Optimization EngineerSunnyvale, California, United StatesMachine Learning and AIRole OverviewWe are seeking a highly skilled Large Machine Learning Model Optimization Engineer to join our team. As an applied research and engineering team responsible for developing real-time on-device Language, Computer Vision, and Machine...

  • Data Science Leadership Position

    2 weeks ago

    Sunnyvale, California, United States Walmart Full time

    Job Title: Senior, Data ScientistJob Summary:We are seeking a seasoned data scientist to lead our research and development efforts in generative AI and large language models for e-commerce data. The ideal candidate will have a strong background in machine learning, natural language processing, and advertising domain knowledge, as well as excellent...

  • Predictive Modeling Expert

    8 hours ago

    Sunnyvale, California, United States Saxon Global Full time

    Predictive Modeling Position at Saxon GlobalWe are seeking a skilled Predictive Modeler to join our team in San Francisco. The successful candidate will be responsible for developing and implementing predictive models, analyzing data, and making recommendations.Key Responsibilities:Develop and implement predictive modelsAnalyze data to inform model...

  • AI/ML Data Integrity Expert

    8 hours ago

    Sunnyvale, California, United States US Tech Solutions Full time

    **About Us:** US Tech Solutions is a leading provider of technology services and solutions. We deliver innovative and effective solutions to our clients across various industries.We are seeking an AI/ML Data Integrity Expert to join our team. In this role, you will be responsible for ensuring the integrity and quality of our machine learning models.**Key...

  • Data Analytics Expert

    8 hours ago

    Sunnyvale, California, United States CloudBC Labs Full time

    Job Title: Data Analytics ExpertEstimated Salary: $175,000 - $225,000 per yearAbout the Role:Cognos Developer needed at CloudBC Labs to design analytical solutions and collaborate with technical architecture and infrastructure planning areas. The ideal candidate will have experience with Cognos report development, data modeling, and SQL. Responsibilities...

  • Data Scientist for Machine Learning Solutions

    4 days ago

    Sunnyvale, California, United States Amazon Full time

    About Amazon IndiaAmazon India is a pioneer in using machine learning and big data to create innovative solutions that improve the customer experience, reduce costs, and drive speed and automation. Our team works on practical problems where machine learning systems can make a significant impact.About the RoleWe are seeking an experienced Data Scientist to...