Large Language Model Data Analyst

18 hours ago


Sunnyvale, California, United States US Tech Solutions Full time

Job Overview:

We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.

About the Role:

  • The project involves analyzing the results of Human Data in the coding domain.
  • Work closely with technical modeling teams and vendor leads to understand data needs.
  • Analyze LLM use cases, comprehend good versus great content, and use quantitative and qualitative techniques to analyze datasets.
  • Write ETL logic to automate data collection and reporting processes/pipelines, including data quality and monitoring.
  • Build complex and reliable data pipelines in SQL to serve as the backbone for input and output to several ML models.

Responsibilities:

  • Define human data creation instructions, rubric, and evaluate coding-related data created by humans.
  • Perform data analysis, meetings with rater pool leads, and modeling leads, status reporting.
  • Benchmark vendor data quality against competitor models.
  • Use quantitative techniques to analyze vendor-produced data, ensuring high quality and driving rater pool optimization.
  • Audit datasets for quality issues and develop tools to accelerate qualitative analysis.
  • Apply modeling and experimentation techniques to demonstrate data impact and identify blind spots.
  • Collaborate with data scientists to drive operational efficiency and make machine learning data workflows more reliable.

Requirements:

  • Experience with SQL and Python Coding.
  • Understanding of LLM capabilities and limitations.
  • Experience with training/tuning models, prompt engineering, and evaluating LLM outputs is a plus.
  • Experience writing, maintaining, and monitoring both streaming and batch ETLs operating on a variety of structured and unstructured sources.
  • Familiarity with Machine Learning libraries or exploratory/statistical analysis using Python, R.
  • Experience in software development life cycle.
  • Prompt engineering & Writing prompts for GenAI is a plus.
  • Advanced ability to write English prose.

Education: Bachelor's or higher in CS or related field.



  • Sunnyvale, California, United States US Tech Solutions Full time

    Job OverviewWe are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.About the RoleIn this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM modeling teams, and...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:US Tech Solutions is seeking a skilled Data Quality Expert to join our team in providing high-quality human-created data for Large Language Models (LLMs). The successful candidate will have a strong understanding of LLM processes and be able to ensure that the data meets the highest quality standards.Key Responsibilities:Collaborate with...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. As a key member of our team, you will play a critical role in ensuring the highest quality data is produced for our Large Language Model (LLM) projects.The ideal candidate will have a strong understanding of LLM processes, including Pre-training, RLHF,...


  • Sunnyvale, California, United States Amazon Full time

    **Job Overview:**We are seeking an experienced Advanced AI Developer to join our Amazon General Intelligence (AGI) team. As a key player in this role, you will be responsible for leading the development of novel algorithms and modeling techniques to advance the state of the art of large model training using cutting-edge hardware like NVIDIA GPUs.Key...

  • Data Model Architect

    2 weeks ago


    Sunnyvale, California, United States Walmart Full time

    Company OverviewWe are Walmart, a leading international retailer with over 12,000 stores worldwide. Our mission is to save people money and time.Salary:$150,000 - $200,000 per yearJob DescriptionData Scientist RoleWe are seeking an experienced Data Scientist to lead in the research and development of state-of-the-art generative AI and large language models...


  • Sunnyvale, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior AI Software Development Lead to join our team at Amazon, where you will play a pivotal role in the development of industry-leading multi-modal and multi-lingual Large Language Models (LLMs). As a key member of our team, you will have the opportunity to lead the charge in developing mind-blowing algorithms...


  • Sunnyvale, California, United States LinkedIn Full time

    We are seeking a Senior Data Analyst Lead to join our team at LinkedIn. As a key member of our data science team, you will be responsible for developing and delivering data-driven insights to drive business growth. This role offers a hybrid work option, allowing you to balance home and office work depending on your team's needs.About the Job:Develop and...


  • Sunnyvale, California, United States Willow Biosciences Full time

    About the PositionWe are seeking a Data Analyst for Life Sciences to join our team at Willow Biosciences. As a key member of our research group, you will be responsible for analyzing and visualizing large amounts of biological data, collaborating with scientists to develop new tools and applications, and providing technical support to our...


  • Sunnyvale, California, United States Walmart, Inc. Full time

    About This Role:">We are seeking a highly skilled Lead Data Insights Analyst to join our team at Walmart, Inc. As a key member of our analytics team, you will be responsible for analyzing complex business problems and developing recommendations to improve operational efficiency and reduce costs.">Key Responsibilities:">">Analyze large datasets to identify...


  • Sunnyvale, California, United States Grid Dynamics Full time

    As a Data Science Engineer at Grid Dynamics, you will play a crucial role in the development of cutting-edge data analytics platforms that handle massive amounts of data. We are seeking an experienced Machine Learning Architect to lead the design and implementation of advanced analytics solutions using bleeding-edge technologies like PRISM, SHAG, and Dark...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:We are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. The ideal candidate will have a strong understanding of Large Language Models (LLMs) and be able to ensure the highest quality standards in data production.Key Responsibilities:Collaborate with technical modeling teams and vendor leads to understand data...


  • Sunnyvale, California, United States Apple Full time

    About the RoleAre you a seasoned Machine Learning Engineer looking to take your career to the next level? Do you have expertise in developing large-scale machine learning models and optimizing them for real-time performance? If so, we'd love to hear from you!In this role, you'll work closely with our cross-functional teams to develop and deploy cutting-edge...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About US Tech Solutions:We are a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions.Job Description:We are looking for a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project...

  • Data Analyst

    2 weeks ago


    Sunnyvale, California, United States Diverse Lynx Full time

    Data Science Role at Diverse LynxKey responsibilities include:Machine Learning• Experience with regression, classification, neural networks, and Natural Language Processing (NLP) for actionable insights and data-driven decision making.Natural Language Processing (NLP)• Extensive experience with Spacy, NLTK, flair, and sklearn-crfsuite libraries for...


  • Sunnyvale, California, United States Walmart Full time

    Job Title: Senior, Data ScientistJob Summary:We are seeking a seasoned data scientist to lead our research and development efforts in generative AI and large language models for e-commerce data. The ideal candidate will have a strong background in machine learning, natural language processing, and advertising domain knowledge, as well as excellent...


  • Sunnyvale, California, United States Apple Full time

    Large Machine Learning Model Optimization EngineerSunnyvale, California, United StatesMachine Learning and AIRole OverviewWe are seeking a highly skilled Large Machine Learning Model Optimization Engineer to join our team. As an applied research and engineering team responsible for developing real-time on-device Language, Computer Vision, and Machine...

  • Data Science Lead

    3 weeks ago


    Sunnyvale, California, United States CurieTech, Inc. Full time

    CurieTech Inc. Data Science Lead - AI InnovationFull-time position in Sunnyvale, CAWe are seeking an experienced Data Science Lead to join our team and drive innovation in Artificial Intelligence. As a key member of our organization, you will be responsible for designing, developing, and implementing machine learning models and algorithms.This includes...


  • Sunnyvale, California, United States Walmart Global Tech Full time

    About the RoleWe are seeking a seasoned Data Science expert to join our personalization team at Walmart Global Tech. This is an exceptional opportunity to leverage your expertise in machine learning, computer vision, and data analysis to drive business growth through innovative solutions.The ideal candidate will have a strong background in Computer Science,...


  • Sunnyvale, California, United States LinkedIn Full time

    As a Business Intelligence Analyst at LinkedIn, you will play a critical role in driving business decisions through data-driven insights. You will work closely with cross-functional teams to identify business opportunities and develop algorithms and methodologies to address them. In addition, you will analyze large-scale structured and unstructured data to...


  • Sunnyvale, California, United States The Select Group Full time

    Job Title: Supply Chain Business Analyst - Data Validation ExpertJob Summary: We are seeking a highly skilled Supply Chain Business Analyst to join our team. As a key member of our organization, you will be responsible for validating vendor component quote data across all of our clients' vendors, ensuring our clients receive the best price for their warranty...