Large Language Model Data Analyst
18 hours ago
Job Overview:
We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.
About the Role:
- The project involves analyzing the results of Human Data in the coding domain.
- Work closely with technical modeling teams and vendor leads to understand data needs.
- Analyze LLM use cases, comprehend good versus great content, and use quantitative and qualitative techniques to analyze datasets.
- Write ETL logic to automate data collection and reporting processes/pipelines, including data quality and monitoring.
- Build complex and reliable data pipelines in SQL to serve as the backbone for input and output to several ML models.
Responsibilities:
- Define human data creation instructions, rubric, and evaluate coding-related data created by humans.
- Perform data analysis, meetings with rater pool leads, and modeling leads, status reporting.
- Benchmark vendor data quality against competitor models.
- Use quantitative techniques to analyze vendor-produced data, ensuring high quality and driving rater pool optimization.
- Audit datasets for quality issues and develop tools to accelerate qualitative analysis.
- Apply modeling and experimentation techniques to demonstrate data impact and identify blind spots.
- Collaborate with data scientists to drive operational efficiency and make machine learning data workflows more reliable.
Requirements:
- Experience with SQL and Python Coding.
- Understanding of LLM capabilities and limitations.
- Experience with training/tuning models, prompt engineering, and evaluating LLM outputs is a plus.
- Experience writing, maintaining, and monitoring both streaming and batch ETLs operating on a variety of structured and unstructured sources.
- Familiarity with Machine Learning libraries or exploratory/statistical analysis using Python, R.
- Experience in software development life cycle.
- Prompt engineering & Writing prompts for GenAI is a plus.
- Advanced ability to write English prose.
Education: Bachelor's or higher in CS or related field.
-
Sunnyvale, California, United States US Tech Solutions Full timeJob OverviewWe are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.About the RoleIn this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM modeling teams, and...
-
Data Quality Expert for Large Language Models
3 hours ago
Sunnyvale, California, United States US Tech Solutions Full timeAbout the Role:US Tech Solutions is seeking a skilled Data Quality Expert to join our team in providing high-quality human-created data for Large Language Models (LLMs). The successful candidate will have a strong understanding of LLM processes and be able to ensure that the data meets the highest quality standards.Key Responsibilities:Collaborate with...
-
Data Quality Expert for Large Language Models
2 weeks ago
Sunnyvale, California, United States US Tech Solutions Full timeJob DescriptionWe are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. As a key member of our team, you will play a critical role in ensuring the highest quality data is produced for our Large Language Model (LLM) projects.The ideal candidate will have a strong understanding of LLM processes, including Pre-training, RLHF,...
-
Advanced AI Developer for Large Language Models
2 weeks ago
Sunnyvale, California, United States Amazon Full time**Job Overview:**We are seeking an experienced Advanced AI Developer to join our Amazon General Intelligence (AGI) team. As a key player in this role, you will be responsible for leading the development of novel algorithms and modeling techniques to advance the state of the art of large model training using cutting-edge hardware like NVIDIA GPUs.Key...
-
Data Model Architect
2 weeks ago
Sunnyvale, California, United States Walmart Full timeCompany OverviewWe are Walmart, a leading international retailer with over 12,000 stores worldwide. Our mission is to save people money and time.Salary:$150,000 - $200,000 per yearJob DescriptionData Scientist RoleWe are seeking an experienced Data Scientist to lead in the research and development of state-of-the-art generative AI and large language models...
-
Sunnyvale, California, United States Amazon Full timeAbout the RoleWe are seeking a highly skilled Senior AI Software Development Lead to join our team at Amazon, where you will play a pivotal role in the development of industry-leading multi-modal and multi-lingual Large Language Models (LLMs). As a key member of our team, you will have the opportunity to lead the charge in developing mind-blowing algorithms...
-
Senior Data Analyst Lead
1 day ago
Sunnyvale, California, United States LinkedIn Full timeWe are seeking a Senior Data Analyst Lead to join our team at LinkedIn. As a key member of our data science team, you will be responsible for developing and delivering data-driven insights to drive business growth. This role offers a hybrid work option, allowing you to balance home and office work depending on your team's needs.About the Job:Develop and...
-
Data Analyst for Life Sciences
14 hours ago
Sunnyvale, California, United States Willow Biosciences Full timeAbout the PositionWe are seeking a Data Analyst for Life Sciences to join our team at Willow Biosciences. As a key member of our research group, you will be responsible for analyzing and visualizing large amounts of biological data, collaborating with scientists to develop new tools and applications, and providing technical support to our...
-
Lead Data Insights Analyst
2 weeks ago
Sunnyvale, California, United States Walmart, Inc. Full timeAbout This Role:">We are seeking a highly skilled Lead Data Insights Analyst to join our team at Walmart, Inc. As a key member of our analytics team, you will be responsible for analyzing complex business problems and developing recommendations to improve operational efficiency and reduce costs.">Key Responsibilities:">">Analyze large datasets to identify...
-
Sunnyvale, California, United States Grid Dynamics Full timeAs a Data Science Engineer at Grid Dynamics, you will play a crucial role in the development of cutting-edge data analytics platforms that handle massive amounts of data. We are seeking an experienced Machine Learning Architect to lead the design and implementation of advanced analytics solutions using bleeding-edge technologies like PRISM, SHAG, and Dark...
-
Data Quality Expert for LLM Modeling Teams
2 weeks ago
Sunnyvale, California, United States US Tech Solutions Full timeAbout the Role:We are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. The ideal candidate will have a strong understanding of Large Language Models (LLMs) and be able to ensure the highest quality standards in data production.Key Responsibilities:Collaborate with technical modeling teams and vendor leads to understand data...
-
Large Model Deployment Engineer
1 day ago
Sunnyvale, California, United States Apple Full timeAbout the RoleAre you a seasoned Machine Learning Engineer looking to take your career to the next level? Do you have expertise in developing large-scale machine learning models and optimizing them for real-time performance? If so, we'd love to hear from you!In this role, you'll work closely with our cross-functional teams to develop and deploy cutting-edge...
-
Senior LLM Data Specialist
17 hours ago
Sunnyvale, California, United States US Tech Solutions Full timeAbout US Tech Solutions:We are a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions.Job Description:We are looking for a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project...
-
Data Analyst
2 weeks ago
Sunnyvale, California, United States Diverse Lynx Full timeData Science Role at Diverse LynxKey responsibilities include:Machine Learning• Experience with regression, classification, neural networks, and Natural Language Processing (NLP) for actionable insights and data-driven decision making.Natural Language Processing (NLP)• Extensive experience with Spacy, NLTK, flair, and sklearn-crfsuite libraries for...
-
Data Science Leadership Position
2 weeks ago
Sunnyvale, California, United States Walmart Full timeJob Title: Senior, Data ScientistJob Summary:We are seeking a seasoned data scientist to lead our research and development efforts in generative AI and large language models for e-commerce data. The ideal candidate will have a strong background in machine learning, natural language processing, and advertising domain knowledge, as well as excellent...
-
AI Model Optimization Lead
2 weeks ago
Sunnyvale, California, United States Apple Full timeLarge Machine Learning Model Optimization EngineerSunnyvale, California, United StatesMachine Learning and AIRole OverviewWe are seeking a highly skilled Large Machine Learning Model Optimization Engineer to join our team. As an applied research and engineering team responsible for developing real-time on-device Language, Computer Vision, and Machine...
-
Data Science Lead
3 weeks ago
Sunnyvale, California, United States CurieTech, Inc. Full timeCurieTech Inc. Data Science Lead - AI InnovationFull-time position in Sunnyvale, CAWe are seeking an experienced Data Science Lead to join our team and drive innovation in Artificial Intelligence. As a key member of our organization, you will be responsible for designing, developing, and implementing machine learning models and algorithms.This includes...
-
Data Science Expert for Retail Innovation
3 weeks ago
Sunnyvale, California, United States Walmart Global Tech Full timeAbout the RoleWe are seeking a seasoned Data Science expert to join our personalization team at Walmart Global Tech. This is an exceptional opportunity to leverage your expertise in machine learning, computer vision, and data analysis to drive business growth through innovative solutions.The ideal candidate will have a strong background in Computer Science,...
-
Data Insights Strategist
17 hours ago
Sunnyvale, California, United States LinkedIn Full timeAs a Business Intelligence Analyst at LinkedIn, you will play a critical role in driving business decisions through data-driven insights. You will work closely with cross-functional teams to identify business opportunities and develop algorithms and methodologies to address them. In addition, you will analyze large-scale structured and unstructured data to...
-
Supply Chain Business Analyst
2 weeks ago
Sunnyvale, California, United States The Select Group Full timeJob Title: Supply Chain Business Analyst - Data Validation ExpertJob Summary: We are seeking a highly skilled Supply Chain Business Analyst to join our team. As a key member of our organization, you will be responsible for validating vendor component quote data across all of our clients' vendors, ensuring our clients receive the best price for their warranty...