LLM/Prompt Engineering Data Modeler

7 days ago


Sunnyvale, United States US Tech Solutions Full time

Duration: 6 Months Contract


Job Description:

  • The project involves analyzing the results of Human Data in the coding domain.
  • We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.
  • In this role, you will work closely with highly technical modeling teams as well as vendor leads to understand the data needs of the LLM modeling teams. You’ll need a strong ability to comprehend LLM use cases, have a nuanced understanding of good versus great content, and be able to use both quantitative and qualitative techniques to analyze LLM datasets.
  • Write Extract, Transform, and Load (ETL) logic to automate data collection and reporting processes/pipelines, including data quality and monitoring.
  • Build complex and reliable data pipelines in SQL to serve as the backbone for input and output to several ML models. Additionally, deploy SQL workflows in conjunction with Python code.


Responsibilities

  • Work with human data leads and modeling leads to define human data creation instructions, rubric and then evaluate the coding-related data created by humans.
  • Data Analysis, Meetings with Rater pool leads, and Modeling leads, Status reporting.
  • Define data requirements based on a deep understanding of modeling team goals and analysis of model loss patterns.
  • Benchmark vendor data quality against competitor models.
  • Use quantitative techniques to analyze vendor-produced data, ensuring high quality and driving rater pool optimization.
  • Audit datasets for quality issues and develop tools to accelerate qualitative analysis.
  • Apply modeling and experimentation techniques to demonstrate data impact and identify blind spots.
  • Use your knowledge of data processing, technical systems, and project management to enhance our existing data and machine learning platforms for internal use cases.
  • Collaborate with data scientists to drive operational efficiency and make our machine learning data workflows more reliable.


Mandatory:

  • Experience with SQL and Python Coding.
  • Understanding of LLM capabilities and limitations.
  • Understanding of LLM processes like Pre-training, RLHF, SFT, Evals, etc.
  • Experience with training/tuning models, prompt engineering and evaluating LLM outputs is a plus.
  • Experience writing, maintaining, and monitoring both streaming and batch ETLs operating on a variety of structured and unstructured sources.
  • Familiarity with Machine Learning libraries (such as TensorFlow, Scikit-learn, Keras) or exploratory/statistical analysis using Python, R.
  • Experience in software development life cycle.
  • Experience with ML / AI is a plus.
  • Prompt engineering & Writing prompts for GenAI is a plus.
  • Advanced ability to write English prose.


Education:

  • Bachelor’s or higher in CS or related field.




About US Tech Solutions:

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.


US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.


Recruiter Details:

Name: Devesh

Email: devesh@ustechsolutionsinc.com

Internal Id: 24-28153



  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 Months Contract Job Description:The project involves analyzing the results of Human Data in the coding domain.We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.In this role, you will work closely with highly technical...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 Months Contract Job Description:The project involves analyzing the results of Human Data in the coding domain.We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.In this role, you will work closely with highly technical...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job Title: Data Modeler EngineerWe are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project involves analyzing the results of Human Data in the coding domain.Work closely with technical modeling teams and vendor leads...

  • LLM Prompt Writer

    3 weeks ago


    Sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The primary focus is on enhancing customer prompt rewrites and contributing to tasks that drive improvements in generative AI models.These roles are essential for advancing the quality and functionality of content outputs for client's cross-functional projects, including those linked to AI-driven platforms....


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job Overview:We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project involves analyzing the results of Human Data in the coding domain.Work closely with technical modeling teams and vendor leads to understand data...

  • Prompt Engineer

    3 days ago


    Sunnyvale, United States Synergis Full time

    TITLE: Prompt EngineerLOCATION: Sunnyvale, CAANTICIPATED DURATION: 6 monthsResponsibilities:For evals, perform SxS comparisons using a predefined rubric for text, chat, factuality, multimodal, and safety.For content creation, create new data for use in eval sets or training from seed data, inspirational examples, or guidelines.Create content through model...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:We are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. The ideal candidate will have a strong understanding of Large Language Models (LLMs) and be able to ensure the highest quality standards in data production.Key Responsibilities:Collaborate with technical modeling teams and vendor leads to understand data...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The primary focus is on enhancing customer prompt rewrites and contributing to tasks that drive improvements in generative AI models.These roles are essential for advancing the quality and functionality of content outputs for client's cross-functional projects, including those linked to AI-driven platforms....


  • Sunnyvale, California, United States US Tech Solutions Full time

    About US Tech Solutions:We are a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions.Job Description:We are looking for a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The client is hiring Data Engineers with experience in data quality and model training. The role involves processing data for machine learning models, writing custom scripts, building automation tools, and assessing the effectiveness of data through quality checks. Responsibilities:Data Quality & Processing:...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:US Tech Solutions is seeking a skilled Data Quality Expert to join our team in providing high-quality human-created data for Large Language Models (LLMs). The successful candidate will have a strong understanding of LLM processes and be able to ensure that the data meets the highest quality standards.Key Responsibilities:Collaborate with...


  • Sunnyvale, United States Bosch Group Inc Full time

    Job Description Conduct research on Natural Language Processing (NLP), Large Language Model (LLM) and Foundation Models to address academic and industrial challenges in AI fields. Collaborate with mentors and other colleagues to integrate the developed methods into prototype systems for Bosch applications such as AI agents, information retrieval, question...


  • Sunnyvale, California, United States Bosch Group Inc Full time

    Job Title: NLP Language Model Development SpecialistThis role is an exciting opportunity to contribute to the development of cutting-edge natural language processing (NLP) and large language model technologies at Bosch Group Inc. The successful candidate will have the chance to work on various research projects, collaborating with experienced mentors and...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job OverviewWe are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.About the RoleIn this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM modeling teams, and...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. As a key member of our team, you will play a critical role in ensuring the highest quality data is produced for our Large Language Model (LLM) projects.The ideal candidate will have a strong understanding of LLM processes, including Pre-training, RLHF,...


  • sunnyvale, United States Insight Global Full time

    About Team:The team works closely with our clients US stores and eCommerce business to better serve customers by empowering team members, stores, and merchants with technological innovation. From groceries and entertainment to sporting goods and crafts this team offers an extensive selection that our customers value, whether they shop online, through one of...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The client is hiring Data Engineers with experience in data quality and model training. The role involves processing data for machine learning models, writing custom scripts, building automation tools, and assessing the effectiveness of data through quality checks. Responsibilities:Data Quality & Processing:...