US Tech Solutions | LLM/Prompt Engineering Data Modeler

6 days ago


sunnyvale, United States US Tech Solutions Full time

Duration: 6 Months Contract


Job Description:

  • The project involves analyzing the results of Human Data in the coding domain.
  • We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.
  • In this role, you will work closely with highly technical modeling teams as well as vendor leads to understand the data needs of the LLM modeling teams. You’ll need a strong ability to comprehend LLM use cases, have a nuanced understanding of good versus great content, and be able to use both quantitative and qualitative techniques to analyze LLM datasets.
  • Write Extract, Transform, and Load (ETL) logic to automate data collection and reporting processes/pipelines, including data quality and monitoring.
  • Build complex and reliable data pipelines in SQL to serve as the backbone for input and output to several ML models. Additionally, deploy SQL workflows in conjunction with Python code.


Responsibilities

  • Work with human data leads and modeling leads to define human data creation instructions, rubric and then evaluate the coding-related data created by humans.
  • Data Analysis, Meetings with Rater pool leads, and Modeling leads, Status reporting.
  • Define data requirements based on a deep understanding of modeling team goals and analysis of model loss patterns.
  • Benchmark vendor data quality against competitor models.
  • Use quantitative techniques to analyze vendor-produced data, ensuring high quality and driving rater pool optimization.
  • Audit datasets for quality issues and develop tools to accelerate qualitative analysis.
  • Apply modeling and experimentation techniques to demonstrate data impact and identify blind spots.
  • Use your knowledge of data processing, technical systems, and project management to enhance our existing data and machine learning platforms for internal use cases.
  • Collaborate with data scientists to drive operational efficiency and make our machine learning data workflows more reliable.


Mandatory:

  • Experience with SQL and Python Coding.
  • Understanding of LLM capabilities and limitations.
  • Understanding of LLM processes like Pre-training, RLHF, SFT, Evals, etc.
  • Experience with training/tuning models, prompt engineering and evaluating LLM outputs is a plus.
  • Experience writing, maintaining, and monitoring both streaming and batch ETLs operating on a variety of structured and unstructured sources.
  • Familiarity with Machine Learning libraries (such as TensorFlow, Scikit-learn, Keras) or exploratory/statistical analysis using Python, R.
  • Experience in software development life cycle.
  • Experience with ML / AI is a plus.
  • Prompt engineering & Writing prompts for GenAI is a plus.
  • Advanced ability to write English prose.


Education:

  • Bachelor’s or higher in CS or related field.




About US Tech Solutions:

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.


US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.


Recruiter Details:

Name: Devesh

Email: devesh@ustechsolutionsinc.com

Internal Id: 24-28153



  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 Months Contract Job Description:The project involves analyzing the results of Human Data in the coding domain.We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.In this role, you will work closely with highly technical...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 6 Months Contract Job Description:The project involves analyzing the results of Human Data in the coding domain.We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.In this role, you will work closely with highly technical...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The primary focus is on enhancing customer prompt rewrites and contributing to tasks that drive improvements in generative AI models.These roles are essential for advancing the quality and functionality of content outputs for client's cross-functional projects, including those linked to AI-driven platforms....

  • LLM Prompt Writer

    3 weeks ago


    Sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The primary focus is on enhancing customer prompt rewrites and contributing to tasks that drive improvements in generative AI models.These roles are essential for advancing the quality and functionality of content outputs for client's cross-functional projects, including those linked to AI-driven platforms....


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job Title: Data Modeler EngineerWe are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project involves analyzing the results of Human Data in the coding domain.Work closely with technical modeling teams and vendor leads...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The client is hiring Data Engineers with experience in data quality and model training. The role involves processing data for machine learning models, writing custom scripts, building automation tools, and assessing the effectiveness of data through quality checks. Responsibilities:Data Quality & Processing:...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:We are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. The ideal candidate will have a strong understanding of Large Language Models (LLMs) and be able to ensure the highest quality standards in data production.Key Responsibilities:Collaborate with technical modeling teams and vendor leads to understand data...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:We are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.In this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About US Tech Solutions:We are a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions.Job Description:We are looking for a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job Overview:We are seeking a highly skilled Data Modeling Engineer with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-Created Data.About the Role:The project involves analyzing the results of Human Data in the coding domain.Work closely with technical modeling teams and vendor leads to understand data...


  • Sunnyvale, United States US Tech Solutions Full time

    Duration: 6 months contract Job Description:The client is hiring Data Engineers with experience in data quality and model training. The role involves processing data for machine learning models, writing custom scripts, building automation tools, and assessing the effectiveness of data through quality checks. Responsibilities:Data Quality & Processing:...


  • Sunnyvale, California, United States US Tech Solutions Full time

    About the Role:US Tech Solutions is seeking a skilled Data Quality Expert to join our team in providing high-quality human-created data for Large Language Models (LLMs). The successful candidate will have a strong understanding of LLM processes and be able to ensure that the data meets the highest quality standards.Key Responsibilities:Collaborate with...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Quality Expert to join our team at US Tech Solutions. As a key member of our team, you will play a critical role in ensuring the highest quality data is produced for our Large Language Model (LLM) projects.The ideal candidate will have a strong understanding of LLM processes, including Pre-training, RLHF,...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job OverviewWe are seeking a highly skilled data quality expert with a strong understanding of Large Language Models (LLMs) to join our team as a Quality Analyst for Human-created Data.About the RoleIn this role, you will liaise closely with the highly technical modeling teams as well as vendor leads, understand the data needs of LLM modeling teams, and...


  • Sunnyvale, California, United States US Tech Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Quality Engineer to join our team at US Tech Solutions. This is a 6-month contract position.The successful candidate will have experience in data quality and model training, with proficiency in Python and knowledge of tools like Jupyter Notebooks.Data Quality & Processing: Ensure high-quality data for...

  • Prompt Engineer

    3 days ago


    Sunnyvale, United States Synergis Full time

    TITLE: Prompt EngineerLOCATION: Sunnyvale, CAANTICIPATED DURATION: 6 monthsResponsibilities:For evals, perform SxS comparisons using a predefined rubric for text, chat, factuality, multimodal, and safety.For content creation, create new data for use in eval sets or training from seed data, inspirational examples, or guidelines.Create content through model...


  • Sunnyvale, California, United States US Tech Solutions Full time

    **Job Title:** Data Quality EngineerWe are seeking a highly skilled Data Quality Engineer to join our team at US Tech Solutions. As a Data Quality Engineer, you will be responsible for ensuring the accuracy and reliability of our machine learning models.**Responsibilities:Data Quality & Processing: Guarantee that data is clean, formatted correctly, and meets...


  • sunnyvale, United States US Tech Solutions Full time

    Duration: 5 Months ContractJob Description:You will be responsible for policy compliance checks on publisher sites.Work directly with other members of your team to remediate complex abuse issues.Enhance our operational workflows via process improvements.Responsibilities:Perform policy compliance checks on publisher sites.Leverage SQL to extract data and...