Principal Machine Learning Engineer, Content Safety and ML Fairness

1 month ago


Santa Clara CA, United States NVIDIA Corporation Full time

Principal Machine Learning Engineer, Content Safety and ML Fairness page is loaded Principal Machine Learning Engineer, Content Safety and ML Fairness
Apply locations US, CA, Santa Clara time type Full time posted on Posted 3 Days Ago job requisition id JR1978571 NVIDIA is seeking a Principle Machine Learning Engineer to lead our Content Safety & ML Fairness efforts for LLMs across all of our Research and Production Engineering teams, and to coordinate with Legal, Policy, Ethics and Security. Content Safety & ML Fairness are essential to the responsible development and deploying Large Language Models (LLMs). NVIDIA is in a unique position: we are developing AI-based products across multiple domains, and we collaborate with many exciting AI companies as partners and customers.
In this role, you’ll work with the teams who are developing Large Language Models (LLMs) aka Generative AI for text. Our LLMs are a growing area of AI products including models and services, and we are committed to ensuring that they are used safely and responsibly. This key position will ensure the highest content safety possible by reducing exposure to inappropriate material, preventing bias and discrimination which is essential to protect both individual rights and to achieve the best quality of results including accuracy and completeness of information. By prioritizing safety and fairness, we can ensure that LLMs benefit everyone and contribute to a better future for all.
What you'll be doing:
Craft, orchestrate and realize the Content Safety & ML Fairness vision, mission, strategy, work and delivery across multi-functional teams.
Conduct technical review of existing methods and emerging approaches from academia and industry, and be our expert on what we can purchase or open source vs building. Including staying up-to-date with the latest research and advancements in Content Safety and ML Fairness.
Research and implement innovative techniques for bias detection and mitigation in LLMs and systems using LLMs like RAGs.
Follow, connect and guide the work across Foundation, Alignment and PEFT modeling and evaluation work, as well as pre-and-post Inference-time guardrails, dataset assessment, and model evaluation tools. Define one technical roadmap for these teams. Ensure the problems are solved in the most appropriate place in a sophisticated landscape of models derived from other models.
Define the datasets and modeling techniques, classification and evaluation strategy for designing, training and evaluating models and end-to-end systems for Content Safety and ML Fairness. Including a mix of LLM, Supervised learning, and other approaches. Ensure high quality execution, review, and (where applicable) threshold of models.
Define and supervise key metrics for responsible LLM behavior and usage.
Follow the best MLOps practices of automation, monitoring, scale, safety, fairness.
Develop a unified MLOps methodology that ML teams can follow to be highly productive and deliver safe and fair AI products.
Contribute to the MLOps platform and develop safety and fairness tools to help ML teams be more effective.
Champion standard methodologies for responsible LLM development and deployment across the company and our partners.
Collaborate with other engineers, data scientists, and researchers to develop and implement solutions to content safety and ML fairness challenges.
What we need to see:
~ You have a Master’s or PhD in Computer Architecture, Computer Science, Electrical Engineering or related field or equivalent experience.
~ Strong understanding of machine learning principles and algorithms.
~8+ years of Work Experience in developing and deploying machine learning models in production.
~ Collaborated with multiple teams to bring research into enterprise, developer or consumer products.
~ Ability to lead technical projects from problem to solution.
~ Experience with two or more of the following broader areas for 5+ years: ML Fairness, Content Safety, Deliberative Misinformation, Robustness, Security, or related areas.
~ Experience with one or more of the following areas within Content Safety: Hate/Harassment, Sexualized, Harmful/Violent, or other specific areas from your application.
~ Background with ML Fairness/De-biasing: de-biasing of models at training, de-biasing of results at inference, fairness metrics and bias detection techniques.
~ Experience with explainable AI (XAI) techniques, and large datasets.

Ways to stand out from the crowd:
Have more than the minimum experience required within the Content Safety and ML Fairness areas listed above
Experience with Robustness including Hallucinations, Digressions, Generative Misinformation.
Background with GenAI Security including Prompt Stability, Model Extraction, Confidentiality/Data Extraction, Integrity, Availability and Adversarial Robustness.
Experience with legal and regulatory compliance.
Experience with leadership in Content Safety and/or ML Fairness across large organizations with multiple teams/groups, with a consistent record of extensive indirect influence.
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working with us and our engineering teams are growing fast in some of the hottest pioneering fields: Deep Learning, Artificial Intelligence, and Large Language Models. If you're a creative engineer with a real passion for robust and enjoyable user experiences, we want to hear from you
The base salary range is 268,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Similar Jobs (5)
Senior AI and Machine Learning Engineer
locations 2 Locations time type Full time posted on Posted 16 Days Ago Machine Learning Engineer, AI for Gaming
locations US, CA, Santa Clara time type Full time posted on Posted 7 Days Ago Senior Prediction and Planning Machine Learning Engineer - Autonomous Vehicles
locations 3 Locations time type Full time posted on Posted 2 Days Ago NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and the metaverse is transforming the world's largest industries and profoundly impacting society.
#J-18808-Ljbffr



  • Mountain View, CA, United States Inworld AI Full time

    view open rolesWhy Join InworldInworld is the best-funded startup in AI and games with a $500 million valuation and backing from top tier investors like Intel, Microsoft, Lightspeed, Bitkraft, Founders Fund, Kleiner Perkins, and more. Inworld was recognized by CB Insights as one of the 100 most promising AI companies in the world and was nominated alongside...


  • Santa Clara, California, United States Palo Alto Networks Full time

    Job Description Your Career You will have the opportunity to build a career solving network security challenges leveraging advanced machine learning techniques on exabytes of data. You will help create and deliver the most advanced AI and Machine Learning enabled solutions to detect and remediate network issues, discover threats, provide intelligence and...


  • San Francisco, CA, United States Genentech Full time

    The PositionThe PositionAt Genentech Computational Sciences (gCS) Prescient Design, we are at the forefront of employing machine learning to revolutionize drug discovery, adopting novel methods, techniques, and infrastructure to transform the field. Our Engineering team is seeking engineers with strong skills and hands-on experience in designing,...


  • Santa Clara, California, United States Nutanix Full time

    Build on top of Open Source LLM (Large Language Models) to leverage a diverse dataset.Develop AI-based systems for Natural Language Processing (NLP)Develop tools and processes for automatically train, updating and evaluate LLM (Large Language Models)Qualifications: Strong foundation in Machine Learning (ML), Deep Learning, LLMs and NLPFamiliar with LLM...


  • San Francisco, CA, United States Nextdoor Full time

    #TeamNextdoorNextdoor is where you connect to the neighborhoods that matter to you so you can belong. Our purpose is to cultivate a kinder world where everyone has a neighborhood they can rely on.Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those...


  • Santa Clara, United States Zeitro Full time

    Title: AI/ML Engineer InternLocation: Santa Clara, CA (remote)Duration: 6 monthsStart Date: July 2024Company Overview: We are a pioneering SaaS startup in the mortgage software industry, committed to transforming the mortgage experience for consumers, brokers, and lenders alike. With a product that stands out in the market for its clear differentiation and...


  • Santa Clara, United States Zeitro Full time

    Title: AI/ML Engineer InternLocation: Santa Clara, CA (remote)Duration: 6 monthsStart Date: July 2024Company Overview: We are a pioneering SaaS startup in the mortgage software industry, committed to transforming the mortgage experience for consumers, brokers, and lenders alike. With a product that stands out in the market for its clear differentiation and...


  • Santa Clara, CA, United States Nvidia Full time

    NVIDIA is building the world’s leading AI company, and we are looking for an experienced Cloud Solution Architect to help assist customers with adoption of GPU hardware and Software, as well as building and deploying Machine Learning (ML) , Deep Learning (DL), data analytics solutions on various Cloud Computing Platforms.As part of the Solutions...


  • Santa Clara, CA, United States percipient.ai Full time

    Santa Clara, CAEngineering – Backend /Full-Time /HybridPercipient.ai is currently seeking to hire a Principal Back-End Software Engineer to join our growing team. The Principal Back-End Software Engineer will work collaboratively with other back-end engineers, front-end engineers, product managers, and AI and Computer Vision scientists to build scalable...


  • Foster City, CA, United States Zoox Full time

    Foster City, CASoftware – Prediction /Full-time/ HybridThe Prediction & Behavior ML team is responsible for developing machine-learned models that understand the full scene around our vehicle and forecast the behavior for other agents, our own vehicle’s actions, and for offline applications. To solve these problems we develop deep learning algorithms...


  • San Jose, CA, United States TikTok Full time

    DescriptionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA is building the world’s leading AI company, and we are looking for an experienced Cloud Solution Architect to help assist customers with adoption of GPU hardware and Software, as well as building and deploying Machine Learning (ML) , Deep Learning (DL), data analytics solutions on various Cloud Computing Platforms. As part of the Solutions...


  • Burlingame, CA, United States Got-It AI Full time

    At Got It, Machine Learning Engineers and Scientists develop cutting edge technology and integrate it into our conversational AI platform. Our engineers and scientists bring fresh ideas from a diverse set of areas, including natural language processing, speech and conversational AI, cloud computing, large-scale system design, security, artificial...


  • Foster City, CA, United States Zoox Full time

    Foster City, CASoftware – Calibration, Localization & Mapping /HybridHigh-definition semantic maps are a critical tool for enabling autonomous driving. We are looking for highly motivated individuals who are passionate about machine learning, computer vision, and machine perception. You will be part of our algorithm team with a diverse group of researchers...


  • San Francisco, CA, United States Doordash Full time

    About the TeamCome help us build the world's most reliable on-demand, logistics engine for last-mile retail delivery! We're looking for an experienced machine learning engineer to help us develop modern growth and personalization models that power DoorDash's growing retail and grocery business.About the RoleWe’re looking for a passionate Applied Machine...


  • San Francisco, CA, United States Discord Full time

    Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...


  • Mountain View, CA, United States Google Full time

    Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of experience in software development, and with data structures/algorithms.5 years of experience with design and architecture, and testing/launching software products.Experience with Machine Learning.Preferred qualifications:PhD in Computer Science.Experience in running a...


  • Santa Clara, California, United States XPENG Full time

    We design, develop, manufacture and market smart EVs that are seamlessly integrated with advanced Internet, AI and autonomous driving technologies.We are looking for a machine learning engineer with strong programming and development skills and experience with machine learning.Experiences with deep learning algorithms, object detection, sensor fusion, SLAM...


  • Santa Clara, United States NVIDIA Full time

    Senior Solution Engineer - AI and ML Storage Architecture page is loaded Senior Solution Engineer - AI and ML Storage Architecture Apply locations US, CA, Santa Clara US, Remote time type Full time posted on Posted Yesterday job requisition id JR1980968 As a Senior Solution Engineer specializing in AI/ML Storage Architecture, you will be an integral part of...


  • San Francisco, CA, United States Atlassian Full time

    Overview Working at AtlassianAs a Senior Software Engineer in the Central AI team, you will build and maintain the core infrastructure to allow machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine Learning models and pipelines. You will use your software development expertise to solve difficult problems,...