Principal Engineer, Distributed Machine Learning

5 days ago


Santa Clara, United States NVIDIA Corporation Full time
Principal Engineer, Distributed Machine Learning

NVIDIA is looking for a Principal Engineer to join our Distributed Machine Learning team focused on GPU accelerated Apache Spark. Data scientists often apply machine learning (ML) and deep learning (DL) algorithms over large datasets to train AI models. To accelerate and scale the model training, some libraries (e.g., XGBoost, RAPIDS cuML, PyTorch, and TensorFlow) have been extended for distributed training in a GPU-accelerated computer cluster. NVIDIA plans to work with open source communities to make GPU-accelerated distributed ML/DL even more widely applicable and easier to use. We aim to address the key limitations (including performance and usability) of existing solutions so that data scientists could build AI models to achieve business goals, faster, more reliably, and at a lower cost. Come join NVIDIA to design and develop GPU-accelerated distributed machine learning solutions.

What you’ll be doing:

  • Design and develop new user-friendly APIs and libraries to optimally use existing DL/ML frameworks in GPU-enabled Spark clusters for distributed DL/ML training and inference at scale.
  • Design and develop GPU accelerated ML libraries for distributed training and inference on Spark clusters, e.g., to improve our existing spark-rapids-ml open source library.
  • Demonstrate superior performance of developed solutions on industry standard benchmarks and datasets.
  • Make technical contributions to enhance capabilities of open source projects such as RAPIDS, XGBoost, spark-rapids-ml, and Apache Spark.
  • Work with NVIDIA partners and customers on deploying distributed ML algorithms in cloud or on-premise.
  • Keep up with published advances in distributed ML systems and algorithms.
  • Provide technical mentorship to a team of engineers.

What we need to see:

  • BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field (or equivalent experience).
  • 12+ years of work or research experience in software development.
  • 5+ experience as technical lead in distributed machine learning and/or deep learning.
  • 3+ years of open source development experience.
  • 3+ years of hands-on experience with Spark MLlib, XGBoost, and/or PyTorch.
  • Knowledge of internals of Apache Spark MLlib.
  • Experience with Kubernetes, YARN, Spark, and/or Ray for distributed ML orchestration.
  • Proven technical skills in designing, implementing and delivering high-quality distributed systems.
  • Excellent programming skills in C++, Scala, and Python.
  • Familiar with agile software development practice.

Ways to stand out from the crowd:

  • Familiarity with NVIDIA libraries (RAPIDS cuML, Spark-RAPIDS, NVTabular) is a plus.
  • Familiarity with NVIDIA GPUs and CUDA is also a strong plus.
  • Familiarity with Horovod, Petastorm and other existing/past distributed learning libraries is desirable.
  • Experience working with multi-functional teams across organizational boundaries and geographies.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. If you are passionate about what you do, creative and autonomous, we want to hear from you

The base salary range is 272,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and benefits.

NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#J-18808-Ljbffr

  • Santa Clara, United States NVIDIA Corporation Full time

    Principal Engineer, Distributed Machine LearningNVIDIA is looking for a Principal Engineer to join our Distributed Machine Learning team focused on GPU accelerated Apache Spark. Data scientists often apply machine learning (ML) and deep learning (DL) algorithms over large datasets to train AI models. To accelerate and scale the model training, some libraries...


  • Santa Clara, California, United States Amazon Development Center U.S., Inc. Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Machine Learning Engineer to join our team at Amazon Development Center U.S., Inc. as an Applied Scientist II.Key ResponsibilitiesDesign, develop, and deploy state-of-the-art machine learning algorithms and systems for large-scale applications.Collaborate with cross-functional teams to...


  • Santa Clara, United States Nvidia Full time

    Senior Machine Learning EngineerlocationsUS, CA, RemoteUS, TX, AustinUS, WA, RemoteUS, NY, RemoteUS, CA, Santa Claratime typeFull timejob requisition idJR1977220We're looking for a motivated Senior Machine Learning Engineer, focused on Vector Search, to join NVIDIA’s RAPIDS Machine Learning team. RAPIDS is the open source suite of libraries that combine...


  • Santa Clara, California, United States Nvidia Full time

    Senior Machine Learning EngineerlocationsUS, CA, RemoteUS, TX, AustinUS, WA, RemoteUS, NY, RemoteUS, CA, Santa Claratime typeFull timejob requisition idJR1977220We're looking for a motivated Senior Machine Learning Engineer, focused on Vector Search, to join NVIDIA's RAPIDS Machine Learning team. RAPIDS is the open source suite of libraries that combine the...


  • Santa Clara, United States Eightfold Full time

    About EightfoldEightfold AI is the industry leader in AI-powered talent intelligence and transforming the way organizations manage their talent. Our AI-powered Talent Intelligence Platform helps companies identify, attract, and retain top talent, while also providing employees with the tools they need to grow and succeed in their careers. Join us in shaping...


  • Santa Clara, United States Eightfold Full time

    About EightfoldEightfold AI is the industry leader in AI-powered talent intelligence and transforming the way organizations manage their talent. Our AI-powered Talent Intelligence Platform helps companies identify, attract, and retain top talent, while also providing employees with the tools they need to grow and succeed in their careers. Join us in shaping...


  • Santa Clara, California, United States Amazon Web Services, Inc. - A97 Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Engineer to join our team at Amazon Web Services, Inc. - A97. As an Applied Scientist II, NGDE Science, you will play a key role in developing novel algorithms and modeling techniques to advance the state-of-the-art in human language technology.Key ResponsibilitiesDesign and develop...


  • Santa Clara, United States Ethereum Technologies LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 10 MonthsDomain Exposure: Work Authorization: Client: Employment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)We are looking for passionate, hard-working, and talented Software Engineers to help...


  • Santa Clara, United States Ethereum Technologies LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 10 MonthsDomain Exposure: Work Authorization: Client: Employment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)We are looking for passionate, hard-working, and talented Software Engineers to help...


  • Santa Clara, United States Cloud Analytics Technologies, LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 10 MonthsDomain Exposure: Not specifiedWork Authorization: Not specifiedClient: To Be Discussed LaterEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)We are looking for passionate,...


  • Santa Clara, United States Cloud Analytics Technologies, LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 10 MonthsDomain Exposure: Not specifiedWork Authorization: Not specifiedClient: To Be Discussed LaterEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)We are looking for passionate,...


  • Santa Clara, California, United States Amazon Web Services, Inc. - A97 Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Engineer to join our Amazon Web Services (AWS) Next Gen DevX (NGDE) team. As an Applied Scientist II, you will play a key role in developing novel algorithms and modeling techniques to advance the state-of-the-art in human language technology.Key ResponsibilitiesDesign and develop machine...

  • AI Engineer

    2 days ago


    Santa Clara, California, United States Abbott Laboratories Full time

    About the RoleWe are seeking a highly skilled Principal AI Engineer to join our team at Abbott Laboratories. As a key member of our Corporate IT Organization, you will be responsible for designing and developing artificial intelligence products that drive business growth and innovation.Key ResponsibilitiesDevelop and apply industry-leading machine learning...


  • Santa Clara, United States Robotics Prcocess Automation, LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters. Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning...


  • Santa Clara, United States Blockchain Technologies. LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters. Job Overview Specialized Area: Machine learning Job Title: Machine Learning Engineer Location: Duration:...


  • Santa Clara, United States Quantum Technologies. LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters.Job OverviewSpecialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be...


  • Santa Clara, United States AI Technologies LLC. Full time

    Job OverviewJob ID: J37968Specialized Area: PythonJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 10 MonthsDomain Exposure: Manufacturing, Education, IT/SoftwareWork Authorization: W-2 (Consultant must be on our company payroll. C2C is not allowed)Employment Type: W-2 (Consultant must be on our company payroll. C2C is not...


  • Santa Clara, California, United States Blockchain Technologies. LLC Full time

    Job OverviewBlockchain Technologies, LLC is seeking a highly skilled Machine Learning Engineer to join our team. As a Machine Learning Engineer, you will be responsible for developing and implementing deep learning models using TensorFlow, PyTorch, and Keras.Key Responsibilities:Design and develop deep learning models for computer vision applications,...


  • Santa Clara, California, United States Eightfold Full time

    About EightfoldEightfold AI is the industry leader in AI-powered talent intelligence and transforming the way organizations manage their talent. Our AI-powered Talent Intelligence Platform helps companies identify, attract, and retain top talent, while also providing employees with the tools they need to grow and succeed in their careers.About The AI/ML...


  • Santa Clara, United States Blockchain Technologies. LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters. Job Overview Specialized Area: Python Job Title: Machine Learning Engineer Location: To Be Discussed...