Software Engineering Manager

1 week ago

Hillsboro, United States NVIDIA Full time


We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models.

We are a fast-paced, agile team building tools and software to make design and deployment of new deep learning models easier and accessible to more inference solution providers and data scientists.

In this role, you will manage an engineering team designing, developing, and optimizing software that streamlines AI inferencing.

Ideal candidates will not only have experience leading an agile, system software engineering team, but also motivated to push the boundaries of what is possible with AI inferencing on both CPUs and GPUs.

If this sounds exciting, we would love to hear from you

What You'll Be Doing


Lead, mentor, and grow the Triton engineering team and be responsible for planning and execution of projects as well as the quality and performance of the Triton Inference Server.

Work closely with Product and Program Management to establish feature roadmaps and coordinate project dependencies; load-balance asynchronous requests across available resources; and collaborating on all feature designs.

Engage with internal and external partners and costumers to understand their use cases and requirements.

What We Need To See

Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field.
8+ years of overall experience in developing customer facing software.
3+ years of experience recruiting, training, and leading software engineering teams.
Strong fundamentals in building and deploying cloud services using HTTP REST, gRPC, protobuf, and related technologies.
Excellent C/C++ and Python programming and software design skills, including debugging, performance analysis, and test design. Emphasis on clean and SOLID object-oriented programming principles are a plus.

Experience running a large open source project - use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.

Experience with agile software development practices is a requirement, including familiarity with tools such as JIRA and AHA.

Ways To Stand Out From The Crowd

Experience working in a globally distributed organization.
Experience with machine learning algorithms and frameworks. Especially experience frameworks such as TensorFlow, PyTorch, ONNX, TensorRT, OpenVino, and vLLM.
Good knowledge of CPU and/or GPU hardware architecture.
Knowledge of GPU programming such as OpenCL or CUDA

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most experienced and passionate people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the multifaceted and quickly growing field Deep Learning and Artificial Intelligence

The base salary range is 216,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#J-18808-Ljbffr

  • Sr Manager, Software Engineering

    2 weeks ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Title: Sr. Manager, Software Engineering Do you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you’ll help solve some of the world’s toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law enforcement tackle...

  • Software Engineering Manager

    2 weeks ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Do you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you’ll help solve some of the world’s toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law enforcement tackle cases through forensics. We empower our teams...

  • Sr Manager, Software Engineering

    4 weeks ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Sr. Manager, Software Engineering Do you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you’ll help solve some of the world’s toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law enforcement tackle cases...

  • Sr Manager, Software Engineering

    3 weeks ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Sr. Manager, Software Engineering Do you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you’ll help solve some of the world’s toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law enforcement tackle cases...

  • Software Engineering Manager

    13 hours ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Work ScheduleOtherEnvironmental ConditionsOfficeJob DescriptionDo you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you'll help solve some of the world's toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law...

  • Software Engineering Manager

    1 month ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Job DescriptionDo you have a passion for innovative ideas and groundbreaking discoveries? With over $1 billion invested annually in R&D, at Thermo Fisher Scientific you'll help solve some of the world's toughest challenges, from giving cancer patients hope, ensuring safe drinking water and helping law enforcement tackle cases through forensics. We empower...

  • Software Engineering Manager

    2 weeks ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    Job at Thermo Fisher Scientific: Software Automation Development Engineer Are you passionate about innovative concepts and revolutionary breakthroughs? Thermo Fisher Scientific invests over $1 billion each year in R&D to tackle some of the toughest global challenges, from providing hope to cancer patients to ensuring clean drinking water and supporting law...

  • Platform Software Engineer Execution Manager

    4 weeks ago

    Hillsboro, United States Intel Full time

    In this role, you will lead one or more Platform Software Execution Teams (PSXT) on technology development for Intel Xeon platforms in the Data Center and AI Group (DCAI). The key functions of the role will be to:Manage the platform Firmware/ Softw Software Engineer, Manager, Platform, Software, Electrical Engineer, Computer Science

  • Software Engineering Manager

    3 weeks ago

    Hillsboro, United States The Ladders Full time

    In this role, you will lead a group of software developers working on applications for the Rohde & Schwarz line of Vector Network Analyzers (VNAs), Signal Analyzers, and Spectrum Analyzers. This position is part of the Measurement Applications R&D organization in Hillsboro, OR which focuses on application development for various devices in close alignment...

  • Software Engineering Manager

    7 days ago

    Hillsboro, United States ROHDE & SCHWARZ GmbH & Co. KG Full time

    **Your tasks**: - Provide leadership for 10-15 team members, promoting professional development within the team through training and learning opportunities - Collaborate closely with international R&D sites and with other product teams - Support the establishment of local customer collaborations, including occasional customer visits - Facilitate and drive...

  • Software Engineering Manager

    3 weeks ago

    Hillsboro, United States The Ladders Full time

    In this role, you will lead a group of software developers working on applications for the Rohde & Schwarz line of Vector Network Analyzers (VNAs), Signal Analyzers, and Spectrum Analyzers. This position is part of the Measurement Applications R&D organization in Hillsboro, OR which focuses on application development for various devices in close alignment...

  • Technician: Engineering

    2 months ago

    hillsboro, United States Talent Software Services Full time

    Technician: Engineering - IIIJob Summary: Talent Software Services is in search of a Technician: Engineering for a contract position in Hillsboro, OR. The opportunity will be four months with a strong chance for a long-term extension.Primary Responsibilities/Accountabilities:...

  • Engineer: Verification

    1 month ago

    Hillsboro, United States Talent Software Services Full time

    Hybrid: Must work 2-3 days between Tuesday - Thursday Onsite Max Bill rate: *** Min education requirement: Bachelor's degree (NO EXCEPTION) Laptop provided. Title: Verification Engineer Responsibilities: Prepare verification plans against each release and create JIRA stories and tasks. Setup test environment that includes configuration of Linux Machines,...

  • Verification Engineer- I

    4 weeks ago

    Hillsboro, United States Talent Software Services Full time

    Hybrid: Must work 2-3 days between Tuesday - Thursday Onsite Max Bill rate: *** Min education requirement: Bachelor's degree (NO EXCEPTION) Laptop provided. Title: Verification Engineer Responsibilities: Prepare verification plans against each release and create JIRA stories and tasks. Setup test environment that includes configuration of Linux Machines,...

  • Software Engineer- Hillsboro

    1 month ago

    Hillsboro, United States Rohde & Schwarz Full time

    Make ideas real - with the perfect job. Right now we have several job openings for you. Functional area All Administration 7 Application Development 28 Construction 6 Controlling 7 Cybersecurity 2 Finance 19 Hardware Development 42 Human Resources 10 Information Technology 40 Law 5 Manufacturing 26 ...

  • Software Engineer- Hillsboro

    4 weeks ago

    Hillsboro, United States Rohde & Schwarz Full time

    Make ideas real - with the perfect job. Right now we have several job openings for you. Functional area All Administration 7 Application Development 28 Construction 6 Controlling 7 Cybersecurity 2 Finance 19 Hardware Development 42 Human Resources 10 Information Technology 40 Law 5 Manufacturing 26 ...

  • Staff Software Engineer

    1 week ago

    Hillsboro, United States Thermo Fisher Scientific Full time

    As a Senior Software Engineer at Thermo Fisher Scientific, you will play a crucial role in developing automated semiconductor process equipment that provides essential information to our customers to facilitate informed decision-making. Responsibilities: Develop control software to automate scanning electron microscope process workflows in a FAB...

  • Senior Software Application Engineer

    1 month ago

    Hillsboro, United States ASML Full time

    Description Apps Software engineering forms the backbone of the team that supports customers enabling their new technology nodes. Defines the specific technical node strategy, drives understanding of customer requirements, analyses and solves complex on-product issues, defines and create solutions and brings ideas for new products and/or services....

  • Senior Software Application Engineer

    4 weeks ago

    Hillsboro, United States ASML Full time

    Description Apps Software engineering forms the backbone of the team that supports customers enabling their new technology nodes. Defines the specific technical node strategy, drives understanding of customer requirements, analyses and solves complex on-product issues, defines and create solutions and brings ideas for new products and/or services....

  • Software Support Engineer

    1 month ago

    Hillsboro, United States Orion Talent Full time

    Description Position Details: •Title: Software Support Engineer •Locations: •Albuquerque, NM •Chandler, AZ •Hillsboro, OR •Travel/Schedule: •This is typically a standard Mon-Fri dayshift opportunity. •You may be asked to travel to other EV Group support sites on occasion. •Compensation: Target base rate ~$36/hr - $41/hr...