Software Engineering Manager

3 weeks ago

Santa Clara, United States Karkidi Full time

We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models. We are a fast-paced, agile team building tools and software to make design and deployment of new deep learning models easier and accessible to more inference solution providers and data scientists.

In this role, you will manage an engineering team designing, developing, and optimizing software that streamlines AI inferencing. Ideal candidates will not only have experience leading an agile, system software engineering team, but also motivated to push the boundaries of what is possible with AI inferencing on both CPUs and GPUs. If this sounds exciting, we would love to hear from you

What you'll be doing:

  • Lead, mentor, and grow the Triton engineering team and be responsible for planning and execution of projects as well as the quality and performance of the Triton Inference Server.
  • Work closely with Product and Program Management to establish feature roadmaps and coordinate project dependencies; load-balance asynchronous requests across available resources; and collaborating on all feature designs.
  • Engage with internal and external partners and costumers to understand their use cases and requirements.

What we need to see:

  • Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field.
  • 8+ years of overall experience in developing customer facing software.
  • 3+ years of experience recruiting, training, and leading software engineering teams.
  • Strong fundamentals in building and deploying cloud services using HTTP REST, gRPC, protobuf, and related technologies.
  • Excellent C/C++ and Python programming and software design skills, including debugging, performance analysis, and test design. Emphasis on clean and SOLID object-oriented programming principles are a plus.
  • Experience running a large open source project - use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.
  • Experience with agile software development practices is a requirement, including familiarity with tools such as JIRA and AHA.

Ways to stand out from the crowd:

  • Experience working in a globally distributed organization.
  • Experience with machine learning algorithms and frameworks. Especially experience frameworks such as TensorFlow, PyTorch, ONNX, TensorRT, OpenVino, and vLLM.
  • Good knowledge of CPU and/or GPU hardware architecture.
  • Knowledge of GPU programming such as OpenCL or CUDA

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most experienced and passionate people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the multifaceted and quickly growing field Deep Learning and Artificial Intelligence

The base salary range is 216,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#J-18808-Ljbffr

  • Software Engineering Manager

    3 weeks ago

    Santa Clara, United States Amazon.com Services LLC Full time

    We are seeking a Software Development Manager to lead a highly customer centric, and early stage team for Amazon Stores Finance Technology Team. How often have you had an opportunity to be an early member of a team that is tasked with solving a huge customer need through disruptive and innovative technology?The Team: WW Amazon Stores Finance is poised for a...

  • Requirements Engineer

    1 week ago

    Santa Clara, United States Countervail Engineering Full time

    Countervail Engineering is working with several Agencies (incl. WMATA, VTA, Amtrak, SFMTA, BART) and design and build construction ventures nationwide to do system design, systems engineering, system integration, and testing & commissioning, with the goal of improving system capacity, reliability, safety, and maintaining a state of good repair.Countervail...

  • Software Engineer

    3 weeks ago

    Santa Clara, United States Selector Software Full time

    Job DescriptionJob DescriptionSalary: About UsSelector is building an operational intelligence platform for digital infrastructure. By adopting an AI/ML-based analytics approach, the platform provides actionable multi-dimensional insights to network, cloud, and application operators. It enables operations teams to meet their KPIs through seamless...

  • Software Engineer

    1 day ago

    Santa Clara, United States Omega Solutions Full time

    We are looking for a Java Software Engineer to help us build functional products and applications. Java Software Engineer responsibilities include defining software requirements, writing clean and efficient code for various applications and running tests to improve system functionality. If you have hands-on experience with programming in Java and are...

  • Software Engineering Manager

    4 days ago

    Santa Clara, CA, United States Nvidia Full time

    NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for 30 years. It’s an outstanding legacy of innovation that’s motivated by great technology—and outstanding people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers,...

  • System Software Engineer

    29 minutes ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA platforms are at the center of generative AI, autonomous driving, industrial robots, medical instruments and data centers across the world where GPU accelerated AI is revolutionizing the technology industry. As a platform company we deliver not just hardware solutions but also vertically integrated software stacks, GPU accelerated SDKs, libraries and...

  • System Software Engineer

    1 week ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA platforms are at the center of generative AI, autonomous driving, industrial robots, medical instruments and data centers across the world where GPU accelerated AI is revolutionizing the technology industry. As a platform company we deliver not just hardware solutions but also vertically integrated software stacks, GPU accelerated SDKs, libraries and...

  • Software Engineering Manager, NIM

    4 days ago

    Santa Clara, CA, United States Nvidia Full time

    We are seeking a SW Engineering Manager for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes, serves and develops performant inferencing for every AI model. You will design, build and deliver high performance inference applications and services. Our NIM offerings are...

  • Mobility Software Engineer

    1 week ago

    Santa Clara, United States Talascend Full time

    Talascend is currently seeking a Mobility Software Engineer for a contract opportunity in Santa Clara, CA SUMMARY: Our Client is developing the next generation of Intelligent Mobility. As a Software Engineer, you will have the opportunity to contribute to architect and develop software services running on their prototype and production vehicles in the...

  • Mobility Software Engineer

    3 weeks ago

    Santa Clara, United States Talascend Full time

    Talascend is currently seeking a Mobility Software Engineer for a contract opportunity in Santa Clara, CA SUMMARY: Our Client is developing the next generation of Intelligent Mobility. As a Software Engineer, you will have the opportunity to contribute to architect and develop software services running on their prototype and production vehicles in the...

  • Software Engineer, Front End

    1 week ago

    Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A FRONT END SOFTWARE ENGINEERAs our Front End Software Engineer, you will contribute to the GUI software core to our product. As a front end software engineer, you will write enabling frameworks, set up the foundational GUI architecture and implement new GUI features. You will help establish coding practices that foster high-growth...

  • Software Engineer, Front End

    2 weeks ago

    Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A FRONT END SOFTWARE ENGINEERAs our Front End Software Engineer, you will contribute to the GUI software core to our product. As a front end software engineer, you will write enabling frameworks, set up the foundational GUI architecture and implement new GUI features. You will help establish coding practices that foster high-growth...

  • Software Engineer, Front End

    2 weeks ago

    Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A FRONT END SOFTWARE ENGINEERAs our Front End Software Engineer, you will contribute to the GUI software core to our product. As a front end software engineer, you will write enabling frameworks, set up the foundational GUI architecture and implement new GUI features. You will help establish coding practices that foster high-growth...

  • Senior Software Engineer

    1 week ago

    Santa Clara, United States Tech Firefly Full time

    Summary: The Project Manager is an Information Technology (IT) position and will direct, oversee, monitor, and report to our client. The Project Manager will collaborate with project stakeholders and implement the project work plan to achieve project objectives. The Project Manager will lead daily Agile Scrum standup meetings and help identify and resolve...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States Tech Firefly Full time

    Job DescriptionJob DescriptionSummary:The Project Manager is an Information Technology (IT) position and will direct, oversee, monitor, and report to our client. The Project Manager will collaborate with project stakeholders and implement the project work plan to achieve project objectives. The Project Manager will lead daily Agile Scrum standup meetings and...

  • Senior Software Engineer

    4 weeks ago

    Santa Clara, United States Tech Firefly Full time

    Summary:The Project Manager is an Information Technology (IT) position and will direct, oversee, monitor, and report to our client. The Project Manager will collaborate with project stakeholders and implement the project work plan to achieve project objectives. The Project Manager will lead daily Agile Scrum standup meetings and help identify and resolve...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States Tech Firefly Full time

    Job DescriptionJob DescriptionWe are offering excellent opportunities for Senior Software EngineersApplicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity.Direct Hires Only.No Recruiters or Solicitations.Job Type:...

  • Senior Software Engineer

    4 weeks ago

    Santa Clara, United States Tech Firefly Full time

    We are offering excellent opportunities for Senior Software EngineersApplicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity.Direct Hires Only.No Recruiters or Solicitations.Job Type: Full-timeWork...

  • Senior Software Engineer

    2 weeks ago

    Santa Clara, United States Tech Firefly Full time

    We are offering excellent opportunities for Senior Software EngineersApplicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity.Direct Hires Only.No Recruiters or Solicitations.Job Type: Full-timeWork...

  • Senior Software Engineer

    1 week ago

    Santa Clara, United States Ask Staffing Full time

    Team: The charter of the ServiceNow Techops Development team is to develop business applications and customizations on the ServiceNow platform. We develop easy-to-use innovative SaaS solutions for all our internal users and for our customers to interact with us. The team works on multiple complex projects simultaneously using Agile methodologies. Role: The...