Software Engineering Manager, NIM

3 weeks ago


Santa Clara CA, United States Nvidia Full time

We are seeking a SW Engineering Manager for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes, serves and develops performant inferencing for every AI model. You will design, build and deliver high performance inference applications and services. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self hosted infrastructure and locally on all NVIDIA GPUs. You will use your deep understanding of software engineering, shipping enterprise software and optimizing performance to drive and deliver on the mission for NIMs as best performing inference microservices with cloud APIs on NVIDIA GPUs.NVIDIA is building a new category of products by intersecting our prowess in deep learning and computing with industry-leading technologies. You will harness groundbreaking technologies, and build highly efficient cloud services, reference applications and software processes to power how NVIDIA optimizes LLM Inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIAs processes and build the cross functional infrastructure team that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere.What you’ll be doing:You will design and implement industry leading Inference Microservices, built on top of heterogeneous hardware and software matrixBuild and drive a metrics driven engineering team that measures it’s capabilities and drives work based on first principles and knowledge.Integrate AI models, build microservices, optimize and verify the highest performance following a repeatable engineering process.Continuously improve your team’s ability to iterate critical features and performance improvements.Learn about new advancements in the area of AI inference, and integrate new research innovations from groups across NVIDIA into your products.Drive predictable execution, high quality software and own the roadmap and technical future of your team.What we need to seeAn expert engineering leader and trained software engineer with Masters or equivalent experience in Computer Science, Computer Engineering or related field.10+ overall years of relevant industry experienceExcellent interpersonal skills and 4+ years of leadership experienceHands-on experience developing microservices, distributed software using CI/CDBackground in designing and delivering gRPC and REST based high quality APIs that scale out in highly distributed infrastructures.Experience working with NVIDIA's compute platforms such as DGX, Omniverse or AGX (Jetson, Drive) and exposure to platform software such as CUDA, TRT and software stack and applications is desired.Please be able to show a track record of crafting well-designed solutions and delivering high-quality software on time with strong engineering skills when faced with complicated and ambiguous problems.You excel at finding the simplest way to bring new technology to new domains.Highly motivated with strong communication skills, you have the ability to work successfully with multi-functional teams and coordinate effectively across organizational boundaries and geographies. A history of mentoring engineers is a plus.Growing individuals and teams and have demonstrated skills in a wide variety of programming languages and infrastructure problems.With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our teams are rapidly growing.The base salary range is 220,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time



  • Santa Clara, United States L4B Software Full time

    Job DescriptionL4B Software is a cutting-edge technology company specializing in Embedded systems and Linux-based solutions. We are at the forefront of innovation, developing advanced software solutions that power a wide range of devices across various industries. As we continue to grow, we are seeking passionate and talented individuals to join our...


  • Santa Clara, CA, United States ADVANCED ENGINEERING GROUP PC Full time

    We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team! Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models. We are a fast-paced, agile team...


  • Santa Clara, CA, United States ADVANCED ENGINEERING GROUP PC Full time

    We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team! Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models. We are a fast-paced, agile team...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Software Engineering Manager page is loaded Software Engineering Manager Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1981015 NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for 30 years. It’s an outstanding legacy of innovation that’s motivated by great...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Software Engineering Manager page is loaded Software Engineering Manager Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1981015 NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for 30 years. It’s an outstanding legacy of innovation that’s motivated by great...


  • Santa Clara, CA, United States telenav Full time

    Do you dream of what cars of the future will look like when you combine them with connectivity, a smartphone, and cloud services? Can you imagine uniting those dreams with a company that has the skills and relationships to make that a reality? If so, Telenav wants you! At Telenav, we believe the car is at the beginning of a massive innovation wave that...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Software Engineering Manager - Libraries page is loaded Software Engineering Manager - Libraries Apply locations US, CA, Santa Clara US, CA, Remote time type Full time posted on Posted Yesterday job requisition id JR1981753 We are looking for a software engineering manager to lead our development efforts for math libraries in the AI, HPC, and Quantum...


  • Santa Clara, United States Amazon.com Services LLC Full time

    We are seeking a Software Development Manager to lead a highly customer centric, and early stage team for Amazon Stores Finance Technology Team. How often have you had an opportunity to be an early member of a team that is tasked with solving a huge customer need through disruptive and innovative technology?The Team: WW Amazon Stores Finance is poised for a...


  • Santa Clara, CA, United States NVIDIA Full time

    Are you passionate about challenging yourself and would you love to contribute as part of a world-class company? We are hiring a Graphics Software Engineering Manager for the Compiler Graphics Test Dev team to lead a dynamic and diverse group of graphics application engineers. What You’ll Be Doing Be both a technical and managerial leader for the...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    NVIDIA is looking for Senior Software Engineering to join NVIDIA in the Cumulus Linux team! We present you with an opportunity to be part of the team that develops the Network Operating System that powers data centers that are accelerated, disaggregated and software-defined to meet the exploding growth in AI and high-performance computing. You'll be part of...


  • Santa Clara, United States NVIDIA Full time

    For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, product design, medical diagnosis and scientific research. Today, we stand at the beginning of the next era, the AI computing...

  • Software Engineer

    1 week ago


    Santa Clara, CA, United States Order, Inc. Full time

    ENGINEERING Ordr, Inc. in Santa Clara, CA seeks Software Engineer: Meet w/ sales/mktg teams to gather new reqs from the customer. Review & analyze the reqs within the engineering team. Part-time tele-commuting allowed. $283,442/ yr. Email res (must reference Job Code #43010) to careers@ordr. net.

  • Software Engineer

    1 month ago


    Santa Clara, United States Selector Software Full time

    Job DescriptionJob DescriptionSalary: About UsSelector is building an operational intelligence platform for digital infrastructure. By adopting an AI/ML-based analytics approach, the platform provides actionable multi-dimensional insights to network, cloud, and application operators. It enables operations teams to meet their KPIs through seamless...


  • Santa Clara, United States L4B Software Full time

    L4B Software is a global engineering deep-tech company headquartered in Munich, Germany, and Santa Clara, California. Since 2004, the company has been providing software engineering solutions and services for leading OEMs in automotive, consumer electronics, smartphone manufacturing, and medical devices. L4B offers an undisputed "full stack" embedded-system...


  • Santa Clara, CA, United States NVIDIA Full time

    NVIDIA's Cumulus Linux Release Engineering team is seeking a Senior Linux Systems Software Engineer with extensive experience in DevOps, and software configuration management. You will play a critical role in developing and implementing software tools for improving developer productivity, organizational efficiency and improving the software build and...


  • Santa Clara, CA, United States palo_alto_networks Full time

    We are looking to hire our Head of Management Software. This technical leader will have a successful track record in the delivery of software products with proven experience in building, motivating and managing a strong team of software architect, web developers and software engineers. This role will manage the day-to-execution by development and...


  • Santa Clara, CA, United States UnitX, Inc. Full time

    Job Title Senior Software Engineer, Computer Vision/3D About Us UnitX builds the world's leading robotics systems to automate repetitive visual tasks in factories. UnitX is an exciting, innovative, and fast-moving startup with a team from Stanford, MIT, and Google. Our team is highly collaborative and we are looking forward to offering you the chance...

  • Software Engineer

    3 weeks ago


    Santa Clara, United States Omega Solutions Full time

    We are looking for a Java Software Engineer to help us build functional products and applications. Java Software Engineer responsibilities include defining software requirements, writing clean and efficient code for various applications and running tests to improve system functionality. If you have hands-on experience with programming in Java and are...


  • Santa Clara, CA, United States Tech Firefly Full time

    We are offering excellent opportunities for Senior Software Engineers Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity. Direct Hires Only. No Recruiters or Solicitations. Job Type: Full-time Work...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer, Server Manageability FMEA page is loaded Senior Software Engineer, Server Manageability FMEA Apply locations US, CA, Santa Clara US, Remote time type Full time posted on Posted Yesterday job requisition id JR1980416 NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer...