Senior Software Architect

4 weeks ago

Santa Clara, California, United States NVIDIA Full time

About the Role:

NVIDIA is a leader in groundbreaking developments in Artificial Intelligence, High Performance Computing, and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars.


What We're Seeking:

We're the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.


DL and HPC applications have a huge compute demand and already run at scales of up to tens of thousands of GPUs.

GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems.


Responsibilities:

Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.


Design and implement new communication technologies to accelerate AI and HPC workloads.


Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects.


Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.


Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)


Requirements:

M.S./Ph.D. degree in CS/CE or equivalent experience.


5+ years of relevant experience.


Excellent C/C++ programming and debugging skills.


Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).


Deep understanding of operating systems, computer and system architecture.


Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.


Strong experience with Linux.


Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.


Preferred Qualifications:

Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc.


Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications.


Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment.


What We Offer:

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.


You will also be eligible for equity and benefits.


NVIDIA accepts applications on an ongoing basis.


NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States Oracle Full time

    Job Title: Senior Software ArchitectWe are seeking a highly skilled Senior Software Architect to join our team at Oracle. As a key member of our engineering team, you will be responsible for designing and developing scalable, secure, and high-performance software systems.Key Responsibilities:Design and develop software systems that meet the needs of our...

  • Senior Java Software Architect

    4 weeks ago

    Santa Clara, California, United States Omega Solutions Full time

    Job Title: Senior Java Software ArchitectAbout the Role:We are seeking a highly skilled Senior Java Software Architect to join our team at Omega Solutions. As a key member of our software development team, you will be responsible for designing and implementing large-scale distributed systems and web services using Java/J2EE.Key Responsibilities:Architecting...

  • Senior Software Architect

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Architect to join our system software engineering team at NVIDIA. As a key member of our team, you will be responsible for architecting, evaluating, and integrating proximity sensing and positioning solutions to our automotive platforms and products.You will collaborate with our global engineering teams to...

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Architect to lead the design and development of our AI platform for industrial-grade robotics solutions.The ideal candidate will have a strong background in computer science, electrical engineering, or a related field, and at least 5 years of experience working on cloud platforms.Key responsibilities include...

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Engineer to join our US-based networking software group at NVIDIA. As a technical leader, you will have a unique opportunity to shape the future of the group, develop its technological vision, and strategize with partners on the next generation of software-defined networking products built on top of the...

  • Senior Software Architect

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    Job DescriptionNVIDIA is seeking a highly skilled Senior Software Engineer to join our US-based networking software group. As a technical leader, you will have the opportunity to shape the future of the group, develop its technological vision, and strategize with partners on the next generation of software-defined networking products built on top of the...

  • Senior Firmware Software Architect

    4 weeks ago

    Santa Clara, California, United States Solomon Page Full time

    Job Title: Senior Firmware Software ArchitectJob Summary:We are seeking a Senior Firmware Software Architect to join our team at Solomon Page. As a key member of our R&D team, you will be responsible for designing and developing firmware for our next-generation analyzers. Your expertise in FPGA, Xilinx, and embedded systems will be crucial in helping us...

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Architect to lead software activities for NVIDIA's deep learning server platforms, from design through production. The ideal candidate will have deep expertise in designing server platforms and a strong understanding of application use cases in Deep Learning workloads.You will work closely with world-class...

  • Senior Software Architect, Advanced Development

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    NVIDIA is a leader in computer graphics, PC gaming, and accelerated computing, with a legacy of innovation driven by technology and people. We are seeking a senior architect to join our Advanced Development team and shape the future of our company.As a senior architect, you will be responsible for crafting architectural solutions and participating in...

  • Senior Cloud Architect Leader

    4 weeks ago

    Santa Clara, California, United States Cynet Systems Full time

    Job Title: Senior Cloud Architect LeaderCynet Systems is seeking a highly experienced Senior Cloud Architect Leader to lead our cloud solutions team. The ideal candidate will have a strong background in public cloud environments, software engineering, and team leadership.Key Responsibilities:Lead the development and implementation of cloud-based...

  • Senior System and Software Architect

    4 weeks ago

    Santa Clara, California, United States SiFive Full time

    About SiFiveSiFive is a pioneering company that introduced RISC-V to the world, transforming the future of compute by bringing the limitless potential of RISC-V to the highest performance and most data-intensive applications.Our unrivaled compute platforms enable leading technology companies to innovate, optimize, and deliver advanced solutions across every...

  • Senior Network Architect

    1 month ago

    Santa Clarita, California, United States United Software Group Full time

    Job SummaryWe are seeking a highly skilled Senior Network Architect to lead our network engineering team. The ideal candidate will have a strong background in routing protocols and switching, with a focus on Cisco environments. Key Responsibilities* Design and implement automation and toolsets for real-time network monitoring, fault management, and...

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    NVIDIA is a leader in the field of computer graphics and parallel computing. We are seeking a highly skilled Senior Software Engineer to join our team and contribute to the development of our infrastructure tools.The ideal candidate will have a strong background in software development, with experience in languages such as C++, Python, and Perl. They will...

  • Software Architect

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    NVIDIA is seeking a talented Software Architect to join our team and help build and own the system architecture of simulators for our DGX and HGX Server platforms.This is a unique opportunity to work with world-class engineering teams across HW and SW and engage with industry-leading cloud service providers on taking these products to market.The successful...

  • Senior System Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    pWe are seeking a highly motivated Senior System Architect to join our GPU team at NVIDIA./ppA key aspect of NVIDIA's success is its ability to innovate in the graphics and parallel computing fields, delivering the highest performance in the world for graphics processing./ppWe are constantly looking for ways to improve our GPU architecture and maintain our...

  • Senior Software Quality Assurance Engineer

    4 weeks ago

    Santa Clara, California, United States United Software Group Full time

    We are seeking a highly skilled Senior Software Quality Assurance Engineer to join our team at United Software Group. In this role, you will be responsible for developing and maintaining our CI/CD pipeline, ensuring the highest quality of our software products.Key responsibilities include:Designing and implementing automated testing frameworksDeveloping and...

  • Senior Software Leader

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Job DescriptionNVIDIA is seeking a highly experienced and skilled Senior Software Leader to lead our CUDA kernel mode teams. As a key member of our software leadership team, you will be responsible for developing strategic direction for the group and fostering software quality improvement for CUDA kernel mode components deployed on multiple...

  • Senior Software Architect

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    NVIDIA is a leader in groundbreaking developments in Artificial Intelligence, High Performance Computing, and Visualization. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.We are the GPU Communications Libraries and...

  • Senior System Architect

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly motivated and experienced Senior System Architect to join our GPU team at NVIDIA.A key aspect of NVIDIA's success is our ability to innovate in the graphics and parallel computing fields, delivering the highest performance in the world for graphics processing.We are constantly looking for ways to improve our GPU architecture and...

  • Senior Software Leader

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    Job SummaryNVIDIA is seeking a highly experienced and skilled Senior Software Leader to lead our CUDA kernel mode teams. As a key member of our engineering organization, you will be responsible for developing strategic direction for the group, fostering software quality improvement, and collaborating with cross-functional teams to ensure product requirements...