Senior Systems Software Engineer, Spark Service

4 weeks ago


Santa Clara CA, United States Nvidia Full time

We are seeking expert Senior System Software Engineers adept at Apache Spark to join our team. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features and fit ML algorithms impedes an efficient business workflow. NVIDIA believes that data science workflows can benefit tremendously from being accelerated, to enable data scientists to explore many more and larger datasets to drive towards their business goals, faster and more efficiently.At NVIDIA, we are passionate about working on hard problems that have an impact. You will need to have previous experience working with Apache Spark applications, implementing big data applications for a variety of customers, programming skills, and familiarity with open source distributed processing frameworks. You should be comfortable working with interdisciplinary teams. You will work with an engineering team accelerating Apache Spark with GPUs using CUDA and open source libraries. This is an opportunity to work with a team that is developing the Spark RAPIDS open source library to accelerate Spark applications. This is a strategic investment for NVIDIA The code is being adopted by multiple cloud service providers and Apache Spark distributions.What you'll be doing:Design and develop a world-class GPU accelerated Apache Spark service.Enable a collection of micro-services to provide the ability to run Spark applications on Kubernetes or other platforms.Implement the REST API and its client libraries to simplify customer adoptions.Customize the open-source projects to meet the project requirements.Deploy and verify the solution on CSPs or on-prem Kubernetes environments.Engage open source communities, including Apache Spark and RAPIDS, for technical discussions and contributionsWhat we need to see:8+ years of experience in software development.5+ years hands on experience with web service design and developmentBS/MS/PhD in computer science or a related field or equivalent experience Experience with REST service frameworks like Spring BootFamiliarity with the modern data open source ecosystem (Apache Spark, Apache Kyuubi, Apache Zookeeper, gRPC, etc)Experience with Kubernetes and Helm charts and Experience building performance and reliable service APIsExperience working on public and private cloud platforms and Experience with object storage and distributed file systemsPrior experience supporting enterprise customersSolid understanding of Python and Scala/JavaExcellence at communicating, presenting and explaining technical topicsWays to stand out from the crowd:Working experience with Spark distributions: Databricks, AMS EMR, GCP Dataproc, Azure Synapse Analytics.Contributions to major open source projects such as Apache Spark, Apache Kyuubi, Apache Ranger, Apache Iceberg, and Delta Lake.Development experience of Apache Spark Data Sources and connectors.Development experience with Spark Client interfaces/tools like Jupyter, Zeppelin, Spark Connect, and BI tools.Working knowledge of secrets and encryption management systems and Basic ML/DL experience with PyTorch, TensorFlow, Spark ML and XGBoost.NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative, passionate and self-motivated, we want to hear from you NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. The base salary range is 220,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time



  • Santa Clara, United States NVIDIA Full time

    We are seeking experienced System Software Engineers adept at Apache Spark to join our team to help drive innovation for accelerated data processing on GPUs. As Nvidia is leading the world in accelerated computing, we are building the next generation data processing ecosystem. Data scientists spend a considerable amount of time exploring data and iterating...


  • Santa Clara, CA, United States Polaris Wireless Full time

    Polaris solutions continually process massive accurate cell-phone geolocation data covering all subscribers across the entire country. Analytics are used to convert this massive data flow into various applications that benefit our end-customers. The Aigis product backend includes the WINT platform. The WINT platform processes incoming events and computes...


  • Santa Clara, United States Polaris Wireless Full time

    Polaris solutions continually process massive accurate cell-phone geolocation data covering all subscribers across the entire country. Analytics are used to convert this massive data flow into various applications that benefit our end-customers. The Aigis product backend includes the WINT platform. The WINT platform processes incoming events and computes...


  • Santa Clara, United States Polaris Wireless Full time

    Polaris solutions continually process massive accurate cell-phone geolocation data covering all subscribers across the entire country. Analytics are used to convert this massive data flow into various applications that benefit our end-customers. The Aigis product backend includes the WINT platform. The WINT platform processes incoming events and computes...


  • Santa Clara, United States DeepSight Technology Full time

    Senior Imaging Systems Software Engineer DeepSight Technology Inc. is actively searching for a Senior Imaging Systems Software Engineer to apply to join our amazing software team full-time in our Santa Clara, CA office! We are an innovative medical imaging company that invests in our team and offers real opportunities for career growth. This Senior Software...


  • Santa Clara, CA, United States NVIDIA Full time

    The NVIDIA GPU Cloud (NGC) Data Platform team is building a cloud-native stack of software services and tools for managing data on a hybrid and multi-cloud infrastructure. We are building the next-generation Data and Storage infrastructure to solve the most challenging problems - storage, access, and data management for exabyte-scale, high-performance...


  • Santa Clara, United States DeepSight Technology Full time

    Job DescriptionJob DescriptionSenior Imaging Systems Software EngineerDeepSight Technology Inc. is actively searching for a Senior Imaging Systems Software Engineer to apply to join our amazing software team full-time in our Santa Clara, CA office!We are an innovative medical imaging company that invests in our team and offers real opportunities for career...


  • Santa Clara, United States DeepSight Technology Full time

    Job DescriptionJob DescriptionSenior Imaging Systems Software EngineerDeepSight Technology Inc. is actively searching for a Senior Imaging Systems Software Engineer to apply to join our amazing software team full-time in our Santa Clara, CA office!We are an innovative medical imaging company that invests in our team and offers real opportunities for career...


  • Santa Clara, United States NVIDIA Full time

    Senior Graphics Software Engineer page is loaded Senior Graphics Software Engineer Apply locations US, CA, Santa Clara time type Full time posted on Posted 3 Days Ago job requisition id JR1978454 We are looking for a Senior Graphics Software Engineer. Nvidia’s invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer...


  • Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A SENIOR IMAGING SYSTEMS SOFTWARE ENGINEER We are looking for an engineer with a strong background in ultrasound, signal processing, image optimization, and programming languages such as Python or C++ to shape our new ultrasound imaging platform. As a Senior Imaging Systems Software Engineer, you will work on characterization,...


  • Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A SENIOR IMAGING SYSTEMS SOFTWARE ENGINEER We are looking for an engineer with a strong background in ultrasound, signal processing, image optimization, and programming languages such as Python or C++ to shape our new ultrasound imaging platform. As a Senior Imaging Systems Software Engineer, you will work on characterization,...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI - the next era of computing - with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world....


  • Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A SENIOR IMAGING SYSTEMS SOFTWARE ENGINEERWe are looking for an engineer with a strong background in ultrasound, signal processing, image optimization, and programming languages such as Python or C++ to shape our new ultrasound imaging platform. As a Senior Imaging Systems Software Engineer, you will work on characterization,...


  • Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A SENIOR IMAGING SYSTEMS SOFTWARE ENGINEERWe are looking for an engineer with a strong background in ultrasound, signal processing, image optimization, and programming languages such as Python or C++ to shape our new ultrasound imaging platform. As a Senior Imaging Systems Software Engineer, you will work on characterization,...


  • Santa Clara, United States Protingent Full time

    WHAT WE NEED FROM YOU AS A SENIOR IMAGING SYSTEMS SOFTWARE ENGINEERWe are looking for an engineer with a strong background in ultrasound, signal processing, image optimization, and programming languages such as Python or C++ to shape our new ultrasound imaging platform. As a Senior Imaging Systems Software Engineer, you will work on characterization,...


  • Santa Clara, United States L4B Software Full time

    Job DescriptionL4B Software is a cutting-edge technology company specializing in Embedded systems and Linux-based solutions. We are at the forefront of innovation, developing advanced software solutions that power a wide range of devices across various industries. As we continue to grow, we are seeking passionate and talented individuals to join our...


  • Santa Clara, CA, United States NVIDIA Full time

    Senior Software Engineer in Infrastructure Development We are looking to hire a Senior Software Engineer who will work in the Test Solutions Group at NVIDIA developing manufacturing test solutions for Datacenter and Enterprise products. In this role, you will collaborate with other key hardware design teams help enable NVIDIA's next generation GPU...


  • Santa Clara, CA, United States NVIDIA Full time

    NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the...


  • Santa Clara, United States NVIDIA Full time

    Senior System Test Engineer page is loaded Senior System Test Engineer Apply locations US, CA, Santa Clara time type Full time posted on Posted 6 Days Ago job requisition id JR1980106 We are looking to hire a System Test Engineer who will work in the test solutions group at NVIDIA developing manufacturing test solutions for Datacenter products. Through HW...


  • Santa Clara, United States NVIDIA Full time

    Senior System Test Engineer page is loaded Senior System Test Engineer Apply locations US, CA, Santa Clara time type Full time posted on Posted 6 Days Ago job requisition id JR1980106 We are looking to hire a System Test Engineer who will work in the test solutions group at NVIDIA developing manufacturing test solutions for Datacenter products. Through HW...