Data Lake Engineer

2 weeks ago


Champaign, United States NVIDIA Full time

We are seeking experienced Distributed Systems Engineers to accelerate Apache Spark and related frameworks on GPUs. Apache Spark is the most popular distributed data processing engine in data centers. It is used for a wide variety of workloads, from data preparation, feature generation, reporting, analytics, and more. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features and fit ML algorithms impedes an efficient business workflow. At NVIDIA, we are passionate about working on hard problems that have an impact. You will work with the open source community to enable Apache Spark data processing with GPUs. Data workflows can benefit tremendously from being accelerated, enabling data scientists to explore many more and larger datasets to achieve their business goals, faster and more efficiently.

What you'll be doing:

  • Extending the RAPIDS Accelerator for Apache Spark to work seamlessly with data lake  table formats – including Delta Lake, Apache Iceberg, and Apache Hudi

  • Benchmarking and optimizing data lake table formats at scale with NVIDIA GPUs

  • Optimizing I/O operations on table layout formats and backing stores (distributed filesystems, object stores)

  • Engaging open source communities, including Apache Spark, RAPIDS, and for technical discussions and contributions around data lake table formats

  • Creating a collection of GPU accelerated libraries for data processing, data analytics and ML for compatibility with data lake table formats

  • Working with NVIDIA strategic partners on deploying sophisticated data analytics solutions in public cloud or on-premise clusters

  • Presenting technical solutions in industry conferences and meetups

What we need to see:

  • BS, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience

  • 15+ years of work or research experience in software development

  • 5+ years working with key open source big-data projects as a contributor or committer including Delta Lake, Apache Iceberg, Apache Hudi, Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Storm and Apache Hive

  • Understanding of data management architecture and experience with table formats at large scale

  • Experience with Apache Parquet, Apache ORC, Apache Arrow

  • Outstanding technical skills in crafting and implementing high-quality distributed systems

  • Excellent programming skills in C++, Java, and/or Scala 

  • Knowledge of distributed system schedulers: Kubernetes, Hadoop YARN, Spark standalone

  • Able to work successfully with multi-functional teams across organizational boundaries and geographies

  • Highly motivated with strong communication skills

Ways to stand out from the crowd:

  • Development work on one or more of Delta Lake, Apache Iceberg, Apache Hudi, preferably with contributions back to the open source community  

  • Track record of contributions to major open source projects (such as Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Arrow) 

  • Working experience with acceleration libraries (CUDA, RAPIDS, UCX)


​We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. If you're passionate, creative, and driven, we'd love to have you join the team. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 268,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  • Champaign, United States NVIDIA Full time

    We are seeking expert System Software Engineers to join our Apache Spark Acceleration team. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. NVIDIA believes that data science and analytics workflows can benefit tremendously from being accelerated, to enable data users to explore more and...

  • Electrical Engineer

    4 weeks ago


    Champaign, United States Clark Dietz Full time

    Clark Dietz, Inc. is a Midwest based, employee owned, multi-discipline consulting engineering firm. We are a recognized leader in transportation, civil, environmental, mechanical and electrical engineering. Our depth of talent across disciplines allows our staff the opportunity to collaborate and serve our clients with innovative, sustainable solutions.We...

  • Electrical Engineer

    2 days ago


    Champaign, United States Clark Dietz Full time

    Clark Dietz, Inc. is a Midwest based, employee owned, multi-discipline consulting engineering firm. We are a recognized leader in transportation, civil, environmental, mechanical and electrical engineering. Our depth of talent across disciplines allows our staff the opportunity to collaborate and serve our clients with innovative, sustainable solutions. We...

  • Electrical Engineer

    2 days ago


    Champaign, United States Clark Dietz Full time

    Job DescriptionJob DescriptionClark Dietz, Inc. is a Midwest based, employee owned, multi-discipline consulting engineering firm. We are a recognized leader in transportation, civil, environmental, mechanical and electrical engineering. Our depth of talent across disciplines allows our staff the opportunity to collaborate and serve our clients with...


  • Champaign, United States SteveRecruiter, LLC Full time

    Microelectronics Engineer - Pulsed Power SupplyPart of the technical engineering team to support applied R&D on the next-generation pulsed power supply (Switched-mode DC power Supplies). In an R&D prototyping environment and production facilityPassionate about your workHands-on with full lifecycle product developmentMultiple industry; Medical Device, EV,...


  • Champaign, United States SteveRecruiter, LLC Full time

    Microelectronics Engineer - Pulsed Power SupplyPart of the technical engineering team to support applied R&D on the next-generation pulsed power supply (Switched-mode DC power Supplies). In an R&D prototyping environment and production facilityPassionate about your workHands-on with full lifecycle product developmentMultiple industry; Medical Device, EV,...


  • Champaign, United States SteveRecruiter, LLC Full time

    Microelectronics Engineer - Pulsed Power Supply Part of the technical engineering team to support applied R&D on the next-generation pulsed power supply (Switched-mode DC power Supplies). In an R&D prototyping environment and production facility Passionate about your work Hands-on with full lifecycle product development Multiple industry; Medical Device,...


  • Champaign, United States SteveRecruiter, LLC Full time

    Microelectronics Engineer - Pulsed Power SupplyPart of the technical engineering team to support applied R&D on the next-generation pulsed power supply (Switched-mode DC power Supplies). In an R&D prototyping environment and production facilityPassionate about your workHands-on with full lifecycle product developmentMultiple industry; Medical Device, EV,...

  • Civil Engineer

    3 weeks ago


    Champaign, United States Fehr Graham Full time

    We are looking for a motivated and experienced civil engineer with preference given to candidates who have an interest in municipal engineering, site design or transportation to join our team. We are talented, trustworthy and skilled people who are passionate about what we do and enjoy providing personalized attention to our clients. **Responsibilities** *...

  • Software Engineer

    2 weeks ago


    Champaign, United States NVIDIA Full time

    NVIDIA's products, hardware and software, are world leaders for performance and efficiency. We are continually innovating in creative ways to improve our ability to deliver outstanding solutions across a wide range of sectors. We are seeking System Software Engineers who are passionate about what they do and are committed to making a difference in the world...


  • Champaign, United States Zmodo AI Inc Full time

    Job DescriptionJob DescriptionSalary: Infrastructure EngineerAt Smartz Inc, we rely on our dynamic team of engineers to solve the many challenges and puzzles that come with our rapidly evolving technical stack. We are seeking a results-oriented database engineer to help optimize the performance of our organization's databases. You will be enhancing our...

  • Packaging Engineer

    1 week ago


    Champaign, United States Cyient Full time

    Our customers and their equipment are hard at work in every corner of the globe, and they can’t afford to slow down or stop. They need our machines, engines and parts to do the world’s work. That’s what our logistics team makes possible—using the latest digital, analytics and data forecasting tools to move material where it needs to be, when it needs...


  • Champaign, United States NVIDIA Full time

    We are seeking experienced System Software Engineers adept at Apache Spark to join our team to help drive innovation for accelerated data processing on GPUs.  As Nvidia is leading the world in accelerated computing, we are building the next generation data processing ecosystem. Data scientists spend a considerable amount of time exploring data and...

  • Production Engineer

    2 weeks ago


    Champaign, United States Primient Full time

    Production Engineer Decatur, IL Ready for a fast-track start to your engineering career? Join a market a leader in ingredient manufacturing that is investing in its people, plants and technologies. ABOUT PRIMIENTEstablished yet entrepreneurial: Primient is an industry leader with proven products, six manufacturing plants, 1500+ employees and deep roots in...

  • Electrical Engineer

    6 days ago


    Champaign, United States Affinity Inc Full time

    Any of these types of backgrounds are a potential fit: Electronic Engineer | Electrical Engineer | Pulsed Power Supply | HV Circuit Design Hands-on with full lifecycle product development. From concept to customer sign-off and support. See your work and ideas take shape and build to a successful delivery to multiple industries. Join the technical engineering...

  • Civil Engineer

    7 hours ago


    Champaign, United States Clark Dietz Full time

    Clark Dietz, Inc. is an employee owned, multi-discipline consulting engineering firm with offices in Illinois, Indiana, Kentucky, Michigan, and Wisconsin. We are a recognized leader in transportation, civil, environmental, water/wastewater, structural, mechanical, and electrical engineering. Our depth of talent across disciplines allows our staff the...

  • Civil Engineer

    5 days ago


    Champaign, United States Clark Dietz Full time

    Job DescriptionJob DescriptionClark Dietz, Inc. is an employee owned, multi-discipline consulting engineering firm with offices in Illinois, Indiana, Kentucky, Michigan, and Wisconsin. We are a recognized leader in transportation, civil, environmental, water/wastewater, structural, mechanical, and electrical engineering. Our depth of talent across...

  • Production Engineer

    2 weeks ago


    Champaign, United States Primient Full time

    Production Engineer Decatur, IL Ready for a fast-track start to your engineering career? Join a market a leader in ingredient manufacturing that is investing in its people, plants and technologies. ABOUT PRIMIENT Established yet entrepreneurial: Primient is an industry leader with proven products, six manufacturing plants, 1500+ employees and deep roots...

  • Senior NOC Engineer

    4 weeks ago


    Champaign, United States Pavlov Media Inc Full time

    Job DescriptionJob DescriptionPosition Summary:The Senior Backbone NOC Engineer is responsible for engineering, operations and maintenance of the Pavlov Media national network. You’ll be involved with the planning, installation, and management of the hardware and backbone engineering as well as the day to day operations of the network. This is the...


  • Champaign, United States Henneman Engineering, Inc Full time

    **Company**:Come join the team at Henneman Engineering! Henneman Engineering is a full-service, multi-disciplinary engineering design and consulting firm. We are headquartered in Champaign, Illinois and have additional offices throughout the Midwest, including offices in Waukesha and Madison, Wisconsin. Over the decades, Henneman Engineering has proven...