Senior Research Engineer- Optimization

4 weeks ago


Palo Alto, California, United States Luma Full time

We are looking for engineers with significant problem solving experience in PyTorch, CUDA and distributed systems. You will work with Research Scientists to build & train cutting edge foundation models on thousands of GPUs.

Experience

  • Experience training large models using Python & Pytorch, including practical experience working with the entire development pipeline from data processing, preparation & data loading to training and inference.
  • Experience with profiling CPU & GPU code in PyTorch, including Nvidia Nsight or similar.
  • Experience writing & improving highly parallel & distributed PyTorch code, with familiarity in DDP, FSDP, Tensor Parallel, etc.
  • Experience writing high-performance parallel C++. Bonus if done within an ML context with PyTorch, like for data loading, data processing, inference code.
  • Experience with high-performance CUDA and writing custom PyTorch kernels. Top candidates will be able to utilize tensor cores; optimize performance with CUDA memory and other similar skills.
  • Good to have experience working with Deep learning concepts such as Transformers & Multimodal Generative models such as Diffusion Models and GANs.
  • Good to have experience building inference / demo prototype code (incl. Gradio, Docker etc.)
  • Please note this role is not meant for recent grads.

Your applications are reviewed by real people.



  • Palo Alto, California, United States Luma Full time

    Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for...


  • Palo Alto, California, United States OPPO US Research Center Full time

    Job OverviewWe are seeking a highly skilled Senior Machine Learning Engineer to join our Research and Development team at OPPO US Research Center. As a key member of our technology innovation leadership team, you will play a crucial role in refining our recommender system, search algorithms, and ad targeting algorithms.Key ResponsibilitiesLead Algorithmic...

  • Research Engineer

    2 months ago


    Palo Alto, California, United States Pika Full time

    ROLE: RESEARCH ENGINEERSummary:As a Research Engineer specializing in Machine Learning and Systems Engineering at our company, you will be instrumental in pioneering sophisticated AI solutions. This role demands a unique blend of leadership in conducting end-to-end research projects and technical expertise in building scalable systems. You'll be part of an...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    RI Research Instruments GmbH is dedicated to pioneering multimodal AI technologies that enhance human creativity and capabilities. We recognize that true intelligence requires a multimodal approach. Our focus is on advancing beyond traditional language models to develop systems that can perceive, comprehend, and interact with the world around us. We are in...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Job Title:DERMS & Microgrid Staff/Researcher IVLocation:EPRI Knoxville Office, Palo Alto, CA, Remote/Home BasedJob Summary and Description:EPRI's DERMS team is seeking to fill a Sr Research Scientist position to lead research on emerging technologies in the smart grid including smart inverters, DER Management Systems and Microgrid Controls. The candidate...


  • Palo Alto, California, United States PsiQuantum Full time

    Position: Photonics Research Engineer at PsiQuantumAt PsiQuantum, we are at the forefront of quantum computing innovation, committed to transforming industries globally. We are currently in search of a skilled Photonics Research Engineer to become an integral part of our innovative team.Role Overview:Develop, execute, and refine advanced experimental...


  • Palo Alto, California, United States SmartNews Full time

    Job DescriptionAbout SmartNewsSmartNews is a global leader in redefining information and news discovery, committed to providing users with accurate, timely information and supporting quality journalism. We combine the power of our unique machine-learning technology with the expertise of our first-rate editorial team to bring news that matters to millions of...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    RI Research Instruments GmbH is dedicated to advancing multimodal artificial intelligence to enhance human creativity and capabilities. We recognize that multimodality is essential for true intelligence. Our goal is to transcend traditional language models by integrating vision into our systems. We are focused on developing and scaling multimodal foundation...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Research Engineer, Foundation Models, Self-DrivingTesla is on the lookout for outstanding software engineers to contribute to the development of Tesla AI's foundational models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your...


  • Palo Alto, California, United States Tykhe Inc Full time

    Exciting Opportunity for a Lead Research Scientist/EngineerWe are a dynamic start-up focused on advancing GenAI infrastructure, particularly in the realms of Voice, Audio, Speech, Vision, and Multi-modal platforms.Your Role: As a key player in our organization, you will engage in the design, development, training, fine-tuning, and deployment of...


  • Palo Alto, California, United States PsiQuantum Full time

    About PsiQuantum:At PsiQuantum, we are on a transformative journey to revolutionize the computing landscape through quantum technology. Our mission is to develop the world's first practical quantum computer, which will significantly enhance computational capabilities across various industries.Position Overview:We are seeking a talented Photonics Research...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Job SummaryThis is a challenging role that requires a highly skilled and experienced professional to conduct research in complex technical or scientific fields. The successful candidate will be responsible for leading technical activities, providing guidance to junior staff, and communicating complex strategies and results to subject matter experts and...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Position SummaryThe Electric Power Research Institute (EPRI) is seeking a **Principal Software Engineer** within the **Transmission Operations and Planning** division. This position is pivotal in the creation and execution of innovative software solutions tailored for power systems. You will lead a skilled team, oversee software policy alignment, and engage...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    About RI Research Instruments GmbHAt RI Research Instruments GmbH, we are dedicated to pioneering advancements in multimodal artificial intelligence, enhancing human creativity and capabilities. Our focus is on developing systems that transcend traditional language models, emphasizing the importance of vision in achieving true intelligence.Role OverviewWe...


  • Palo Alto, California, United States Tesla Full time

    Position OverviewAs an AI Research Engineer focusing on Foundation Models for Self-Driving technologies, you will play a crucial role within a dedicated team of deep learning specialists, leveraging one of the largest model training infrastructures globally. Key ResponsibilitiesYour main responsibilities will include training and optimizing large-scale...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is in search of outstanding software engineers to advance the development of AI's foundation models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will facilitate the...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is on the lookout for outstanding software engineers to contribute to the development of AI's foundation models. You will collaborate with a select group of elite deep learning specialists to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will facilitate...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is on the lookout for outstanding software engineers to contribute to the development of AI's foundation models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and expand the horizons of AI research and innovation. Your contributions will facilitate...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Research Engineer, Foundation Models, Self-DrivingTesla is on the lookout for outstanding software engineers to develop the foundation models for Tesla AI. You will collaborate with a select group of elite deep learning specialists to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Position SummaryThe Electric Power Research Institute (EPRI) is seeking a **Principal Software Engineer** within the **Transmission Operations and Planning** division. This pivotal role involves leading the development and execution of advanced software solutions for power systems. You will oversee a skilled team, manage software policy alignment, and engage...