Senior Research Engineer- Optimization

2 months ago


Palo Alto, California, United States Luma Full time

Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

We are looking for engineers with significant problem solving experience in PyTorch, CUDA and distributed systems. You will work with Research Scientists to build & train cutting edge foundation models on thousands of GPUs.

Startup Mindset

  • Value velocity and execution.
  • Communicate clearly.
  • Focus on building what will matter to users and the product.
  • Be resourceful at finding creative ways to overcome challenges.

Experience

  • Experience training large models using Python & Pytorch, including practical experience working with the entire development pipeline from data processing, preparation & data loading to training and inference.
  • Experience with profiling CPU & GPU code in PyTorch, including Nvidia Nsight or similar.
  • Experience writing & improving highly parallel & distributed PyTorch code, with familiarity in DDP, FSDP, Tensor Parallel, etc.
  • Experience writing high-performance parallel C++. Bonus if done within an ML context with PyTorch, like for data loading, data processing, inference code.
  • Experience with high-performance CUDA and writing custom PyTorch kernels. Top candidates will be able to utilize tensor cores; optimize performance with CUDA memory and other similar skills.
  • Good to have experience working with Deep learning concepts such as Transformers & Multimodal Generative models such as Diffusion Models and GANs.
  • Good to have experience building inference / demo prototype code (incl. Gradio, Docker etc.)
  • Please note this role is not meant for recent grads.

Benefits

  • Equity grant to reflect the incredible value you will bring to Luma, with annual refreshes.
  • Excellent salary and benefits.
  • Full health, dental, and vision coverage.
  • Latest and greatest gear.
  • Stipends towards wellness, house cleaner, and phone/internet.
  • Unlimited paid time off with 12 days minimum.
  • Unlimited sick days.

Why Join Luma AI?

  • You will get to work with the world best AI researchers, shipping their research to millions of users around the world
  • You will be equipped with all the tools, technologies, resources and AI tools you need to get the job done
  • We build. We ship. Your work will matter to people.
  • We are building a very widely usable product, and you'll get to work on equally wide variety of challenging problems.
  • We have fantastic traction from early customers, whom you'll get to work directly with.
  • We have backing of some of the best VCs in Silicon Valley, and Angels from across the industry.

Your applications are reviewed by real people.



  • Palo Alto, California, United States Luma Full time

    We are looking for engineers with significant problem solving experience in PyTorch, CUDA and distributed systems. You will work with Research Scientists to build & train cutting edge foundation models on thousands of GPUs. ExperienceExperience training large models using Python & Pytorch, including practical experience working with the entire development...

  • Research Engineer

    2 months ago


    Palo Alto, California, United States Pika Full time

    ROLE: RESEARCH ENGINEERSummary:As a Research Engineer specializing in Machine Learning and Systems Engineering at our company, you will be instrumental in pioneering sophisticated AI solutions. This role demands a unique blend of leadership in conducting end-to-end research projects and technical expertise in building scalable systems. You'll be part of an...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    RI Research Instruments GmbH is dedicated to pioneering multimodal AI technologies that enhance human creativity and capabilities. We recognize that true intelligence requires a multimodal approach. Our focus is on advancing beyond traditional language models to develop systems that can perceive, comprehend, and interact with the world around us. We are in...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Job Title:DERMS & Microgrid Staff/Researcher IVLocation:EPRI Knoxville Office, Palo Alto, CA, Remote/Home BasedJob Summary and Description:EPRI's DERMS team is seeking to fill a Sr Research Scientist position to lead research on emerging technologies in the smart grid including smart inverters, DER Management Systems and Microgrid Controls. The candidate...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    RI Research Instruments GmbH is dedicated to advancing multimodal artificial intelligence to enhance human creativity and capabilities. We recognize that multimodality is essential for true intelligence. Our goal is to transcend traditional language models by integrating vision into our systems. We are focused on developing and scaling multimodal foundation...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Research Engineer, Foundation Models, Self-DrivingTesla is on the lookout for outstanding software engineers to contribute to the development of Tesla AI's foundational models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your...


  • Palo Alto, California, United States Tykhe Inc Full time

    Exciting Opportunity for a Lead Research Scientist/EngineerWe are a dynamic start-up focused on advancing GenAI infrastructure, particularly in the realms of Voice, Audio, Speech, Vision, and Multi-modal platforms.Your Role: As a key player in our organization, you will engage in the design, development, training, fine-tuning, and deployment of...


  • Palo Alto, California, United States PsiQuantum Full time

    About PsiQuantum:At PsiQuantum, we are on a transformative journey to revolutionize the computing landscape through quantum technology. Our mission is to develop the world's first practical quantum computer, which will significantly enhance computational capabilities across various industries.Position Overview:We are seeking a talented Photonics Research...


  • Palo Alto, California, United States Electric Power Research Institute Full time

    Position SummaryThe Electric Power Research Institute (EPRI) is seeking a **Principal Software Engineer** within the **Transmission Operations and Planning** division. This position is pivotal in the creation and execution of innovative software solutions tailored for power systems. You will lead a skilled team, oversee software policy alignment, and engage...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    About RI Research Instruments GmbHAt RI Research Instruments GmbH, we are dedicated to pioneering advancements in multimodal artificial intelligence, enhancing human creativity and capabilities. Our focus is on developing systems that transcend traditional language models, emphasizing the importance of vision in achieving true intelligence.Role OverviewWe...


  • Palo Alto, California, United States Tesla Full time

    Position OverviewAs an AI Research Engineer focusing on Foundation Models for Self-Driving technologies, you will play a crucial role within a dedicated team of deep learning specialists, leveraging one of the largest model training infrastructures globally. Key ResponsibilitiesYour main responsibilities will include training and optimizing large-scale...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is on the lookout for outstanding software engineers to contribute to the development of AI's foundation models. You will collaborate with a select group of elite deep learning specialists to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will facilitate...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is on the lookout for outstanding software engineers to contribute to the development of AI's foundation models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and expand the horizons of AI research and innovation. Your contributions will facilitate...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Foundation Models Research EngineerTesla is in search of outstanding software engineers to advance the development of AI's foundation models. You will collaborate with a select group of elite deep learning professionals to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will facilitate the...


  • Palo Alto, California, United States Tesla, Inc. Full time

    Research Engineer, Foundation Models, Self-DrivingTesla is on the lookout for outstanding software engineers to develop the foundation models for Tesla AI. You will collaborate with a select group of elite deep learning specialists to create cutting-edge neural networks and explore the frontiers of AI research and innovation. Your contributions will...


  • Palo Alto, California, United States RI Research Instruments GmbH Full time

    About the RoleAt RI Research Instruments GmbH, our mission is to innovate and enhance human creativity and capabilities through advanced multimodal AI systems. We recognize that a comprehensive understanding of various modalities is essential for true intelligence.To transcend traditional language models, we are focusing on developing and scaling multimodal...


  • Palo Alto, California, United States Luma Full time

    Luma's mission is to build multimodal AI to expand human imagination and capabilities.We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. We are working on training and scaling up multimodal foundation models for systems...

  • CR Research Associate

    2 months ago


    Palo Alto, California, United States Palo Alto Veterans Institute for Research Full time

    Palo Alto Veterans Institute for Research (PAVIR) is seeking a full-timeClinical Research Associate- Implementation Science Trainee.The Research Associate will be working on research to improve the quality of medical therapy for heart failure. This role will include helping coordinate and lead a multicenter quality improvement study on promoting pharmacist...


  • Palo Alto, California, United States Ford Motor Company Full time

    Job SummaryWe are seeking a highly skilled Senior Powertrain Thermal System Modeling Engineer to join our team at Ford Motor Company. As a key member of our Electric Vehicle Digital Design (EVDD) team, you will play a critical role in developing the next generation of electric powertrain architectures.Key ResponsibilitiesDevelop an integrated powertrain...


  • Palo Alto, California, United States Ford Motor Company Full time

    Job SummaryWe are seeking a highly skilled Senior Powertrain Thermal System Modeling Engineer to join our team at Ford Motor Company. As a key member of our Electric Vehicle Digital Design (EVDD) team, you will play a critical role in developing the next generation of electric powertrain architectures.Key ResponsibilitiesDevelop an integrated powertrain...