GPU Acceleration Specialist

3 days ago


Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time
About Tensorwave Inc.

We are seeking a skilled Machine Learning Engineer to join our team at TensorWave. As a pioneer in AI computing, we're revolutionizing the industry with our cutting-edge cloud services powered by AMD Instinct MI300x GPUs. Our mission is to accelerate AI innovation by overcoming hardware limitations and delivering scalable, efficient solutions for AI workloads.

About the role:

In this pivotal position, you will empower our customers by supporting innovative tools and techniques for fine-tuning and training deep learning models on AMD GPUs. Your work will directly contribute to the growth of the ROCm ecosystem and the advancement of PyTorch on AMD hardware, enabling users to harness the full potential of our AI cloud services.

Key Responsibilities:
  • Contribute to open-source deep learning libraries like PyTorch, advocating for and implementing ROCm support and enhancements.
  • Develop in-house frameworks and tools that simplify and streamline model fine-tuning and training for our customers.
  • Debug and identify compatibility issues with libraries, and collaborate with internal and external teams to resolve them.
  • Design and develop optimization strategies to accelerate fine-tuning and training of deep learning models on AMD GPUs.
  • Conduct in-depth research and performance analysis to identify and address bottlenecks in the AMD GPU acceleration pipeline.
  • Stay at the forefront of advancements in deep learning, GPU acceleration, and model optimization techniques, particularly those related to ROCm and AMD hardware.
Requirements:
  • Equivalent of a Bachelor's Degree in Computer Science, Artificial Intelligence, or a related field.
  • 3+ years of hands-on experience with PyTorch training and fine-tuning deep learning models.
  • Strong understanding of GPU architecture, memory management, and optimization techniques.
  • Proficiency in Python and C/C++ for implementing high-performance deep learning models.
  • Extensive experience with LLM / transformer architecture and a deep understanding of its internals.
  • Experience with GPU kernel development (CUDA or ROCm) for deep learning applications.
  • Excellent communication and collaboration skills, with the ability to effectively engage with both technical and non-technical audiences.
Nice to Have:
  • Experience with Triton or other model deployment frameworks.
  • Experience with distributed training across GPU clusters.
  • Familiarity with networking protocols and technologies, especially in the context of HPC and AI.
  • Contributions to open-source deep learning projects, particularly those focused on training / fine-tuning / optimizing LLMs.
  • Familiarity with Python profiling and benchmarking tools.
  • Familiarity with ROCm and its ecosystem, including libraries like hipBLAS and MIOpen.
  • GDB Benchmarking/ Profiling/ Stacktrace
Our Offer:

We offer a competitive salary range of $140,000 - $200,000 per annum, plus benefits, including:
  • Stock Options
  • 100% paid Medical, Dental and Vision Benefits for employees
  • Life and Voluntary supplemental life insurance
  • Short-term disability insurance
  • Flexible Spending Account
  • 401(k)
  • Flexible PTO
  • Paid Holidays
  • Parental Leave
  • Mental Health Benefits through Spring Health


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave Inc.We are pushing the boundaries of AI computing by leveraging the power of AMD Instinct MI300x GPUs. Our aim is to accelerate AI innovation by overcoming hardware constraints and delivering scalable solutions for AI workloads.About the role:Tensorwave is seeking a seasoned expert with a proven track record in training and fine-tuning deep...


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave Inc.We're a cutting-edge technology company revolutionizing AI computing by offering advanced cloud services, highlighted by our deployment of AMD Instinct MI300x GPUs. Our mission is to accelerate AI innovation by removing hardware limitations and ensuring scalable, efficient solutions for AI workloads.Job Overview:We're seeking a driven AI...


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave, Inc.Tensorwave, Inc. is a pioneering company in the field of AI computing, leveraging advanced cloud services and cutting-edge technology to accelerate innovation. With a focus on removing hardware limitations, we strive to provide scalable and efficient solutions for AI workloads.The Role:We are seeking an exceptional Senior AI...


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave Inc.We are driving innovation in AI computing by deploying the latest AMD Instinct MI300x GPUs. Our goal is to accelerate AI progress by addressing hardware constraints and providing scalable solutions for AI workloads.About the position:Tensorwave is looking for an expert who can leverage their knowledge of PyTorch, open-source AI...


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave Inc. We're revolutionizing AI computing at TensorWave by offering cutting-edge cloud services powered by advanced AMD Instinct MI300x GPUs. Our mission is to accelerate AI innovation by overcoming hardware limitations and delivering scalable, efficient solutions for AI workloads. About the role: This pivotal position empowers our customers...


  • Sens, Bourgogne-Franche-Comté, United States Tensorwave, Inc. Full time

    About Tensorwave Inc. TensorWave is leading the charge in AI computing by leveraging cutting-edge cloud services powered by advanced AMD Instinct MI300x GPUs. Our mission is to accelerate AI innovation by removing hardware limitations and delivering scalable, efficient solutions for AI workloads. About the role: In this pivotal position, you will empower our...

  • Nurse Specialist

    2 weeks ago


    Sens, Bourgogne-Franche-Comté, United States OneStaff Medical Full time

    We are seeking a highly skilled Nurse Specialist to join our team for an Oncology travel assignment in Las Vegas, Nevada. As a valued member of our team, you will have the opportunity to work with a dynamic and experienced group of healthcare professionals who share your passion for delivering exceptional patient care.The ideal candidate will possess strong...


  • Sens, Bourgogne-Franche-Comté, United States Epic Travel Staffing Allied Full time

    About the JobEpic Travel Staffing Allied is seeking a skilled Interventional Radiology Technologist to join their team. As a travel imaging specialist, you will have the opportunity to work in Las Vegas, Nevada, and gain valuable experience in a dynamic healthcare environment.Job SummaryThis 13-week contract position requires an experienced technologist with...


  • Sens, Bourgogne-Franche-Comté, United States FYZICAL LLC Full time

    About the Role:">FYZICAL LLC, a leading provider of physical therapy services, is seeking a passionate and licensed Physical Therapist to join our team at our Las Vegas (Buffalo) location.">Key Responsibilities:">">Assess and interpret patient evaluations and test results.">Develop and implement personalized treatment plans.">Create fitness-oriented...