AI Infrastructure Developer

1 week ago

San Francisco, California, United States Acceler8 Talent Full time
About the Position:
We are looking for an experienced AI Infrastructure Developer to join our team at Acceler8 Talent. As an AI Infrastructure Developer, you will be responsible for designing and implementing scalable machine learning and distributed systems for Large Language Models. You will also optimize under the hood to create high-performing infrastructure with custom kernels.

Your Key Responsibilities:
1. Collaborate on delivering captivating experiences through Large Language Models.
2. Design and implement scalable machine learning and distributed systems for LLMs.
3. Innovate at lower stack levels, creating high-performing infrastructure with custom kernels.

Requirements:
- Experience in training LLMs using Megatron, DeepSpeed, etc., and deploying with vLLM, TGI, TensorRT-LLM, etc.
- Strong grasp of AI accelerator architectures such as TPU, IPU, HPU, and their associated tradeoffs.
- Proficient in working under-the-hood with kernel languages like OAI Triton, Pallas, and compilers like XLA.

  • Software Engineer, AI Infrastructure

    2 weeks ago

    San Francisco, California, United States WaveForms AI Full time

    Job title: Software Engineer, AI Infrastructure (Training + Inference) / Member of Technical Staff Who We Are WaveForms AI is an Audio Large Language Models (LLMs) company building the future of audio intelligence through advanced research and products. Our models will transform human-AI interactions making them more natural, engaging and immersive. Role...

  • Distributed AI Infrastructure Engineer

    6 days ago

    San Francisco, California, United States Together AI Full time

    About Together AIWe are a research-driven artificial intelligence company. Our mission is to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models.Our team has made significant contributions to open-source research, models, and datasets that advance the frontier of AI. We invite you to join our...

  • Software Engineer, AI Infrastructure

    4 weeks ago

    San Francisco, California, United States Waveforms AI, Inc Full time

    Job title:Software Engineer, AI Infrastructure (Training + Inference) / Member of Technical StaffWho We Are WaveForms AI is an Audio Large Language Models (LLMs) company building the future of audio intelligence through advanced research and products. Our models will transform human-AI interactions making them more natural, engaging and immersive.Role...

  • Senior AI Infrastructure Engineer

    4 weeks ago

    San Francisco, California, United States Together AI Full time

    As a Senior AI Infrastructure Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI's rapid growth.This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and provides a cohesive...

  • Senior AI Infrastructure Engineer

    2 weeks ago

    San Francisco, California, United States Together AI Full time

    About the Role As a Senior AI Infrastructure Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI's rapid growth. This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and...

  • AI Infrastructure Specialist

    2 weeks ago

    San Francisco, California, United States The Rundown AI, Inc. Full time

    About the RoleThe Rundown AI, Inc. is seeking a highly skilled Machine Learning Systems Engineer to join its Model Evaluations team. As a member of this team, you will be responsible for designing, building, and maintaining scalable systems that enable researchers to effectively evaluate models and conduct inference tasks critical to the organization's...

  • AI Infrastructure Specialist

    2 weeks ago

    San Francisco, California, United States The Rundown AI, Inc. Full time

    About the RoleThe Rundown AI, Inc. is seeking an AI Infrastructure Specialist to join our Data Encodings and Tokenization team. As a key member of our team, you'll play a crucial role in developing and optimizing the encodings and tokenization systems used throughout our Finetuning workflows.This position requires a strong understanding of machine learning...

  • Senior AI Infrastructure Engineer

    5 days ago

    San Francisco, California, United States Together AI Full time

    As a Senior AI Infrastructure Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI's rapid growth.This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and provides a cohesive...

  • Strategic Product Manager

    2 weeks ago

    San Francisco, California, United States Snorkel AI Full time

    We're on a mission to make machine learning accessible to everyone. At Snoekl AI, we're building the definitive AI data development platform.The AI landscape has undergone significant changes over the years, but one thing remains constant: high-quality data is essential for achieving differentiation, high performance, and production-ready systems.Our...

  • AI Systems Infrastructure Specialist

    2 weeks ago

    San Francisco, California, United States The Rundown AI, Inc. Full time

    About The Rundown AI, Inc.Company OverviewThe Horizons team at The Rundown AI, Inc. leads the development of our company's reinforcement learning research and advancements in AI systems. We've made significant contributions to all Claude models, with substantial impacts on the autonomy and coding capabilities of Claude 3.5 and 3.7 Sonnet.About the RoleAs an...