Site Reliability Engineer, AI/ML Infrastructure

1 day ago

Santa Clara, United States Boson AI Full time

About The Role We're looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers. You'll be hands‑on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale. Responsibilities Manage and optimize HPC cluster operations Deploy and maintain infrastructure‑as‑code solutions Support ML/research teams with cluster usage optimization Operate, troubleshoot and optimize Ceph storage clusters. Develop automation and tooling Minimum Qualifications 5+ years of experience in SRE or HPC operations Proficiency in Linux systems administration (Ubuntu/Debian) Experience with Kubernetes and container orchestration Experience with Ceph >1PB deployments and maintenance Knowledge of security best practices in multi‑tenant environments Understanding of L2/L3 networking fundamentals Skilled in Python and Bash scripting Preferred Qualifications Experience with infrastructure‑as‑code tools (Ansible/Terraform) Experience with GitOps (Helm, ArgoCD) Strong grasp of RDMA, InfiniBand, and GPUDirect technologies Familiarity with deep learning frameworks such as PyTorch and TensorFlow Familiarity in at least one cloud platform: AWS, Azure or GCP If you're a natural problem‑solver with a passion for continuous learning, we'd love to hear from you. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. #J-18808-Ljbffr

  • Site Reliability Engineer, AI/ML Infrastructure

    3 weeks ago

    Santa Clara, United States Boson AI Full time

    About The Role We’re looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers. You’ll be hands‑on with the full lifecycle of HPC infrastructure: planning, building,...

  • Network Engineer, AI/ML Infrastructure

    1 day ago

    Santa Clara, United States Boson AI Full time

    About The Role We’re seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You’ll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • Network Engineer, AI/ML Infrastructure

    28 minutes ago

    Santa Clara, California, United States Boson AI Full time $150,000 - $250,000

    About The RoleWe're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage,...

  • AI/ML Infrastructure Engineer – Consulting Staff

    43 minutes ago

    Santa Clara, United States Ll Oefentherapie Full time

    A leading technology firm in Santa Clara is seeking an AI/ML Infrastructure Engineer to design and implement the infrastructure supporting AI initiatives. The ideal candidate will have experience in automation, containerization, and possess strong Linux skills. You will work closely with data scientists and engineers to optimize system performance and ensure...

  • Senior Site Reliability Engineer ML Platforms

    7 days ago

    Santa Clara, United States Promote Project Full time

    Senior Site Reliability Engineer ML PlatformsLocation60000 - 135000 a year (s)DescriptionAre you passionate about building and maintaining large-scale production systems that support advanced data science and machine learning applications? Do you want to join a team at the heart of NVIDIA's data-driven decision-making culture? If so, we have a great...

  • Senior Site Reliability Engineer ML Platforms

    1 day ago

    Santa Clara, United States Promote Project Full time

    Senior Site Reliability Engineer ML PlatformsLocation60000 - 135000 a year (s)DescriptionAre you passionate about building and maintaining large-scale production systems that support advanced data science and machine learning applications? Do you want to join a team at the heart of NVIDIA's data-driven decision-making culture? If so, we have a great...

  • Applied AI Engineering

    2 weeks ago

    Santa Clara, United States Genios AI Full time

    Overview We are a scrappy, data-driven, customer-focused startup revolutionizing financial operations with AI-driven workflow automation. We are looking for an Applied AI Engineer who is first and foremost a strong software engineer with solid foundations in building production systems and a strong applied AI focus. You will be responsible for building...

  • Consulting Member of Technical Staff

    2 weeks ago

    Santa Clara, United States Oracle Full time

    Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks an AI/ML Infrastructure Engineer on the GPU Strategic Customers Engineering team, you will play a critical role in designing, implementing, and maintaining the infrastructure that supports our AI and machine learning initiatives. You will work closely with...

  • AI/ML Networking Engineer for HPC Infrastructure

    24 hours ago

    Santa Clara, United States Boson AI Full time

    A leading AI technology firm based in California is seeking an experienced Network Engineer to design and manage high-performance networking for AI/ML operations. The role involves configuring InfiniBand networks, optimizing performance, and ensuring security. Ideal candidates have over 4 years of experience, strong knowledge of networking protocols, and...

  • Consulting Member of Technical Staff

    43 minutes ago

    Santa Clara, United States Ll Oefentherapie Full time

    Consulting Member of Technical Staff - AI/ML Infrastructure Engineer Trending Job Identification Job Category Product Development Posting Date 12/04/2025, 07:02 PM Job Type Regular Employee Does this position require a security clearance? No Years 10+ years Additional Info Visa / work permit sponsorship is not available for this position Applicants are...