Cloud AI Engineer Lead

1 day ago


San Francisco, California, United States Recruiting from Scratch Full time
Cloud AI Engineer Lead

Recruiting from Scratch is seeking a Cloud AI Engineer Lead to scale our inference systems, handling millions of LLM requests daily.

Key responsibilities include:

  • Designing and implementing large-scale, fault-tolerant systems for AI infrastructure.
  • Architecting and implementing distributed systems for our inference network.
  • Developing resource allocation models across heterogeneous hardware.
  • Optimizing network performance metrics (latency, throughput, availability).
  • Building robust monitoring and observability systems.

The ideal candidate will have 5+ years of experience building high-performance, scalable distributed systems, as well as strong programming skills in TypeScript, Python, and either Go, Rust, or C++.

Experience with Kubernetes/Nomad orchestration, AI tooling (ChatGPT, Claude, Cursor), and GPU programming (CUDA) is a plus. Startup experience (pre-seed to series A) is also required.

The salary range is $180K - $300K + Equity (0.1-3%) | Visa Sponsorship Available, with the location being San Francisco, CA.



  • San Francisco, California, United States Scale AI Full time

    Cloud AI Engineer Position at ScaleWe are seeking an experienced Cloud AI Engineer to join our team at Scale, a leading provider of AI solutions. As a Cloud AI Engineer, you will play a key role in designing and developing our cloud infrastructure platforms and systems.The ideal candidate will have extensive experience in software development and a deep...


  • San Francisco, California, United States Pano AI Full time

    About the RolePano AI is a leader in wildfire early detection, leveraging IoT, AI, satellites, and SaaS software to deliver actionable intelligence to customers. As a Cloud Data Engineer, you will be part of the data platform pod that develops and deploys data ingestion and processing systems.You will develop pipelines to ingest, process, and publish large...


  • San Francisco, California, United States Lambda Inc. Full time

    Lambda Inc. is a cutting-edge AI computing platform that empowers engineers with the tools to deploy AI at scale.We are seeking an experienced Cloud Engineering Lead to oversee the design, implementation, and deployment of our cloud orchestration services.About the RoleThis position requires leadership and technical expertise in cloud-based systems,...


  • San Francisco, California, United States Distyl AI Full time

    About the RoleAs a Lead AI Engineer at Distyl, you will play a key role in shaping the future of AI-driven solutions for enterprises across the globe. Our team is dedicated to developing production-grade AI systems that transform how our clients operate, and we're looking for exceptional talent to join us.Key Responsibilities:Architect and Deliver AI...


  • San Francisco, California, United States Scale AI, Inc. Full time

    Senior Software Engineer, Federal Job DescriptionWe are seeking a highly skilled and motivated Senior Software Engineer to join our dynamic Federal Engineering team at Scale AI, Inc.About the Role:This position plays a critical role in delivering high-impact AI-powered mission solutions for government customers.You will design and implement scalable backend...

  • AI Engineering Lead

    2 days ago


    San Francisco, California, United States Scale AI Full time

    Company OverviewAbout Scale AI:We are a leading AI data foundry, accelerating the development of AI applications. Our mission is to make AI accessible to every organization across industries. We empower businesses to build and deploy AI at scale.At Scale AI, we believe in the transformative power of AI. Our team is dedicated to making AI more accessible,...

  • Cloud AI Engineer

    3 days ago


    San Francisco, California, United States United Software Group Full time

    Job Title: Cloud AI EngineerLocation: San Francisco, CA HybridJob Type: Contract on W2Estimated Salary: $160,000 - $220,000 per yearAbout the JobWe are seeking an experienced Cloud AI Engineer to join our team at United Software Group. As a key member of our cloud engineering team, you will be responsible for designing, developing, and deploying scalable...


  • San Francisco, California, United States Hayden AI Full time

    Transformative Cloud Leadership OpportunityHayden AI is a trailblazing organization that harnesses the power of artificial intelligence and machine learning to address real-world challenges. As our team scales, we're seeking a seasoned Cloud Engineering Director to join our dynamic Cloud Engineering Leadership.You will lead a high-performing team of talented...


  • San Francisco, California, United States Together AI Full time

    Are you a skilled DevOps engineer looking to take your career to the next level? Do you have a passion for designing and building automated infrastructure pipelines? We are seeking a talented Senior DevOps Engineer to join our cloud engineering team at Together AI. About the RoleWe are hiring a highly experienced Senior DevOps Engineer to lead the...


  • San Francisco, California, United States Fractional AI Full time

    About Fractional AIWe're a leading dev shop for applied AI, working with top companies to build high-impact gen AI applications.Our team of senior engineers is dedicated to closing the gap between AI theory and practice, delivering exceptional engineering talent and custom end-to-end AI builds.By joining us, you'll be part of a San Francisco-based team...


  • San Francisco, California, United States Distyl AI Full time

    **Cloud-Agnostic AI Solutions**As a Production AI System Lead at Distyl AI, you will be responsible for architecting and delivering cloud-agnostic AI solutions that meet the complex needs of our F500 clients. With your expertise in enterprise cloud architectures and AI system design, we can ensure seamless deployment and operation of our AI systems in hybrid...


  • San Francisco, California, United States Hayden AI Full time

    About Our MissionHayden AI is transforming the way governments and businesses address real-world challenges using artificial intelligence and machine learning. Our innovative mobile perception system empowers clients to accelerate transit, enhance street safety, and drive forward a sustainable future.What You Will DoThe Cloud Engineering team plays a crucial...


  • San Francisco, California, United States Revery AI Full time

    We are seeking a highly skilled and experienced Senior Cloud Engineer to join our team at Revery AI. In this role, you will be responsible for designing, implementing, and maintaining the company's cloud infrastructure on AWS.Key Responsibilities:Design and implement scalable and secure cloud infrastructure on AWSMigrate existing applications to the cloud...


  • San Francisco, California, United States ZipRecruiter Full time

    Job Title: Cloud-Based AI EngineerWe are seeking a highly skilled Cloud-Based AI Engineer to join our team. As a Cloud-Based AI Engineer, you will be responsible for designing and implementing cloud-based AI solutions that meet the needs of our clients.Responsibilities:Design and implement scalable, secure, and high-performance architectures for our...


  • San Francisco, California, United States Relyance AI Full time

    Job Summary:We're seeking an exceptional Senior Software Engineer - ML to lead the development of our AI solutions. As a key member of the team, you'll collaborate with cross-functional stakeholders to design and build scalable, high-performance systems that meet our customers' needs. Your expertise in machine learning and natural language processing will be...

  • SRE Lead

    1 week ago


    San Francisco, California, United States Operant AI Full time

    Operant AI is seeking an experienced SRE Lead - Cloud Native Applications to build out our Operant's SRE roadmap and functions that help keep our platforms and services resilient and secure.In this role, you will be responsible for building and leading the DevOps/SRE functions for our product, which includes activities around monitoring, incident triaging,...

  • AI Engineering Lead

    2 days ago


    San Francisco, California, United States Wispr AI Full time

    About the RoleWe're looking for a highly skilled Software Engineer to lead our engineering efforts at Wispr AI. As a key member of our team, you will be responsible for designing and developing the software platform across devices.Responsibilities:Developing the software platform across devices, including frontend, backend, mobile, and occasional...


  • San Francisco, California, United States Distyl AI Full time

    Job DescriptionDistyl AI is a leading provider of production-grade AI systems, partnering with OpenAI to deliver customized solutions to Fortune 500 clients. As a Lead AI Engineer at Distyl, you will be responsible for architecting and delivering high-impact AI projects that transform how our customers operate.Key Responsibilities:Develop Production-Grade AI...


  • San Francisco, California, United States Distyl AI, Inc. Full time

    As a pioneer in production-grade AI systems, Distyl AI, Inc. empowers Fortune 500 companies to harness the power of AI.We collaborate with OpenAI, leveraging our expertise in enterprise AI and strategic partnerships to deliver customized AI solutions that drive rapid time-to-value.Our leadership team, comprised of seasoned professionals from top companies...


  • San Francisco, California, United States Oleria Security Full time

    Company OverviewOleria Security is a leading enterprise cybersecurity startup revolutionizing access control solutions for cloud applications. Founded by industry senior leaders, we have received over $43M in funding from notable investors. Our mission is to reduce data breaches by addressing access risks through advanced AI-powered technology.We recognize...