Senior Software Engineer

5 days ago

San Francisco, California, United States AI Fund Full time $150,000 - $250,000 per year

About Baseten
Baseten powers inference for the world's most dynamic AI companies, like

THE ROLE
As a Senior Infrastructure Software Engineer at Baseten, you'll architect and lead development of our ML inference platform that powers production AI applications. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.

EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Infrastructure team:

Responsibilities

  • Design and architect scalable infrastructure systems for our ML inference platform
  • Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
  • Drive enhancements to our inference orchestration layer for complex model deployments
  • Define monitoring strategies for model performance, latency, and resource utilization
  • Develop advanced solutions for GPU capacity management and throughput optimization
  • Establish infrastructure automation standards to streamline ML deployment workflows
  • Partner with other engineers to translate complex inference requirements into technical solutions
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap

Requirements

  • Bachelor's degree or higher in Computer Science or related field
  • 5+ years experience building production infrastructure systems
  • Expert-level proficiency in Go, with Python experience a plus
  • Deep expertise with Kubernetes in production environments
  • Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus.
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Track record of leading technical initiatives and mentoring engineers
  • Experience with ML/AI workloads and MLOps platforms highly valued

Benefits

  • Competitive compensation package.
  • This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
  • An inclusive and supportive work culture that fosters learning and growth.
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now
to embark on a rewarding journey in shaping the future of AI If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

  • Software Engineer

    3 days ago

    San Francisco, California, United States Beacon Software Full time $120,000 - $250,000 per year

    Beacon Software is a permanent capital holding company which acquires and grows essential businesses. We are a profitable series B+ firm that combines great technologists, operators and M&A professionals to accelerate the scale of the ambition of the dozens of businesses we own and operate. We are supported by capital from tier-1 venture capital, crossover,...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States Raydar Full time $160,000 - $320,000 per year

    Senior Software Engineer — ProductSan Francisco, CA (In-Person, 5 Days/Week)$200K–$320K base + 0.1–0.3% equityAbout the Role:We're partnering with afast-growing AI startupthat's redefining how the insurance broking industry operates. The company builds automation tools that turn hours of manual work into minutes, transforming how brokers process data,...

  • Senior Software Engineer

    20 hours ago

    San Francisco, California, United States ektello Full time $120,000 - $240,000 per year

    Full Stack / Front End Software EngineerUnable to support C2C rate structuresRate: Highly Negotiable /hr. or +Contract Length: 12 + month contract to (hire + multi-extension capabilityLocation Expectations: RemoteAbility for Conversion & Extension: YESUNABLE TO SUPPORT C2CWhy Join UsAs a Full-Stack/Front-End Senior Software Engineer on the Products team, you...

  • Senior Software Engineer – Erlang

    3 days ago

    San Francisco, California, United States ActiveSoft Full time $160,000 - $180,000 per year

    Job Title: Senior Software Engineer – ErlangLocation: Bay Area, San Francisco (Hybrid)Job Type: Full-TimeJob Description:We are seeking a Senior Software Engineer with hands-on Erlang experience to design, develop, and optimize high-performance, distributed software systems for robotics and automation platforms. You will collaborate with cross-functional...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States Bright Machines Full time $160,000 - $230,000 per year

    RETHINK MANUFACTURING  The only way to ignite change is to build the best team. At Bright Machines, we're innovators and experts in our craft who have joined together to create a new category of manufacturing that will help transform the industry. We believe software and data are the answer, thoughtfully applied to solve our customers' unique...

  • Senior Software Engineer

    1 day ago

    San Francisco, California, United States Experts Group International Full time $150,000 - $250,000 per year

    About The RoleA leading provider in AI cloud infrastructure is seeking a Senior or Staff Software Engineer – DCIM (Data Center Infrastructure Management) to own the development of internal tooling that optimizes how they buy, track, deploy, and manage data center hardware across a growing global footprint.This high-impact, cross-functional role will sit at...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States griddable Full time

    DescriptionOur Salesforce Database (SDB) team provided a highly available database for Salesforce applications. Within the large SDB team, we provide a highly durable and available distributed storage for public clouds. We are defining the next generation of trusted enterprise computing in the cloud. We're a fast-paced, metrics driven team. We're highly...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States The Judge Group Full time $120,000 - $180,000 per year

    Job Title: Software EngineerLocation: San Francisco Bay Area, CA OR Urbandale, IADuration: 1+ YearsNote: Only w2 Candidate. No Corp-CorpJob Description:Client is looking for highly technical and self-directed Senior Software Engineer to contribute to the development of data processing pipelines for a new AI-enabled data analytics product targeted at Large Ag...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States SecurityPal, Inc. Full time $170,000 - $200,000

    SecurityPal is on a mission to accelerate trust on the internet. We streamline and automate the security review process for growing companies, helping them close deals faster, build buyer confidence, and stay compliant in an increasingly complex digital landscape.We're a post–Series A startup backed by world-class investors, already profitable, and growing...

  • Senior Software Engineer

    5 days ago

    San Francisco, California, United States CoinList Full time $128,000 - $179,000 per year

    About CoinListCoinList is a leading crypto financial platform supporting the full lifecycle of crypto investment. We offer a comprehensive suite of services, including token sales, trading, lending, staking, and access to DeFi opportunities. CoinList has helped raise over $1.1 billion for groundbreaking projects, establishing itself as the go-to platform for...