Software Engineer

2 months ago


San Francisco, United States Baseten Full time

ABOUT BASETEN

We’re a growing team of builders backed by top-tier investors, including IVP, Spark Capital, Greylock, and Sarah Guo at Conviction. ML teams at enterprises and category-defining AI-native companies like Descript, Bland.ai, Patreon, Writer, and Robust Intelligence use Baseten to power their core production workloads with best-in-class performance, security, and reliability. While we’ve unlocked PMF and secured Series B funding, the ML infrastructure market is massive, and we’re just getting started. If you’re excited to work on engaging and relevant problems while building something new from the ground up, come join us

THE ROLE

Are you passionate about advancing the frontiers of artificial intelligence? We are looking for a Senior Software Engineer focused on model performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of machine learning. If you are a backend engineer who thrives on making things faster and is excited about open source ML models, we look forward to your application.

RESPONSIBILITIES:

  • Implement, refine, and productionize cutting-edge techniques for ML model inference and infrastructure.

  • Deep dive into underlying codebases of TensorRT, PyTorch, Transformers, CUDA, and other libraries to debug ML performance issues.

  • Apply and scale optimization techniques across a wide range of ML models, particularly large language models.

  • Collaborate with a diverse team to design and implement innovative solutions.

  • Own projects from idea to production, including writing project specs and managing end-to-end feature implementation.

REQUIREMENTS:

  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.

  • 3+ years of work professional work experience in a fast-paced, high-growth environment.

  • Experience with one or more general-purpose programming languages, such as Python, C++, or Go.

  • Deep understanding of software engineering principles and a proven track record of developing and deploying AI/ML inference solutions.

  • Strong familiarity with ML libraries, especially PyTorch, TensorRT, or TensorRT-LLM.

  • Demonstrated interest and experience in machine learning and large language models.

  • Deep understanding of GPU architecture.

  • Experience with Docker and Kubernetes.

  • Experience and interest in growing and leading a team is highly valued.

BONUS POINTS:

  • Proficiency in enhancing the performance of software systems, particularly in the context of large language models (LLMs).

  • Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous batching).

  • Experience with CUDA or similar technologies.

BENEFITS:

  • Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums).

  • A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.

  • An inclusive and supportive work culture that fosters learning and growth.

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply Now to embark on a rewarding journey in shaping the future of AI If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.



  • San Francisco, California, United States Intelliswift Software Full time

    Job Title: Cloud Native Software EngineerAbout the Job:We are seeking an experienced Cloud Native Software Engineer to join our team at Intelliswift Software. This is a full-time, hybrid position that requires 12+ months of commitment.Key Responsibilities:Collaborate with our Personalization Team to develop and implement solutions that enhance user...

  • Software Engineer

    4 weeks ago


    San Francisco, United States Sara Software Systems Full time

    bem Share this job San Francisco, CA, USA Full Time Role Highlights Computer Science Integrations Software Systems LLMs AI Tools, Libraries and Frameworks Description The company leverages LLMs to create a new interface between humans and systems to build robust and scalable software solutions. The role involves working directly with founders to...


  • San Francisco, California, United States ONE INC SOFTWARE CORPORATION Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer Role to join our team at ONE INC SOFTWARE CORPORATION. As a key member of our software engineering team, you will be responsible for leading the development of our cutting-edge SaaS Insurance Payments platform.The successful candidate will have a strong background in software engineering,...


  • San Francisco, California, United States ONE INC SOFTWARE CORPORATION Full time

    Job OverviewWe are seeking a skilled Software Engineering Team Lead to join our team at ONE INC SOFTWARE CORPORATION. This is an exceptional opportunity to lead a talented group of developers and contribute to the success of our cutting-edge SaaS Insurance Payments platform.The successful candidate will have a proven track record of leading high-performing...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Triunity Software Full time

    We are seeking a talented Software Engineer - Angular and Java Expert to join our team at Triunity Software in Montreal, QC Canada. This is a hybrid role with flexible work-from-home options available.About the RoleIn this role, you will have the opportunity to design, develop, and maintain complex web applications using Angular, Java, and microservices. You...


  • San Antonio, Texas, United States Captivation Software Full time

    About Captivation SoftwareCaptivation Software is a reputable organization built on providing high-quality software solutions to its clients. Our team of engineers takes pride in developing innovative software capabilities that meet the evolving needs of our customers.


  • San Francisco, California, United States ONE INC SOFTWARE CORPORATION Full time

    Job OverviewWe are seeking a highly skilled and experienced Senior Software Engineering Team Lead to join our team at ONE INC SOFTWARE CORPORATION. This is an exciting opportunity to lead a team of developers in designing and implementing innovative solutions for the insurance industry.Key ResponsibilitiesLead and manage a global team of software engineers...


  • San Antonio, Texas, United States Captivation Software Full time

    Job Title: Software Engineer Lead PositionWe are seeking a skilled and experienced Software Engineer to join our team at Captivation Software. As a Software Engineer, you will be responsible for designing, developing, and implementing complex software capabilities for computer-based systems.About the Role:You will work closely with other talented engineers...


  • San Francisco, California, United States Triunity Software Full time

    Triunity Software Inc. is a leading provider of software solutions and services in North America. We are seeking an experienced Sr Java Developer to join our team and contribute to the development of our software products.About the RoleThe ideal candidate will have a strong background in Java development and experience with microservices architecture. You...


  • San Leandro, California, United States United Software Group Full time

    Job Title: Senior Software EngineerOverview:United Software Group is a leading technology company seeking an experienced Senior Software Engineer to join our team. With a focus on innovative solutions, we are committed to delivering high-quality products that meet the needs of our clients.About the Role:The successful candidate will be responsible for...


  • san francisco, United States TALENT Software Services Full time

    Are you an experienced Oracle Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Oracle Engineer to work at their company in San Francisco, CA.Position Summary: The Financial Solutions team, part of the broader CIO organization, is looking for a proactive and collaborative...


  • San Leandro, California, United States United Software Group Full time

    Job Title: Senior Java Software EngineerAbout the Role:United Software Group is seeking an experienced Senior Java Software Engineer to join our team in San Leandro, CA. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining high-quality software applications using Java 11+ and Spring/SpringBoot...


  • san francisco bay area, United States Intelliswift Software Full time

    Sr Fullstack Software Engineer12+ Months / Full time with IntelliswiftHybrid – 2days OnsiteSan Francisco CAResponsibilities:• Collaborate with the Personalization Team to develop and implement solutions that enhance user experiences.• Engage in frontend development (40%) using React to create dynamic and user-friendly interfaces.• Handle backend...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States S M Software Solutions Inc Full time

    About the Role: We are seeking a skilled Java Backend Developer to join our team at S M Software Solutions Inc. The ideal candidate will have a strong background in development using Java, JavaScript, and Spring Boot.Key Responsibilities: As a Java Backend Developer, you will be responsible for designing, developing, and maintaining scalable and efficient...


  • San Francisco, California, United States Triunity Software Full time

    Job OverviewWe are seeking a highly skilled Sr Java Developer to join our team at Triunity Software Inc. Based in Toronto, ON, this is a full-time role that offers flexible work-from-home options.About the RoleThis Sr Java Developer position involves working with various business requirements, conducting research and analysis to identify key components for...

  • Software Engineer

    4 days ago


    San Jose, California, United States Software Guidance and Assistance, Inc. Full time

    About SGASoftware Guidance & Assistance, Inc. (SGA) is a technology and resource solutions provider driven to stand out in the industry.The RoleWe are seeking a highly skilled Software Engineer for a contract assignment with one of our premier SaaS clients in San Jose, CA or Seattle, WA. This role will be hybrid with 2-3 days in office per...


  • San Francisco, California, United States Seven Seven Software Full time

    About the Position: We are seeking an experienced Software Development Lead - AI to join our team at Seven Seven Software. The ideal candidate will have a strong background in software engineering and AI/machine learning, with experience in designing and developing advanced AI models and algorithms. As a key member of our team, you will be responsible for...


  • San Leandro, California, United States United Software Group Full time

    Job Title: Software EngineerLocation: San Leandro, CA (Day 1 Onsite) - Onsite Interview OnlyEstimated Salary: $170,000 - $220,000 per yearAbout the Role:The United Software Group is seeking an experienced software engineer to join our team in San Leandro, CA. This position will involve working on back-end software development using Java and Spring Boot...


  • San Francisco, California, United States Triunity Software Full time

    In this role, you will work on exciting projects lasting from six months to several years, collaborating with industry experts and contributing to the success of our clients. At Triunity Software, we value our people and provide opportunities for learning new technologies and showcasing your skills.Required Skills and QualificationsExperience in Java 8 or...

  • Software Engineer

    1 month ago


    San Francisco, United States Itump Full time

    itump is seeking a talented Software Engineer to join our dynamic team and contribute to the development of high-quality software solutions. As a Software Engineer at itump, you will play a key role in designing, implementing, and maintaining software applications that meet the needs of our clients and exceed industry standards.Key...