Software Engineer

4 weeks ago

San Francisco, United States Baseten Full time

ABOUT BASETEN

We’re a growing team of builders backed by top-tier investors, including IVP, Spark Capital, Greylock, and Sarah Guo at Conviction. ML teams at enterprises and category-defining AI-native companies like Descript, Bland.ai, Patreon, Writer, and Robust Intelligence use Baseten to power their core production workloads with best-in-class performance, security, and reliability. While we’ve unlocked PMF and secured Series B funding, the ML infrastructure market is massive, and we’re just getting started. If you’re excited to work on engaging and relevant problems while building something new from the ground up, come join us

THE ROLE

Are you passionate about advancing the frontiers of artificial intelligence? We are looking for a Senior Software Engineer focused on model performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of machine learning. If you are a backend engineer who thrives on making things faster and is excited about open source ML models, we look forward to your application.

RESPONSIBILITIES:

  • Implement, refine, and productionize cutting-edge techniques for ML model inference and infrastructure.

  • Deep dive into underlying codebases of TensorRT, PyTorch, Transformers, CUDA, and other libraries to debug ML performance issues.

  • Apply and scale optimization techniques across a wide range of ML models, particularly large language models.

  • Collaborate with a diverse team to design and implement innovative solutions.

  • Own projects from idea to production, including writing project specs and managing end-to-end feature implementation.

REQUIREMENTS:

  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.

  • 3+ years of work professional work experience in a fast-paced, high-growth environment.

  • Experience with one or more general-purpose programming languages, such as Python, C++, or Go.

  • Deep understanding of software engineering principles and a proven track record of developing and deploying AI/ML inference solutions.

  • Strong familiarity with ML libraries, especially PyTorch, TensorRT, or TensorRT-LLM.

  • Demonstrated interest and experience in machine learning and large language models.

  • Deep understanding of GPU architecture.

  • Experience with Docker and Kubernetes.

  • Experience and interest in growing and leading a team is highly valued.

BONUS POINTS:

  • Proficiency in enhancing the performance of software systems, particularly in the context of large language models (LLMs).

  • Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous batching).

  • Experience with CUDA or similar technologies.

BENEFITS:

  • Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums).

  • A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.

  • An inclusive and supportive work culture that fosters learning and growth.

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply Now to embark on a rewarding journey in shaping the future of AI If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

  • Software Engineer

    4 weeks ago

    San Francisco, California, United States Marvel Medical Staffing Full time

    We are looking for a skilled Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable software solutions.We are looking for someone with a strong background in software engineering, preferably with experience in Java. You will be working on a variety of projects,...

  • Software Engineer

    1 week ago

    San Francisco, United States Itump Full time

    itump is seeking a talented Software Engineer to join our dynamic team and contribute to the development of high-quality software solutions. As a Software Engineer at itump, you will play a key role in designing, implementing, and maintaining software applications that meet the needs of our clients and exceed industry standards.Key...

  • Software Engineer

    3 weeks ago

    San Francisco, California, United States Salvation Army Full time

    We are seeking a skilled Software Engineer to join our team.As a Software Engineer, you will be responsible for designing, developing, and testing software applications.Key responsibilities include:Designing and developing software applicationsCollaborating with cross-functional teamsTesting and debugging software applications

  • Software Engineer

    4 weeks ago

    San Francisco, United States HonorVet Technologies Full time

    Title: Software Engineer Location: Remote Duration: 09+ months; possible extensions Job ID: 33841929Job Description:SOFTWARE ENGINEER | REMOTE (CST) The Select Group is looking for a talented Software Engineer to join one of our top Healthcare Technology partners to support their Reconciliation ledger Project, part of the company's strategic application...

  • Software Engineer

    4 months ago

    San Francisco, United States MERU Full time

    This is a founding role. You will work directly with Venkat (the CTO) to build deployment configurations and platform features for our customers. You will be expected to help with engineering across the stack, including model architecture research, latency optimization at both the software and hardware level, cloud infrastructure, and product roadmap. You...

  • Software Engineer, Database Engine

    4 months ago

    San Francisco, United States SingleStore Full time

    Position Overview MemSQL Software Engineers are at the forefront of real-time technology that’s revolutionizing how companies run their businesses every day. With release cycles throughout the year, our engineers are accustomed to moving quickly in a rapid production environment. To do this successfully, we work collaboratively and creatively across teams...

  • Software Engineer A

    1 week ago

    San Francisco, United States Yaskawa America, Inc. Motoman Full time

    Create and develop support Windows desktop application software for motion controllers and subsystems, and the completion of current development projects. Be a key member of next generation controller and subsystem development tools, and will create work plans, detailed specifications, and schedules in conjunction with Development Manager and then execute...

  • Software Engineer

    4 weeks ago

    San Francisco, United States Diverse Lynx Full time

    Job Title: Software Engineer Location: San Francisco , CA (Onsite) Type: Contract Skills: Strong knowledge of Linux subsystems and networking protocols (TCP/IP, UDP, IPsec etc.) Exposure to common security protocols and their design (SSH, IPsec, TLS etc.), and ability to understand security standard requirements and apply them to products. Proficiency in...

  • Software Engineer

    1 month ago

    san francisco, United States Alpha Search Advisors Full time

    Our Software Engineers are responsible for building the systems that power every aspect of their investment process, from research and analysis to trading, risk management, funding and settlement. Working side by side with investors and quantitative researchers, they use their technical skills to drive critical commercial outcomes. If you’re interested in...

  • Software Engineer

    2 months ago

    San Francisco, United States Alpha Search Advisors Full time

    Our Software Engineers are responsible for building the systems that power every aspect of their investment process, from research and analysis to trading, risk management, funding and settlement. Working side by side with investors and quantitative researchers, they use their technical skills to drive critical commercial outcomes. If you’re interested in...

  • Software Engineer

    2 weeks ago

    San Francisco, United States Workflow86 (YC W22) Full time

    About UsWorkflow86 is revolutionizing the way businesses handle workflow automation. Our AI-powered software enables the autonomous design, construction, modification, and operation of complex business workflows with just natural language inputs. This groundbreaking approach simplifies workflow automation, making it more accessible and efficient for...

  • Software Engineer

    1 month ago

    san francisco, United States Atomus Full time

    This is a full-time on-site US Citizen backend-heavy role for a Software Engineer at Atomus located in San Francisco, CA.About AtomusAtomus' mission is to provide world class cybersecurity for the world’s most critical organizations. We build security compliance software delivered as managed services sold directly, with relevant professional services and...

  • Software Engineer

    2 months ago

    san francisco, United States Atomus Full time

    This is a full-time on-site US Citizen backend-heavy role for a Software Engineer at Atomus located in San Francisco, CA.About AtomusAtomus' mission is to provide world class cybersecurity for the world’s most critical organizations. We build security compliance software delivered as managed services sold directly, with relevant professional services and...

  • Software Engineer

    6 months ago

    San Francisco, United States Atomus Full time

    This is a full-time on-site US Citizen backend-heavy role for a Software Engineer at Atomus located in San Francisco, CA.About AtomusAtomus' mission is to provide world class cybersecurity for the world’s most critical organizations. We build security compliance software delivered as managed services sold directly, with relevant professional services and...

  • Software Engineer

    1 week ago

    San Francisco, United States RemoteWorker CA Full time

    Job Summary:We create magical e-commerce experiences which enable guests and business partners to purchase and modify resort reservations for Walt Disney World Resort, Disneyland Resort, Hong Kong Disneyland, Aulani, A Disney Resort & Spa, Disney’s Hilton Head Island Resort and Disney's Vero Beach Resort!The Software Engineer applies practical knowledge of...

  • Software Development Engineer In Test

    14 hours ago

    San Jose, United States Lynx Software Technologies Full time

    Must be a U.S. citizen by law, regulation, executive order, or government contract for ITAR compliance. Must be within a commutable distance from the San Jose headquarters. About Us: We are a leading technology firm specializing in RTOSs, Hypervisors, and other system-level software for the military and aerospace sectors. We meet stringent certification...

  • Software Engineer

    1 month ago

    san francisco, United States Heliux Full time

    About HeliuxHeliux is reimagining enterprise software for industrials. Our platform is the only all-in-one enterprise operating system that natively unifies operations across engineering, supply chain, manufacturing, finance, and more – completely replacing legacy systems such as PLM, ERP, and MES with a reconstructed experience.Our team is made up of...

  • Software Engineer

    3 months ago

    San Francisco, United States Heliux Full time

    About HeliuxHeliux is reimagining enterprise software for industrials. Our platform is the only all-in-one enterprise operating system that natively unifies operations across engineering, supply chain, manufacturing, finance, and more – completely replacing legacy systems such as PLM, ERP, and MES with a reconstructed experience.Our team is made up of...

  • Software Development Engineer In Test

    4 weeks ago

    San Jose, United States Lynx Software Technologies Full time

    Must be a U.S. citizen by law, regulation, executive order, or government contract for ITAR compliance. Must be within a commutable distance from the San Jose headquarters. About Us: We are a leading technology firm specializing in RTOSs, Hypervisors, and other system-level software for the military and aerospace sectors. We meet stringent certification...

  • Software Engineer

    1 week ago

    San Francisco, United States Informal Systems Inc. Full time

    Software Engineer, EVM SVM Infrastructure - Informal StakingFull TimeRemoteInformal SystemsInformal Systems was founded with a mission to foster trust in software and monetary systems. Our team spent years building state-of-the-art distributed systems and grappling with complexities and limitations. Despite securing billions of dollars in real-world value,...