Senior Software Engineer

2 months ago

New York, New York, United States Baseten Full time

ABOUT BASETEN

We're a growing team of builders backed by top-tier investors including IVP, Spark Capital, and Sarah Guo at Conviction. ML teams at enterprises and category-defining AI-native companies like Descript, Bland, and Patreon use Baseten to power their core production workloads with best in class performance, security, and reliability. While we've unlocked PMF and secured Series B funding, the ML infrastructure market is massive and we're just getting started. If you're excited to work on engaging and relevant problems while building something new from the ground up, come join us

Are you passionate about advancing the frontiers of artificial intelligence? We are looking for a Senior Software Engineer focused on model performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of machine learning. If you are a backend engineer who thrives on making things faster and is excited about open source ML models, we look forward to your application.

KEY RESPONSIBILITIES

Implement, refine, and productionize cutting edge techniques for ML model inference and infrastructure Deep dive into underlying codebases of TensorRT, Pytorch, Transformers, CUDA, and other libraries to debug ML performance issues Apply and scale optimization techniques across a wide range of ML models, particularly large language models Collaborate with a diverse team to design and implement innovative solutions. Own projects from idea to production, from writing project specs to managing end-to-end feature implementation

AS AN ENGINEER, YOU HAVE: 3 -10 years of experience with one or more general purpose programming languages, including but not limited to Python, C++, or Go Deep understanding of software engineering principles and a proven track record of developing and deploying AI/ML inference solutions Strong familiarity with ML libraries, especially PyTorch, TensorRT, or TensorRT-LLM Demonstrated interest and experience in machine learning and large language models Deep understanding of GPU Architecture Experience with Docker and Kubernetes We'd also love it if you have experience and interest in growing and leading a team.

BONUS POINTS Proficiency in enhancing the performance of software systems, particularly in the context of LLMs Familiar with LLM optimization techniques (quantization, speculative decoding, continuous batching, etc.) Experience with CUDA or similar technologies OUR CURRENT TECH STACK Infrastructure - AWS + Kubernetes + Istio + Knative + Prometheus stack Backend - Python + Django + Postgres + Redis Frontend - React + TypeScript + GraphQL WHAT WE OFFER Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums) A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era An inclusive and supportive work culture that fosters learning and growth Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities to embark on a rewarding journey in shaping the future of AI If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

  • Lead Software Infrastructure Engineer

    1 week ago

    New York, New York, United States Intelliswift Software Full time

    Position: Senior Software Infrastructure EngineerLocation: RemoteContract Duration: 12-MonthsEssential Qualifications:Proven experience with Data PlatformsExpertise in constructing and transitioning data pipeline infrastructuresCapability to develop a robust platformProficiency in Python and SQLPreferred Qualifications:Passion for photographyExperience in...

  • Lead Software Infrastructure Engineer

    4 days ago

    New York, New York, United States Intelliswift Software Full time

    Position Title: Senior Software Infrastructure EngineerLocation: OnsiteContract Duration: 12-MonthsEssential Skills:Experience with Data Platforms is essentialExpertise in constructing and transitioning data pipeline frameworksCapability to develop a robust platformProficiency in Python and SQLDesirable Skills:Passion for photographyKnowledge in image...

  • Senior Software Engineer

    3 months ago

    New York, New York, United States Atechstar Full time

    Job DescriptionThe goal of the Senior Software Engineer is to design develop and test new features or enhancements to our web based products that meet the needs of Workhorse's customers. Additionally the Senior Software Engineer will act as a lead to the team and provide mentorship and guidance.Qualifications Degree in Computer Science or equivalent...

  • Vice President of Software Engineering

    1 week ago

    New York, New York, United States IRIS Software Group Full time

    About IRIS Software Group:IRIS Software Group stands as one of the foremost privately owned software enterprises in the UK. For over four decades, we have delivered cutting-edge administrative solutions to a diverse range of clients, including businesses, charitable organizations, and public sector entities. Our workforce has grown to nearly 3000...

  • Senior Software Engineer

    1 month ago

    New York, New York, United States Aer Full time

    We are seeking a Senior Software Engineer to join our dynamic team in New York City, NY. This role involves full-stack development responsibilities and leading the charge on one of our rapidly growing new product offerings. You will be working across the stack using python, react, and prompt engineering with OpenAI. The ideal candidate will be a seasoned...

  • Senior Software Engineer

    4 weeks ago

    New York, New York, United States Moody's Corporation Full time

    Apply for Senior Software Engineer, Career Progress Consultants in New York City for 3 - 6 Year of Experience on

  • Senior Fullstack Software Engineer

    3 days ago

    New York, New York, United States GlossGenius Full time

    Senior Software Engineer at GlossGeniusGlossGenius is committed to empowering entrepreneurs by offering a comprehensive suite of business management solutions. Our platform includes features such as appointment scheduling, marketing tools, analytics, payment processing, and more, enabling small business owners to concentrate on their creative endeavors...

  • Senior Software Engineer

    4 weeks ago

    New York, New York, United States Venture Search Full time

    Senior C# Software Engineer New York Total Comp: $250K-$350KOur Client, a prominent multi-billion dollar alternative investment firm, deploys relative value strategies across fixed-income markets for institutional investors. The firm operates offices in various locations, including Wayzata, New York City, West Palm Beach, Geneva, Copenhagen, and...

  • Senior Software Engineer

    1 month ago

    New York, New York, United States Broadridge Full time

    Senior Software EngineerBroadridge - Newark, NJAt Broadridge, we've built a culture where the highest goal is to empower others to accomplish more. If you're passionate about developing your career, while helping others along the way, come join the Broadridge team.Are you seeking a position within a growing company? Broadridge is hiring Our mission is to...

  • Senior Software Engineer

    1 month ago

    New York, New York, United States Zocdoc Full time

    About the Company: Zocdoc is the country's top online health marketplace that assists patients in easily discovering and scheduling the care they require. Every month, millions of patients use our service to locate nearby, in-network providers and make comparisons based on verified patient reviews. Providers join Zocdoc's Marketplace to connect with new...

  • Senior Software Engineer

    2 months ago

    New York, New York, United States Hulu Full time

    Job Posting Title:Senior Software Engineer (Scala)Req ID:Job Description:Disney Entertainment and ESPN Technology encompasses the teams behind the Hulu, Disney+, ESPN+, and Starstreaming services within Disney's Entertainment & ESPN Technology group.We sit at the intersection between entertainment, sports, and technology and seek to connect viewers with the...

  • Senior Software Engineer

    5 days ago

    New York, New York, United States K Health Full time

    Transforming Healthcare through Innovative TechnologyWe're a mission-driven team at K Health, dedicated to harnessing the power of data to revolutionize healthcare delivery. As a Senior Software Engineer, you'll play a critical role in shaping our cutting-edge technology and driving meaningful change in the healthcare industry.Key Responsibilities:Design,...

  • Senior Software Engineering Lead

    4 days ago

    New York, New York, United States S&P Global Full time

    Job Title: Senior Software Engineering LeadAbout the RoleGrade Level (for internal use): 12The Role: As a Senior Software Engineering Lead at S&P Global, you will be responsible for designing, developing, and implementing innovative software solutions for our global carbon trading platform. This role involves leading a team of software engineers to...

  • Senior Blockchain Software Engineer

    1 week ago

    New York, New York, United States Jobot Full time

    Join a well-capitalized cryptocurrency wallet company as a Senior Blockchain Software EngineerAbout the Role:We are seeking a talented Senior Blockchain Software Engineer to become a vital part of our innovative team. This position offers a competitive salary range of $90,000 - $220,000 annually.Company Overview:Our organization is a pioneering startup in...

  • Senior .NET Software Engineer

    1 week ago

    New York, New York, United States High 5 Full time

    Job Title: Senior .NET Software EngineerLocation: RemoteCompensation: $50/hr - $55/hrContract Duration: 11 MonthsKey ResponsibilitiesAs a Senior .NET Software Engineer, you will be tasked with collaborating closely with design, technology, and architecture teams. Your role will involve leveraging technologies across existing client products, building...

  • Senior Java Software Engineer

    1 week ago

    New York, New York, United States Axelon Full time

    Axelon, a prominent player in the financial services sector, is seeking a skilled Senior Java Software Engineer for an immediate contract opportunity.This position operates on a Hybrid Schedule, requiring reliable internet and a compatible device for remote access during off-site work. Team members will be expected to work in the office three days a week...

  • Senior Java Software Engineer

    1 week ago

    New York, New York, United States Saxon Global Full time

    Join Our Team as a Senior Java Software EngineerAre you an experienced Software Engineer eager to be part of a forward-thinking organization? Saxon Global is on the lookout for a proficient individual to take on the role of Senior Java Software Engineer. This position offers the chance to engage in the design and implementation of state-of-the-art...

  • Senior C++ Software Engineer

    1 week ago

    New York, New York, United States Georgia IT Inc Full time

    Position: Senior C++ Software Engineer Location: New York City, NY Duration: Contract Rate: DOE Overview We are seeking a skilled Senior C++ Software Engineer to join our dynamic team at Georgia IT Inc. This role involves leveraging your expertise in C++ and Python, particularly in Object Oriented Programming with a focus on analytics, to contribute to...

  • Senior Software Engineer

    1 week ago

    New York, New York, United States StubHub Full time

    Senior Full-Stack Engineer - Developer EfficiencyWe are seeking a Senior Full-Stack Engineer to spearhead our Developer Efficiency team at StubHub. In this pivotal role, you will focus on crafting and sustaining tools that boost the productivity of our engineering workforce. Your responsibilities will encompass establishing dependable development...

  • Senior Software Engineer

    1 week ago

    New York, New York, United States Harnham Full time

    Senior Software EngineerSector: Finance & TechnologyLocation: HybridCompensation: $280,000 - $320,000 + BonusAbout Harnham:Harnham is collaborating with a prominent financial services firm recognized for its pioneering solutions and state-of-the-art technology within the finance industry. This organization has positioned itself as a leader in utilizing...