Engineering Manager, Model Serving

6 days ago


California, United States Anthropic Full time
About the roleWe are seeking an experienced and highly technical Engineering Manager to lead our Model Serving engineering team, focused on external partnerships. The team's charter is to build scalable infrastructure to support the serving of Anthropic's world-class large language models on the world’s leading cloud service providers. The team collaborates closely with experts in Anthropic's research organization, product leaders, and external partners to ensure we deliver industry-leading functionality. The team also works closely with Anthropic's systems and core infrastructure teams to define best practices and supporting systems for delivering this unique service.Responsibilities
  • Manage and grow a team of talented backend and infrastructure engineers to deliver on the External Technical Partnerships team charter and goals
  • Maintain deep technical involvement in the project, to help you drive the technical roadmap and execution to ship and expand capabilities, scale, and launch new LLMs. You should be comfortable operating in the codebase alongside the engineers on your team.
  • Collaborate with product and research teams to define the feature set, API interfaces, and technical requirements for launching new models and features at ever faster latencies.
  • Work closely with product management and external partners to design solutions that meet ever-evolving customer needs
  • Practice excellent communication and upward/outward management to establish high-functioning relationships with internal and external partners and keep your executive stakeholders informed.
  • Establish engineering practices and operational excellence to power high-quality, scalable finetuning services
  • Develop capacity management solutions and business metric tracking to ensure the service scales efficiently
  • Hire, mentor, and grow a diverse team of top engineering talent
  • Foster a culture of innovation, accountability, and customer focus
You may be a good fit if you
  • 5+ years of engineering management experience leading high-performing teams to deliver business-critical products
  • Strong backend development background and deep experience operating customer-facing services at scale, with stringent uptime requirements
  • Proven track record partnering with customers and navigating enterprise/B2B environments
  • Excellent cross-functional leadership and communication skills to align engineering, product, research, and business teams
  • Passion for building innovative AI products in a fast-paced, customer-driven environment
  • Commitment to developing AI responsibly and safely
Strong candidates may also have experience with
  • Deep ML/AI engineering expertise, ideally with experience in large language models and finetuning techniques
  • Building and operating SaaS or PaaS offerings on public cloud infrastructure
  • Developing pricing models, SLAs, and operating agreements for AI/ML products
  • Managing relationships with strategic partners and enterprise customers
  • Expertise in large-scale capacity management and resource orchestration
  • Track record hiring and developing diverse engineering teams

Deadline to apply:None. Applications will be reviewed on a rolling basis.

#J-18808-Ljbffr

  • California, United States Acceler8 Talent Full time

    OverviewAcceler8 Talent is seeking a Research Engineer (Pretraining) to contribute to our innovative projects. This position presents an exciting chance to engage in the pretraining of cutting-edge AI models. Ideal candidates will possess a strong passion for machine learning and excel in dynamic environments.Company BackgroundAcceler8 Talent is a pioneering...

  • Emulation Engineer

    2 days ago


    California, United States HCLTech Full time

    About HCLTech:HCLTech is a global technology company, home to 221,000+ people across 60 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Engineering Services,...


  • California, United States Acceler8 Talent Full time

    OverviewAcceler8 Talent is seeking a Research Engineer (Pretraining) to contribute to our innovative initiatives. This position presents an excellent opportunity to engage in the pretraining of cutting-edge AI models. If you possess a strong passion for machine learning and excel in dynamic settings, this role could be a perfect match for your skills.Company...


  • California, United States AIMdyn, Inc. Full time

    Position OverviewAIMdyn, Inc. is a distinguished woman-owned small enterprise situated in Santa Barbara, California, specializing in the advancement of generative AI since 2003. Our focus lies in the development of predictive modeling systems tailored for intricate engineering, natural science, and social science challenges. As a recognized government...


  • California, United States GitLab Full time

    The GitLab DevSecOps platform empowers 100,000+ organizations to deliver software faster and more efficiently. We are one of the world’s largest all-remote companies with 2,000+ team members and values that foster a culture where people embrace the belief that everyone can contribute. Learn more about Life at GitLab.An overview of this role The Custom...


  • San Diego, California, United States Auria Full time

    Auria is seeking a Senior Systems Engineer with Model-Based Expertise to enhance their engineering team. This position offers a competitive salary range.Key Responsibilities:Assist in the upkeep of the NAVWAR Enterprise Architecture tailored for Model-Based Systems Engineering (MBSE).Revise and improve engineering best practices for the technical...

  • AI Research Engineer

    2 weeks ago


    California, United States Krutrim Full time

    About Krutrim: Krutrim is at the forefront of AI computing innovation. Our vision encompasses a comprehensive AI computing stack that includes AI infrastructure, AI Cloud services, multilingual and multimodal foundational models, and AI-driven applications. As India's pioneering AI unicorn, we have developed the first foundational model in the country.Our AI...


  • California, United States ASSETHUB LTD Full time

    Job Title: Machine Learning EngineerAbout the Role:We are seeking a highly skilled Machine Learning Engineer to join our team at ASSETHUB LTD. As a key member of our AI development team, you will be responsible for designing and developing advanced generative models for creating and editing 3D models within our tool.Key Responsibilities:Design and develop...

  • Battery Modeling

    1 day ago


    California, United States Cprime, Inc Full time

    About the RoleCprime, Inc. is seeking a highly skilled Battery Modeling & Algorithm Engineer to join our team of experts in developing cutting-edge battery technologies. As a key member of our team, you will be responsible for designing and developing advanced battery models and control algorithms to improve battery performance.Key ResponsibilitiesDevelop...


  • California, United States Fulcher Davis Associates Full time

    About Fulcher Davis AssociatesWe are a forward-thinking organization dedicated to harnessing the power of Artificial Intelligence to drive innovation and solve complex problems. Our mission is to leverage Large Language Models to streamline decision-making processes, thereby enhancing productivity and efficiency.Key ResponsibilitiesLarge Language Model...


  • California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Research Engineer to join our Pretraining team, responsible for creating and refining foundational models that enable our AI capabilities for enterprise solutions.As a Research Engineer in this role, you will focus on developing large-scale training datasets, optimizing training processes, and innovating model...


  • California, United States Acceler8 Talent Full time

    OverviewAcceler8 Talent is seeking a Research Engineer (Pretraining) to contribute to our innovative initiatives. This position presents an excellent opportunity to engage in the pretraining of cutting-edge AI models. If you possess a strong passion for machine learning and excel in dynamic settings, this role may be a perfect fit.About Acceler8...


  • Sunnyvale, California, United States Chemix, Inc. Full time

    About the RoleChemix, Inc. is seeking a highly motivated Battery Modeling Engineer to develop and expand our AI platform for battery materials discovery. Our AI platform is the core of Chemix, and we're looking for a talented individual to join our team and make a fundamental contribution to developing the batteries that will power the electrification...


  • California, United States Acceler8 Talent Full time

    What We Are BuildingAs we embark on an exciting journey of growth, our emphasis is on collaborating with commercial partners to customize and enhance our sophisticated models to align with their unique business objectives. Our success in developing, aligning, and implementing cutting-edge models in our highly responsive consumer-oriented chatbot has created...


  • California, United States Acceler8 Talent Full time

    Overview of Our Development FocusAs we embark on an exciting growth trajectory, our primary objective is to collaborate with commercial partners to customize and refine our sophisticated models to align with their unique operational requirements. Our success in crafting, aligning, and implementing cutting-edge models within our highly responsive...


  • California, United States Capgemini Engineering Full time

    Job Title: Mobile Automation Software EngineerJob Overview:We are in search of a skilled Automation Engineer to enhance the verification and validation processes for mobile applications on both Android and iOS platforms. The ideal candidate will engage in a structured product development methodology that adheres to quality standards and regulatory...


  • California, United States Capgemini Engineering Full time

    Job Title: Mobile Software Automation DeveloperJob Overview:We are looking for a skilled Automation Developer to enhance the verification and validation processes for mobile applications on both Android and iOS platforms. The successful candidate will engage in a structured product development lifecycle that adheres to quality standards and regulatory...


  • California, United States Capgemini Engineering Full time

    Job Title: Mobile Software Automation DeveloperJob Overview:We are looking for a skilled Automation Developer to play a crucial role in the verification and validation processes of mobile applications across both Android and iOS platforms. The selected candidate will engage in a structured product development methodology that adheres to quality standards and...

  • Catia V5 Specialist

    7 days ago


    California, United States Altair Engineering Full time

    Job Summary:Altair Engineering is seeking a highly skilled Design Drafter to join our team in Burbank, CA. This is a direct hire position that requires expertise in Catia V5 R21 to R32.Key Responsibilities:Prepare 3D models and drawings using Catia V5 R21 to R32.Perform checking functions and coordinate designs with project and manufacturing...

  • Design Drafter

    7 days ago


    California, United States Altair Engineering Full time

    Job Summary:Altair Engineering is seeking a highly skilled Design Drafter to join our team in Burbank, CA. This is a Direct Hire position.Key Responsibilities:Prepare 3D models and drawings using Catia V5 R21 to R32.Perform checking functions and coordinate designs with project and manufacturing engineers.Develop complex and simple detail, sub-assembly, and...