Engineering Manager

Engineering Manager - Machine Learning InfrastructureEngineering Manager - Machine Learning InfrastructureAs the Engineering Manager for the Machine Learning Infrastructure team, you will spearhead the development of the cutting-edge platform that powers Moveworks' conversational AI. This role is absolutely critical to the long-term scalability of our core AI product and, ultimately, the company.Your primary mission is to lead a team of talented engineers in building, optimizing, and scaling the end-to-end systems for the entire ML/LLM lifecycle. This includes our infrastructure for distributed training and inference, model evaluation frameworks, and LLM latency optimization. You will guide the team's technical vision, balancing the operational demands of our core ML infrastructure with forward-looking research to build the next generation of LLMs using cutting-edge generative AI.The frameworks your team builds serve as the foundation for all ML models in production, serving hundreds of millions of enterprise employees. Your contributions will be instrumental in shaping the Moveworks Enterprise Copilot platform and defining the future of AI-driven employee services.What You Will Do:As the Engineering Manager for the Machine Learning Infrastructure team, you will spearhead the development of the cutting-edge platform that powers Moveworks' conversational AI. This role is absolutely critical to the long-term scalability of our core AI product and, ultimately, the company.Your primary mission is to lead a team of talented engineers in building, optimizing, and scaling the end-to-end systems for the entire ML/LLM lifecycle. This includes our infrastructure for distributed training and inference, model evaluation frameworks, and LLM latency optimization. You will guide the team's technical vision, balancing the operational demands of our core ML infrastructure with forward-looking research to build the next generation of LLMs using cutting-edge generative AI.The frameworks your team builds serve as the foundation for all ML models in production, serving hundreds of millions of enterprise employees. Your contributions will be instrumental in shaping the Moveworks Enterprise Copilot platform and defining the future of AI-driven employee services.What You Will Do:Lead, Mentor, and Grow a world-class team of ML and Systems Engineers, fostering a culture of innovation, ownership, and operational excellence that aligns with Moveworks' core principles.Own the Technical Vision and roadmap for the end-to-end ML platform that powers the entire lifecycle—from data synthesis and distributed training to ultra-low-latency inference and serving—for hundreds of production models, including our proprietary MoveLM series.Drive the Strategy for model performance and efficiency, making critical architectural decisions to optimize our GPU infrastructure for latency, throughput, and cost at massive scale.Partner with Leaders across agentic platform, search platform, product engineering, and core infrastructure teams to define and deliver the foundational infrastructure that will power the next generation of agentic AI experiences.Champion a Product Mindset for your platform, building powerful abstractions and tools that accelerate the velocity of machine learning engineers and researchers across the organization.What you bring to the table:A Master's or Ph.D. in Computer Science, Machine Learning, or a related field.5+ years of industry experience with a proven track record of leading or managing high-performing machine learning or infrastructure teams.Deep technical expertise in designing, building, and scaling end-to-end machine learning systems in production environments.Strong command of Python and experience with performant languages such as C++ or GoLang.Extensive experience with deep learning frameworks like PyTorch or Hugging Face.Hands-on experience with modern LLM infrastructure, including distributed training frameworks (e.g., Deepspeed) and inference/serving frameworks (e.g., vLLM, TensorRT-LLM, Kubernetes).A strategic mindset with experience balancing the demands of operating robust, scalable infrastructure with the need for forward-looking research and development.Excellent communication and collaboration skills, with experience working cross-functionally to deliver complex projects.Nice to have:Experience working with Machine Learning productsBase Salary Compensation Range: $276,00-$366,850*Our compensation package includes a market competitive salary, equity for all full time roles, exceptional benefits, and, for applicable roles, commissions or bonus plans.Ultimately, in determining pay, final offers may vary from the amount listed based on geography, the role’s scope and complexity, the candidate’s experience and expertise, and other factors.Moveworks Is An Equal Opportunity Employer*Moveworks is proud to be an equal opportunity employer. We provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, veteran status, or any other characteristics protected by law.Who We AreMoveworks is an AI Assistant that helps all employees find information, automate tasks, and be more productive. We give the entire workforce one interface to get answers and take action across every enterprise system. And for developers, we make it easy to build and deploy AI agents that bring the power of Moveworks to every business process or workflow.It’s all powered by a pioneering Reasoning Engine paired with an Agentic Automation Engine that, together, are able to handle even the most complex requests by understanding queries, then building and executing intelligent plans to fulfill them — in seconds.Founded in 2016, Moveworks has raised $315M in funding, and eclipsed $100M in ARR in 2024 thanks to our award-winning product and team. Along the way, we’ve earned recognition as a leader in the Forrester Wave for Conversational AI Platforms for Employee Services, as a member of the Forbes Cloud 100 and AI 50 lists, and as one of America’s Most Loved Workplaces according to Newsweek.Today, Moveworks has over 500 employees in six offices globally, and is backed by some of the world's most prominent investors including Kleiner Perkins, Lightspeed, Bain Capital Ventures, Sapphire Ventures, Iconiq, and more.Over 350 leading organizations like Marriott, Databricks, Toyota, CVS Health, and Honeywell trust Moveworks to increase operational efficiency, enhance the employee experience, and drive lasting AI transformation.Come join one of the most innovative teams on the planetSeniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionEngineering and Information TechnologyIndustriesSoftware DevelopmentReferrals increase your chances of interviewing at Moveworks by 2xSign in to set job alerts for “Engineering Manager” roles.San Mateo, CA $120,000.00-$180,000.00 2 days agoSunnyvale, CA $208,000.00-$416,000.00 1 week agoSan Jose, CA $207,500.00-$276,700.00 2 days agoDirector/Senior Engineering Manager – PCBA, System Integration, Process & Manufacturing EngineeringDirector of Engineering - LinkedIn Premium, Growth & Subscriptions LifecycleMountain View, CA $209,000.00-$343,000.00 3 days agoManager, Software Engineering, ReliabilityMountain View, CA $152,000.00-$248,000.00 2 weeks agoManager, Software Engineering, ObservabilityMountain View, CA $147,000.00-$240,000.00 2 weeks agoManager, Software Engineering - Premium TeamMountain View, CA $147,000.00-$240,000.00 1 week agoSan Francisco Bay Area $170,000.00-$210,000.00 2 weeks agoPalo Alto, CA $205,000.00-$260,000.00 2 weeks agoSunnyvale, CA $218,000.00-$357,000.00 8 hours agoMountain View, CA $152,000.00-$248,000.00 21 hours agoSoftware Engineering Manager, ReliabilityMountain View, CA $152,000.00-$248,000.00 2 weeks agoMenlo Park, CA $264,000.00-$342,000.00 2 weeks agoDirector of Software Engineering (AI Ops)Mechanical Manufacturing Engineering Manager IISunnyvale, CA $165,000.00-$245,000.00 2 days agoNewark, CA $130,000.00-$170,000.00 2 days agoCupertino, CA $140,000.00-$160,000.00 2 weeks agoSan Jose, CA $233,200.00-$311,300.00 4 days agoFremont, CA $160,000.00-$200,000.00 3 weeks agoSunnyvale, CA $204,000.00-$281,000.00 2 weeks agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr