Engineering Manager, GPU Inference Performance
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Baseten is seeking an Engineering Manager to lead a portion of the Inference Performance team. You will manage a group of inference performance engineers focusing on GPUs, kernels, scheduling, batching, KV-cache management, and related optimizations.
This is a hands-on technical leadership role that shapes team structure, guides deep GPU work, and hires and develops team members. You will collaborate with Infrastructure, Inference Platform, Kernels, Model APIs and customer teams to set