Backend Architect: Inference Gateway
3 days ago
United States
you.com
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
you.com is seeking an experienced backend engineer to own and scale the inference gateway that routes every model call. You will manage provider/model selection, fallback, and enforcement within a sub-millisecond budget while building an intelligence layer for selecting the right model.
This role emphasizes cost attribution, metering, and robust, scalable routing across hosted providers and internal models.
#J-18808-Ljbffr