AI Platform Optimization Lead Engineer

3 days ago

Bee Cave, TX, United States Techvilla Solutions Full-time

We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI platforms and Large Language Model (LLM) infrastructure.

The ideal candidate will have strong technical leadership experience in platform-level optimization, cost management, reliability engineering, and consumption architecture. The role requires hands-on expertise in LLM gateways, model routing, token metering, rate limiting, quota management, observability, caching, batching, and model evaluation.

Must-Have Technical Skills
  • LLM Gateway Architecture
  • LLM Model Routing
  • Token Metering & Usage Tracking
  • API Rate Limiting
  • Quota Management
  • AI Platform Optimization
  • Cost & Consumption Architecture
  • Platform Reliability Engineering
  • Observability & Monitoring
  • Caching Strategies
  • Request Batching
  • LLM Evaluation Frameworks
  • AI Infrastructure Architecture
  • Performance Optimization
  • Technical Leadership
Required Qualifications
  • 8–10 years of experience in platform engineering, infrastructure engineering, cloud engineering, or related technical roles.
  • Strong experience leading platform-level cost, reliability, and consumption optimization initiatives.
  • Hands-on experience with LLM gateways and model routing architectures.
  • Experience implementing token metering, API rate limits, and quota management.
  • Strong understanding of observability, monitoring, and performance optimization.
  • Experience implementing caching and batching strategies.
  • Knowledge of LLM evaluation methodologies and performance benchmarking.
  • Strong architectural design and technical leadership capabilities.
  • Excellent problem-solving and cross-functional collaboration skills.