Lead AI Engineer for Agentic AI Platform Infrastructure

At Capital One, we're dedicated to creating responsible and reliable AI systems that transform banking for good. We have a long-standing reputation as an industry leader in utilizing machine learning to deliver real-time, personalized customer experiences. Our cutting-edge technology and top-tier talent, combined with our extensive experience in machine learning, position us at the forefront of enterprises leveraging AI.

The Intelligent Foundations and Experiences (IFX) team plays a pivotal role in actualizing our AI vision at Capital One. We collaborate with various partners across the organization to advance the frontier of science and AI engineering, developing and deploying proprietary solutions that deliver value to millions of customers. Our AI models and platforms enable teams throughout Capital One to enhance their products responsibly and at scale, ensuring maximum impact.

In this role, you will:

• Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create innovative AI-powered products that redefine how our associates work and how our customers engage with Capital One.
• Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Utilize a wide array of Open Source and SaaS AI technologies, such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
• Invent and implement state-of-the-art LLM optimization techniques to enhance the performance—scalability, cost-effectiveness, latency, and throughput—of large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

The Ideal Candidate:

• Is passionate about building systems and takes pride in their quality of work, aligned with our mission to change banking for good.
• Stays updated on the latest research and can intuitively understand scientific literature, applying novel techniques in practical settings.
• Adapts rapidly and excels at clarifying complex, undefined problems, demonstrating strong analytical skills and a willingness to explore new ideas.
• Has a solid technical background in engineering and mathematics, enabling the identification of unique optimization opportunities in hardware, software, and AI.
• Is a resilient innovator capable of navigating uncharted territory to meet business objectives.

Basic Qualifications:

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field along with at least 8 years of experience in development of AI and ML algorithms or technologies; or a Master's degree in the same fields with at least 6 years of experience.
• At least 8 years of programming experience with Python, Go, Scala, or Java.

Preferred Qualifications:

• 8+ years of experience in deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
• Experience in architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
• A proven ability to lead and mentor engineering teams while influencing cross-functional stakeholders, including those at the VP level.
• Expertise in developing and applying advanced techniques for optimizing training and inference software to enhance hardware utilization, latency, throughput, and cost.
• Strong communication and presentation abilities, with a talent for simplifying complex AI concepts for diverse audiences.
• At least 2 years of experience with Agentic Frameworks (e.g., LangChain, CrewAI, Semantic Kernel, or AutoGen).
• 2+ years of experience in LLMOps (e.g., Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning).
• Experience in developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang.

Capital One is located at 1680 Capital One Drive, McLean, VA. We offer competitive compensation along with comprehensive benefits that support employee well-being, including performance-based incentives. We value diversity and are committed to creating an inclusive environment for all employees. We are an equal opportunity employer.