Lead Engineer Generative AI Product Engineer

2 weeks ago


Washington, Washington, D.C., United States Capital One Full time
Job Title: Lead Engineer Generative AI Product Engineer

Capital One is seeking a highly skilled Lead Engineer Generative AI Product Engineer to join our team. As a key member of our Enterprise AI team, you will be responsible for designing and building large-scale AI and ML products or platforms serving millions of users.

Key Responsibilities:
  • Architect, build and deploy well-managed core APIs and SDKs to access LLMs and our proprietary FMs including training, fine-tuning and prompting tasks, including orchestration SDKs.
  • Design APIs for performance, real-time applications, scale, ease of use and governance automation.
  • Develop application-specific interfaces that leverage LLMs and FMs to continue to enhance the associate and customer experience.
  • Enable our users to build new GenAI capabilities.
  • Develop tools and processes to monitor API access patterns and operational health.
  • Design and implement AI safety and guardrails in the API layer working closely with researchers.
Requirements:
  • Bachelor's degree in Computer Science, Computer Engineering or a technical field
  • At least 6 years of experience designing and building data-intensive solutions using distributed computing and cache optimization techniques
  • At least 6 years of experience programming with Python, Go, Scala, or Java
  • At least 1 years of experience building, scaling, and optimizing training or inferencing systems for deep neural networks
Preferred Qualifications:
  • Familiarity with building large-scale AI and ML products or platforms serving millions of users.
  • Experience designing large-scale distributed platforms and/or systems in cloud environments such as AWS, Azure, or GCP.
  • Experience with Kubernetes and KubeFlow workloads is preferred.
  • Familiarity with the Model Development Lifecycle and MLOps preferred.
  • Experience architecting cloud systems for security, availability, performance, scalability, and cost.
  • Ability to move fast in an environment with ambiguity at times, and with competing priorities and deadlines.
  • Experience at tech and product-driven companies/startups preferred.
  • Ability to iterate rapidly with researchers and engineers to improve a product experience while building the foundational capabilities.
  • Have experience with API security, observability, cloud access control and privacy best practices.
  • Familiarity with deploying AI or ML models in demanding production environments.


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that is building the world's best AI pilot. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About Shield AIShield AI is a company that is passionate about protecting service members and civilians with intelligent...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Principal Engineer, AI SystemsShield AI is a leading defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Principal Engineer to join our team and contribute to the development of our AI systems.Job Summary:We are looking for a talented Principal Engineer to lead the...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Senior Software Engineer - AI PilotShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Senior Software Engineer to join our team and contribute to the development of our AI pilot, Hivemind.Key Responsibilities:Lead teams at the...


  • Washington, Washington, D.C., United States Shield AI Full time

    About Shield AIShield AI is a venture-backed defense technology company founded in 2015 with a mission to protect service members and civilians with intelligent systems. Our team is dedicated to building the world's best AI pilot, Hivemind, which has flown various aircraft, including fighter jets and drones. We have offices in San Diego, Dallas, Washington...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About the Role:Design and implement state-of-the-art planning algorithms, taking ideas from...

  • AI Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Booz Allen Hamilton Full time

    Job Title: Generative AI EngineerAbout the Role:We are seeking an experienced Generative AI Engineer to join our team at Booz Allen Hamilton. As a key member of our AI engineering team, you will be responsible for designing and developing innovative AI solutions that drive business value for our clients.Key Responsibilities:Design and develop AI models and...


  • Washington, Washington, D.C., United States Microsoft Corporation Full time

    AI Compiler EngineerMicrosoft Corporation is seeking a highly skilled AI Compiler Engineer to join our AI Frameworks team. As a key member of our team, you will be responsible for designing and developing AI software in C/C++, Python, and other languages.Responsibilities:Lead design and development of AI softwareCollaborate with cross-functional teams to...


  • Washington, Washington, D.C., United States Empower AI Inc. Full time

    OverviewEmpower AI is a leading provider of AI solutions for government agencies. Our Empower AI Platform empowers federal agency leaders to elevate the potential of their workforce with a direct path for meaningful transformation.Headquartered in Reston, Va., Empower AI leverages three decades of experience solving complex challenges in Health, Defense, and...


  • Washington, Washington, D.C., United States Atlas AI Full time

    Job Title: Senior / Lead ML Tooling Software EngineerAbout the Role:We are seeking a highly skilled Senior / Lead ML Tooling Software Engineer to join our team at Atlas AI. As a key member of our Software Engineering team, you will be responsible for designing, developing, and deploying cloud-scale training services for GeoSpatial Machine Learning models....


  • Washington, Washington, D.C., United States Atlas AI Full time

    Job Title: Senior / Lead ML Tooling Software EngineerJob Summary:We are seeking a highly skilled Senior / Lead ML Tooling Software Engineer to join our team at Atlas AI. As a key member of our Software Engineering team, you will be responsible for designing, developing, and deploying cloud-scale training services for GeoSpatial Machine Learning models. Your...


  • Washington, Washington, D.C., United States Empower AI Inc. Full time

    {"Overview": "Empower AI is a leading provider of AI solutions for government agencies. Our Empower AI Platform enables federal agency leaders to elevate the potential of their workforce with a direct path for meaningful transformation. With three decades of experience solving complex challenges in Health, Defense, and Civilian missions, we leverage our...


  • Washington, Washington, D.C., United States Oddball Full time

    About the RoleWe are seeking a highly skilled AI/Machine Learning Engineer to join our team at Oddball. As a key member of our Federal program, you will be responsible for leading the development and deployment of advanced machine learning models and AI solutions.Key ResponsibilitiesDesign and implement machine learning models and AI solutions to drive...


  • Washington, Washington, D.C., United States The MITRE Corporation Full time

    Job Title: AI Security EngineerAt The MITRE Corporation, we're committed to tackling our nation's toughest challenges while fostering a fulfilling work-life balance. As an AI Security Engineer, you'll be part of a diverse team passionate about harnessing trustworthy and assured artificial intelligence to drive meaningful impact.Job SummaryWe're seeking a...


  • Washington, Washington, D.C., United States HD Tech Recruitment Full time

    About Our Company:HD Tech Recruitment is a forward-thinking company, committed to advancing technology and revolutionizing industries through cutting-edge AI solutions. Our team is dedicated to leveraging the power of artificial intelligence to tackle challenging problems and deliver meaningful results that propel business success.Job Overview:We are seeking...


  • Washington, Washington, D.C., United States Shield AI Full time

    About Shield AIShield AI is a venture-backed defense technology company founded in 2015 with a mission to protect service members and civilians with intelligent systems. Our team is dedicated to building the world's best AI pilot, Hivemind, which has successfully flown various aircraft, including fighter jets and drones.Job SummaryWe are seeking an...

  • AI Software Engineer

    3 weeks ago


    Washington, Washington, D.C., United States MIla Health Inc Full time

    Job Title: AI ML / Artificial Intelligence and Machine Learning Software EngineerLocation: Bellevue, WAWe are seeking ambitious and adaptable AI Engineers to join our growing team at MIla Health Inc. This role offers a unique opportunity to work at the intersection of healthcare and AI, gaining exposure to both domains while contributing to the development...


  • Washington, Washington, D.C., United States Booz Allen Hamilton Full time

    The OpportunityWe are seeking a highly skilled and experienced Artificial Intelligence and Machine Learning Engineer to join our team dedicated to rapidly building, testing, and deploying cutting-edge AI solutions. Our team is looking for a hands-on subject matter expert with all processes related to data, including scraping, cleaning, processing, and...

  • AI Software Engineer

    4 weeks ago


    Washington, Washington, D.C., United States MIla Health Inc Full time

    About the RoleWe are seeking a highly skilled AI Software Engineer to join our team at Mila Health Inc. as a key contributor to the development of innovative healthcare solutions.Key Responsibilities:Design, develop, and deploy scalable AI systems capable of handling highly sensitive healthcare data.Implement state-of-the-art AI/ML algorithms and techniques...

  • Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Booz Allen Hamilton Full time

    About the OpportunityWe are seeking a highly skilled Data Engineer to join our team at Booz Allen Hamilton. As a Data Engineer, you will play a critical role in developing a data platform that will have a significant impact on our clients' ability to rapidly exploit the secrets held by a dataset.Our team is passionate about leveraging the possibilities...


  • Washington, Washington, D.C., United States Primer Full time

    About the RoleWe are seeking a highly skilled Senior Forward Deployed Engineer to join our team at Primer. As a key member of our engineering team, you will play a critical role in developing and deploying AI and NLP technologies to support national security organizations.Key ResponsibilitiesEngage with customers and partners to understand their technical...