AI Solutions Architect

1 day ago


Huntsville, AL, United States Guidehouse Full time
Job Family:
Data Science & Analysis

Travel Required:
Up to 10%

Clearance Required:
Active Top Secret (TS)

Guidehouse is seeking an AI Solutions Architect / Technical Lead to join our Technology / AI and Data team, supporting mission-critical initiatives for Defense and Security clients. In this role, you will serve as the principal architect for advanced AI platforms, driving end-to-end design across ingestion, retrieval-augmented generation (RAG), large language model (LLM) inference, and secure, scalable workflows. You will provide technical leadership and architectural governance to ensure coherence, performance, and compliance with stringent federal standards, while collaborating with engineers, data specialists, and mission stakeholders to deliver innovative solutions that enable data-driven decision-making. This is an opportunity to shape cutting-edge AI capabilities that directly support national security objectives.

What You Will Do:
  • Serves as the principal technical architect for the FBI adjudication AI platform, responsible for end-to-end architecture spanning ingestion, RAG, LLM inference, structured scoring, continuous learning loops, and analyst-facing mission workflows.
  • Leads a dual-path LLM strategy that supports self-hosted open-weight LLMs in AWS GovCloud as well as FedRAMP High managed model endpoints, ensuring secure, scalable, compliant, and mission-aligned model operations.
  • Provides architectural governance across backend services, model pipelines, data engineering, DevSecOps, and UI/UX components to ensure coherence, performance, and SEAD-4 adjudication alignment.
  • Ensures platform architecture conforms to FedRAMP High, RMF, NIST 800-53, and FBI ATO requirements, including boundary definition, logging standards, and continuous monitoring readiness.
Architecture & Platform Leadership
  • Define the complete technical architecture for document ingestion, long-document processing, embedding generation, vector search, anomaly detection, LLM inference, and adjudication memo generation components.
  • Architect scalable infrastructure for 200M+ tokens/month processing volumes, supporting GPU-based inference clusters, model routers, caching layers, and workflow orchestration services.
  • Establish architectural standards for both self-hosted GPU clusters and managed model endpoints, defining patterns for batching, KV-cache utilization, parallel inference, and latency optimization.
  • Produce architectural diagrams, sequence flows, integration contracts, and service interaction models to guide all development teams and maintain architectural consistency.
AI/ML Workflow & Learning Strategy
  • Oversee design of AI/ML workflows supporting entity extraction, evidence linkage, SEAD-4 scoring, anomaly detection, summarization, and document reasoning.
  • Define fine-tuning strategies using SFT, LoRA/QLoRA, dataset curation, evaluation pipelines, drift monitoring, and regression testing for consistent model quality.
  • Establish standards for retrieval-augmented generation (RAG), including embedding selection, retrieval indexing, chunking strategies, context assembly, and chain-of-thought management.
  • Build monitoring patterns to detect hallucinations, scoring inconsistencies, bias, and model performance degradation across adjudicative domains.
Security, Compliance & ATO Alignment
  • Ensure architecture supports FedRAMP High and RMF controls across data governance, encryption, access management, logging, segmentation, and monitoring.
  • Author ATO documentation including SSPs, boundary diagrams, data flow diagrams, control implementation statements, and continuous monitoring artifacts.
  • Embed secure-by-design engineering practices across APIs, data pipelines, LLM workflows, inference gateways, and audit logging layers.
  • Define end-to-end auditability standards capturing prompts, model outputs, retrieval contexts, scoring rationales, and analyst overrides.
Technical Leadership & Stakeholder Engagement
  • Provide senior engineering guidance to FBI leadership, translating complex model architecture, system behavior, and design tradeoffs into mission-relevant insights.
  • Guide sprint planning, backlog prioritization, code review practices, engineering QA, and decision analysis across AI/ML, backend, cloud, and security teams.
  • Mentor senior engineers and ensure adherence to best practices for LLM integration, microservices development, and secure cloud operations.
  • Collaborate directly with adjudicators, policy SMEs, mission stakeholders, and IT partners to ensure platform capabilities meet operational requirements.
Innovation & Mission Enhancement
  • Identify and evaluate new technologies-including multimodal LLMs, knowledge graphs, retrieval fusion methods, and reasoning verification tools-to improve mission outcomes and analyst efficiency.
  • Develop long-term modernization strategies around learning loops, evidence provenance tracking, justification generation, and adaptive adjudication workflows.
  • Support Guidehouse AI strategy, whitepapers, proposals, and federal AI modernization initiatives through technical leadership and domain expertise.
What You Will Need:
  • An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.
  • 8+ years of experience designing secure, scalable cloud architectures using container orchestration, distributed systems, workflow automation, microservices, and GPU-accelerated workloads.
  • Deep expertise in AWS GovCloud, Kubernetes/EKS, GPU workloads, distributed systems, workflow orchestration, and microservice architecture.
  • Proven experience architecting AI/ML or LLM-enabled platforms.
  • Experience working within FedRAMP High, RMF or similar compliance frameworks.
  • Ability to lead multi-disciplinary engineering teams and define end-to-end system architectures.
What Would Be Nice To Have:
  • An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.

    • Once onboard with Guidehouse, new hire MUST be able to OBTAIN and MAINTAIN a Federal or DoD "TOP SECRET/SCI (TS/SCI)" security clearance.
  • AWS GovCloud services (EC2, S3, EKS, Lambda, KMS, API Gateway, etc.)
  • Kubernetes/EKS specifically (vs. generic container orchestration).
  • Step Functions / EventBridge / Bedrock.
  • Vector DB experience (FAISS, pgvector, Milvus).
  • LLM serving frameworks (vLLM, TGI, Sagemaker).
  • Experience with SEAD-4 adjudication, personnel vetting, continuous vetting, or investigative review workflows.
  • Experience fine-tuning open-weight LLMs in secure or air-gapped environments using LoRA/QLoRA or SFT.
  • Experience with knowledge graphs, entity resolution pipelines, reasoning verification, or explainability frameworks.
  • AWS Solutions Architect Professional, Security, or Machine Learning certifications.
What We Offer:

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

Benefits include:
  • Medical, Rx, Dental & Vision Insurance
  • Personal and Family Sick Time & Company Paid Holidays
  • Position may be eligible for a discretionary variable incentive bonus
  • Parental Leave and Adoption Assistance
  • 401(k) Retirement Plan
  • Basic Life & Supplemental Life
  • Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
  • Short-Term & Long-Term Disability
  • Student Loan PayDown
  • Tuition Reimbursement, Personal Development & Learning Opportunities
  • Skills Development & Certifications
  • Employee Referral Program
  • Corporate Sponsored Events & Community Outreach
  • Emergency Back-Up Childcare Program
  • Mobility Stipend


About Guidehouse

Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com. Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.

If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse's Ethics Hotline. If you want to check the validity of correspondence you have received, please contact recruiting@guidehouse.com. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant's dealings with unauthorized third parties.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.

  • Huntsville, AL, United States Sanmina-SCI Full time

    Sanmina is a leading integrated manufacturing solutions provider serving the world's leading original equipment manufacturers (OEMs) across various industries. We provide end-to-end manufacturing solutions, delivering complete product lifecycle support from initial design and engineering to manufacturing, logistics, and after-market services. This role...


  • Huntsville, AL, United States Sanmina-SCI Full time

    Sanmina is a leading integrated manufacturing solutions provider serving the world's leading original equipment manufacturers (OEMs) across various industries. We provide end-to-end manufacturing solutions, delivering complete product lifecycle support from initial design and engineering to manufacturing, logistics, and after-market services. This role...

  • AI Solutions Analyst

    5 hours ago


    Huntsville, AL, United States Sanmina-SCI Full time

    Sanmina is a leading integrated manufacturing solutions provider serving the world's leading original equipment manufacturers (OEMs) across various industries. We provide end-to-end manufacturing solutions, delivering complete product lifecycle support from initial design and engineering to manufacturing, logistics, and after-market services. This role...

  • Manager, Architect

    7 days ago


    Huntsville, AL, United States KPMG Full time

    Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries. Our growth is driven by delivering real results for our clients. It's also enabled by our culture, which encourages individual development, embraces an inclusive environment, rewards innovative...


  • Huntsville, AL, United States Precision Solutions Full time

    Overview Cloud Solutions Architect, Senior Onsite | Huntsville, AL | 5 Days a Week Active Top Secret Clearance Required SummaryOur client brings bold thinking and a desire to be the best at their work in consulting, analytics, digital solutions, engineering, cyber, and with industries ranging from defense to health to energy to international...


  • Huntsville, AL, United States Lockheed Martin Corporation Full time

    Description:Who You Are: Who You Are: Seeking and innovative Solutions Architect to join our transformational Command, Control, Communications, Computers, Intelligence, Reconnaissance, and Surveillance (C4ISR) team within Lockheed Martin Rotary and Mission Systems (RMS). What You Will Be Doing: The Solutions Architect will develop technical solutions that...


  • Huntsville, AL, United States Lockheed Martin Corporation Full time

    Description:Who You Are: Who You Are: Seeking and innovative Solutions Architect to join our transformational Command, Control, Communications, Computers, Intelligence, Reconnaissance, and Surveillance (C4ISR) team within Lockheed Martin Rotary and Mission Systems (RMS). What You Will Be Doing: The Solutions Architect will develop technical solutions that...


  • Huntsville, AL, United States Lockheed Martin Corporation Full time

    Description:Who You Are: Who You Are: Seeking and innovative Solutions Architect to join our transformational Command, Control, Communications, Computers, Intelligence, Reconnaissance, and Surveillance (C4ISR) team within Lockheed Martin Rotary and Mission Systems (RMS). What You Will Be Doing: The Solutions Architect will develop technical solutions that...


  • Huntsville, AL, United States Bowhead Full time

    Overview Proposal Solutions Architect: Bowhead is seeking a Proposal Solutions Architect to support the development of technical proposal content for Army and DoD opportunities, including EXPRESS and GSA Schedule responses. This is a writing-focused role that works closely with the Capture and Technical Proposal Lead to shape and articulate clear,...


  • Huntsville, AL, United States UIC Alaska Full time

    Overview Proposal Solutions Architect: Bowhead is seeking a Proposal Solutions Architect to support the development of technical proposal content for Army and DoD opportunities, including EXPRESS and GSA Schedule responses. This is a writing-focused role that works closely with the Capture and Technical Proposal Lead to shape and articulate clear,...