Principal - Security Architect - Artificial Intelligence (AI/LLM)

3 weeks ago


Charlotte, United States Ally Full time

Principal - Security Architect - Artificial Intelligence (AI/LLM) Join to apply for the Principal - Security Architect - Artificial Intelligence (AI/LLM) role at Ally. 1 day ago — Be among the first 25 applicants. Overview Ally Financial only succeeds when its people do – and that’s more than some cliché people put on job postings. We live this stuff We see our people as, well, people – with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work‑life balance and diversity and inclusion. From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You’re constantly evolving, so shouldn’t your opportunities be, too? Work Schedule: Ally designates roles as (1) fully on‑site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role’s specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need. The Opportunity As the Principal - Security Architect - Artificial Intelligence (AI/LLM), you will lead the design, implementation, and governance of security architectures for AI‑driven systems and platforms. You will ensure that AI solutions are secure by design, compliant with regulatory requirements, and resilient against evolving threats. Your expertise will guide cross‑functional teams in adopting best practices, developing secure patterns, and shaping the technology strategy and roadmap for AI security across the organization. This is a mid‑level to senior‑level highly technical role that will serve as a mentor to more junior architects and will report to Head of Security Architecture. Responsibilities Lead comprehensive security reviews of AI systems, applications, and infrastructure to identify and mitigate risks. Conduct threat modeling for AI and machine learning solutions, ensuring robust protection against adversarial attacks and data breaches. Evaluate vendors and emerging technologies for security posture, integration capabilities, and alignment with organizational standards. Develop and maintain technology strategy and security roadmaps for AI initiatives, ensuring alignment with business objectives and regulatory requirements. Establish and promote secure architecture patterns, frameworks, and guidelines for AI development and deployment. Collaborate with engineering, data science, product, and compliance teams to embed security throughout the AI lifecycle. Provide expert guidance on network security, data security, cloud security, and identity & access management (IAM) in the context of AI systems. Present complex security concepts and recommendations to technical and non‑technical stakeholders, including executive leadership. Build and nurture relationships with internal and external partners to advance the organization’s AI security posture. Stay abreast of emerging threats, technologies, and regulatory changes impacting AI security. Required Skills 5+ years of experience in security architecture, with significant exposure to AI/ML systems and cloud environments. Experience with Model Context Protocol (MCP) and securing the infrastructure that supports it. Ability to mentor and coach a technical team, leading by example. Deep knowledge of network security, data security, cloud security (AWS, Azure, GCP), and IAM principles. Proven experience conducting security reviews, threat modeling, and vendor/technology evaluations. Demonstrated ability to develop technology strategies, roadmaps, and secure architecture patterns based on evolving security threats and industry trends. Strong understanding of financial industry regulatory frameworks (such as is FFIEC, PCI DSS, and SOX) and cybersecurity frameworks (such as NIST and CIS) Excellent communication and presentation skills, with the ability to convey complex concepts to diverse audiences. Exceptional relationship-building and collaboration skills across technical and business teams. Relevant certifications (e.g., CISSP, CCSP, AWS/Azure Security, TOGAF) are highly desirable. Bachelor’s or equivalent experience in Computer Science, Information Security, or related field. Benefits Ally's compensation program offers market‑competitive base pay and pay‑for‑performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry‑leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including: Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part‑time status and management level). Planning for the Future: plan for the near and long term with an industry‑leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access. Supporting your Health & Well‑being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short‑ and long‑term disability, pre‑tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well‑being program that helps you and your family stay on track physically, socially, emotionally, and financially. Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back‑up child and adult/elder care days and childcare discounts. Work‑Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs. Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity. To view more detailed information about Ally’s Total Rewards, please visit this link: https://www.ally.com/content/dam/pdf/corporate/ally-total-rewards-snapshot.pdf Seniority level Mid‑Senior level Employment type Full‑time Job function Information Technology Referrals increase your chances of interviewing at Ally by 2x. Get notified about new Security Architect jobs in Charlotte, NC. At this time, Ally will not sponsor a new applicant for employment authorization for this position. Base Pay Range: $110,000 - $180,000 USD. Incentive Compensation: This position is eligible to participate in our annual incentive plan. Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law. We are committed to working with and providing reasonable accommodation to applicants with physical or mental disabilities. For accommodation requests, email us at hrpolicy@ally.com. Ally will not discriminate against any qualified individual who is capable of performing the essential functions of the job with or without reasonable accommodation. #J-18808-Ljbffr



  • Charlotte, United States AT&T Full time

    A leading telecommunications company is seeking a Principal AI Architect in Charlotte, North Carolina, to design and deploy advanced AI systems. The ideal candidate will have extensive experience in Python, LLMs, and full-stack development. The role involves architecting intelligent automation workflows, developing scalable applications, and ensuring AI...


  • Charlotte, United States AT&T Full time

    Job Description AT&T is ushering in a new era of intelligent automation and secure AI innovation. We are seeking a visionary Principal AI Architect to lead the design, development, and deployment of advanced AI systems that integrate large language models (LLMs), prompt engineering, full-stack development, and AI cybersecurity. This role is ideal for a...


  • Charlotte, United States AT&T Full time

    Job Description:This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.AT&T is ushering in a new era of intelligent automation and secure AI innovation. We are seeking a visionary Principal AI Architect to lead the design, development, and deployment of advanced AI...


  • Charlotte, NC, United States AT and T Full time

    Job Description: This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered. AT&T is ushering in a new era of intelligent automation and secure AI innovation. We are seeking a visionary Principal AI Architect to lead the design, development, and deployment of advanced AI...


  • Charlotte, North Carolina, United States AT&T Full time $141,300 - $237,400 per year

    Job Description:This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.AT&T is ushering in a new era of intelligent automation and secure AI innovation. We are seeking a visionary Principal AI Architect to lead the design, development, and deployment of advanced AI...


  • Charlotte, NC, United States AT&T Full time

    Job Description: This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered. AT&T is ushering in a new era of intelligent automation and secure AI innovation. We are seeking a visionary Principal AI Architect to lead the design, development, and deployment of advanced AI...


  • Charlotte, United States AT&T Full time

    A leading telecommunications company in Charlotte, North Carolina is seeking a Principal AI Architect to lead intelligent automation and secure AI innovation. The position demands extensive experience in AI engineering, full-stack development, and strong skills in Python. The annual salary ranges from $141,300 to $211,900, commensurate with experience and...


  • Charlotte, United States Ally Full time

    A financial services company in Charlotte, NC, seeks a Principal - Security Architect specializing in AI/LLM. This mid-level to senior role involves designing secure architectures for AI systems, conducting security reviews, and mentoring junior team members. The ideal candidate has significant experience in security architecture, especially with AI/ML...

  • Senior AI with LLM

    5 days ago


    Charlotte, NC, United States Omni Inclusive Full time

    Senior AI with LLM (Preferably someone with Java background) Charlotte, NC Experience in working with and fine-tuning Large Language Models (LLMs), including the design, optimization of NLP systems, frameworks, and tools. Experience in building scalable applications using LLMs, utilizing frameworks such as LangChain, LlamaIndex, etc. Utilize off-the-shelf...

  • Senior AI with LLM

    2 weeks ago


    Charlotte, NC, United States Omni Inclusive Full time

    Senior AI with LLM (Preferably someone with Java background) Charlotte, NC Experience in working with and fine-tuning Large Language Models (LLMs), including the design, optimization of NLP systems, frameworks, and tools. Experience in building scalable applications using LLMs, utilizing frameworks such as LangChain, LlamaIndex, etc. Utilize off-the-shelf...