Generative AI Architect

1 week ago

Boston, United States Boston Consulting Group Full time

Locations: Canary Wharf | Boston | Atlanta

Who We Are

BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.

What You'll Do

The Generative AI Architect - Senior Manager plays a crucial role in our AI Center of Excellence (CoE), spearheading the design, deployment, and governance of generative AI solutions across the organization. This senior role demands a unique blend of technical expertise in AI, strategic vision, and hands-on experience with generative models, ensuring that AI initiatives drive business impact and align with organizational goals. The Generative AI Architect will work closely with diverse stakeholders—digital teams, enterprise architects, and governance bodies—to deliver scalable, ethical, and high-performance AI solutions that meet the highest standards across projects. 

Key Responsibilities: 

  • End-to-End Generative AI Architecture: Collaborate with digital teams, architects, and stakeholders to architect comprehensive AI solutions within the enterprise. Partner closely with teams, including Team Builder, Career Development (CD) Platform, and RevOps, to ensure seamless integration of AI solutions, maximizing their effectiveness across various business functions. 

  • Solution Architecture for Early-Stage Initiatives: Lead the architectural design for early-stage generative AI projects, guiding proof-of-concept (PoC) and prototype development with the AI CoE. Prepare these projects for review by the Investment Committee (IC) to secure funding. 

  • Cloud Engineering: Implement deployment strategies such as containerization, DevSecOps, CI/CD, performance monitoring, and logging using tools like Docker, Docker Compose, Kubernetes, and GitHub Actions. 

  • API Management and Deployment: Oversee REST and GraphQL API design, model serving, and endpoint creation with tools like Flask and FastAPI. 

  • Cloud-Based Model Deployment: Leverage cloud platforms like AWS (Lambda, S3, EC2, SageMaker) and Azure ML to facilitate scalable model deployment. 

  • AI/ML Lifecycle Management: Manage model development, experiment tracking, version control, and deployment using tools such as MLflow, DVC, and Weights & Biases. 

  • AI Governance and Risk Assessment: Actively engage with AI Governance frameworks and the Enterprise Architecture CoE to: 

  • Assess generative AI solutions across digital teams, identifying potential risks such as technical debt or overlapping initiatives. 

  • Evaluate generative AI proposals for IC review, ensuring alignment with organizational standards and assessing feasibility, stack compatibility, and build-vs-buy decisions. 

  • Responsible AI Implementation: Partner with the Generative AI Platforms team to ensure Responsible AI principles and standards are woven into LLM evaluations and applications, promoting ethical and secure AI deployment. 

  • Cross-Functional Collaboration: Serve as a subject matter expert on generative AI, guiding cross-functional teams, including digital, platform, and governance stakeholders. Promote knowledge-sharing, establish best practices, and contribute to a collaborative, AI-centric culture. 

  • Strategic Planning & Innovation: Develop and execute architectural strategies and roadmaps in alignment with the company’s vision. Stay updated on industry advancements to drive AI innovation and integrate cutting-edge practices. 

  • Security and Compliance: Ensure that AI solutions comply with security protocols and regulatory standards, implementing necessary safeguards to mitigate AI-related risks. 

  • Go-To-Market Strategy (GTM): Collaborate with onsite teams and senior architects to define go-to-market strategies for AI solutions, aligning development with client needs for impactful, effective implementations. 

What You'll Bring

Required Skills & Qualifications: 

  • Educational Background: Master’s or Ph.D. in Computer Science, Machine Learning, AI, Data Science, or a related discipline. 

  • Technical Expertise: Extensive experience in generative AI and machine learning frameworks, including models like GANs, VAEs, transformer-based architectures, and LLMs. 

  • Solution and Enterprise Architecture Experience: Proven track record in designing and deploying AI architectures at scale, with strong capabilities in risk assessment and alignment with enterprise standards. 

  • Governance and Standards Alignment: Experience in establishing or working within AI governance frameworks, focusing on risk mitigation, Responsible AI compliance, and adherence to organizational standards. 

  • Leadership and Communication Skills: Exceptional interpersonal, leadership, and communication abilities, with a demonstrated capacity to work across teams, lead cross-functional projects, and communicate complex technical concepts to non-technical stakeholders. 

Preferred Qualifications: 

  • Cloud & MLOps Expertise: Proficiency in MLOps and AI lifecycle management, particularly for scalable deployments on platforms such as AWS, GCP, and Azure. 

  • Responsible AI Knowledge: In-depth understanding of Responsible AI practices, particularly in generative AI, and experience in designing and implementing these within enterprise frameworks. 

  • Thought Leadership: Contributions to AI and generative technologies through publications, presentations, or industry engagement are a strong advantage. 

  • Technical Proficiency: Hands-on experience with cloud-based AI/ML solutions and programming languages (e.g., Python, PySpark), data modeling, and microservices. Experience with LLM orchestration on platforms like OpenAI on Azure, AWS Bedrock, GCP Vertex AI, or Gemini AI, alongside familiarity with MLOps tools (MLFlow, batch prediction, real-time endpoints) and DevOps tools like Azure DevOps, GitHub Actions, Jenkins, Terraform, and AWS CloudFormation. 

Who You'll Work With

BCG's information technology group collaboratively delivers the latest digital technologies that enable our consultants to lead and our business to grow. For our IT jobs, we seek individuals with expertise in the areas of IT infrastructure, application development, business systems, collaborative and social technologies, information security, and project leadership.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.
BCG is an E - Verify Employer. Click here for more information on E-Verify.

  • Lead AI Scientist

    4 months ago

    Boston, United States Axiomatic-AI Full time

    Axiomatic_AI's mission: Axiomatic_AI is launching with the aim to accelerate R&D by "Automated Interpretable Reasoning" (AIR) -- a verifiably truthful AI model built for reasoning in science and engineering. Axiomatic_AI is hiring top talent interested in a future of human reasoning aided by -- not replaced by -- AI, and a future that empowers a new...

  • Data Solutions Architect

    6 days ago

    Boston, Massachusetts, United States State Street Corporation Full time

    About the RoleWe are seeking a Data Solutions Architect with expertise in designing and implementing data solutions on our multi-cloud platform. As Senior Solution Architect, Data, you will play a crucial role in enabling the bank to achieve its goals through strategic investments in technology solutions.Key ResponsibilitiesCreate plans and design proposals...

  • Full Stack Software Developer, Generative AI

    7 days ago

    Boston, United States Autodesk Full time

    **Job Requisition ID #** 24WD81306 **Position Overview** Autodesk is leading the transformation of the AEC industry, integrating AI technology into our products. We're enhancing our applications with cloud-native capabilities, including data at scale, edge computing, AI-based solutions, and advanced 3D modeling and graphics. This innovation is happening...

  • Software Engineer

    6 days ago

    Boston, Massachusetts, United States Gradient AI Full time

    Job SummaryWe are seeking a skilled Software Engineer to join our team at Gradient AI. This is a challenging role that requires a strong background in Python, React, and relational databases.About the RoleAs a Software Engineer, you will be responsible for designing and building scalable distributed systems using AWS or other cloud environments. You will...

  • Full Stack Software Developer, Generative AI

    2 months ago

    Boston, United States Autodesk Full time

    Job Requisition ID # 24WD81306 Position Overview Autodesk is leading the transformation of the AEC industry, integrating AI technology into our products. We're enhancing our applications with cloud-native capabilities, including data at scale, edge computing, AI-based solutions, and advanced 3D modeling and graphics. This innovation is happening across our...

  • Principal Cloud AI Architect

    6 days ago

    Boston, Massachusetts, United States Unreal Gigs Full time

    Job OverviewWe are at the forefront of artificial intelligence research and development, driving innovation in cutting-edge AI technologies that transform industries and improve lives.About Unreal Gigs:A leading player in AI-focused tech, we're dedicated to developing AI solutions that tackle complex problems across various domains. Our mission is to...

  • Solutions AI Architect

    1 week ago

    Boston, United States ZipRecruiter Full time

    Job Description LILT is the leading AI solution for enterprise translations. Our stack made up of our Contextual AI Engine, Connector APIs, and Human Adaptive Feedback enables global organizations to adopt a true AI translation strategy, focusing on business outcomes instead of outputs. With LILT, innovative, category-defining organizations like Intel,...

  • Solutions AI Architect

    7 days ago

    Boston, United States ZipRecruiter Full time

    Job Description LILT is the leading AI solution for enterprise translations. Our stack made up of our Contextual AI Engine, Connector APIs, and Human Adaptive Feedback enables global organizations to adopt a true AI translation strategy, focusing on business outcomes instead of outputs. With LILT, innovative, category-defining organizations like Intel,...

  • Solutions AI Architect

    3 weeks ago

    Boston, United States ZipRecruiter Full time

    Job DescriptionLILT is the leading AI solution for enterprise translations. Our stack made up of our Contextual AI Engine, Connector APIs, and Human Adaptive Feedback enables global organizations to adopt a true AI translation strategy, focusing on business outcomes instead of outputs. With LILT, innovative, category-defining organizations like Intel, ASICS,...

  • Principal AI Scientist

    1 month ago

    Boston, United States Pristine Infotech Full time

    Principal AI Scientist Location: Boston Role: Principal AI ScientistExperience: 3 to 5 yearsQualification: PhD in AI, Comp Science, Math or Stats from exceptional institutions Can you architect real-time optimized recommendation engines leveraging cognitive, prescriptive, explainable AI? Can you develop self-learning models? Can you envision automating...

  • Senior AI Engineer

    2 weeks ago

    Boston, United States Discover International Full time

    I am delighted to be partnering with our Boston-based biotech client. They are at the forefront of innovation, leveraging artificial intelligence and machine learning to drive advancements in Genetics. We are seeking a highly skilled Senior Data Science/AI Engineer with extensive experience in large language models (LLMs) and Python development. This role...

  • Senior AI Engineer

    2 weeks ago

    Boston, United States Discover International Full time

    I am delighted to be partnering with our Boston-based biotech client. They are at the forefront of innovation, leveraging artificial intelligence and machine learning to drive advancements in Genetics. We are seeking a highly skilled Senior Data Science/AI Engineer with extensive experience in large language models (LLMs) and Python development. This role...

  • AI/ML Technical Consultant

    1 month ago

    Boston, United States RIT Solutions, Inc. Full time

    Title- AI/Client Technical Consultant Location - Canton/Boston, MA Target Start - asap Length of Assignment - 3 months initially, possible extension 6-9 more months 10 years overall experience with at least 3 years in AIML. 10 years of experience with at least 3 years with Databricks or AI/Client. So not a junior resource. They will be facing off with an...

  • Principle AI Engineer

    4 weeks ago

    boston, United States Unusual Ventures Full time

    About The JobHey there, AI trailblazer! We're a cutting-edge FinTech startup revolutionizing the financial world with our advanced AI-driven SaaS tools. Our mission is to transform risk assessment in financial decisioning, making it smarter, faster, and more efficient for institutions globally. This role is based in Waltham, MA with an expectation to work...

  • Principle AI Engineer

    4 weeks ago

    boston, United States Unusual Ventures Full time

    About The JobHey there, AI trailblazer! We're a cutting-edge FinTech startup revolutionizing the financial world with our advanced AI-driven SaaS tools. Our mission is to transform risk assessment in financial decisioning, making it smarter, faster, and more efficient for institutions globally. This role is based in Waltham, MA with an expectation to work...

  • Software Architect

    4 weeks ago

    Boston, United States Motion Recruitment Partners LLC Full time

    Software Architect Boston, MA 100% Remote Contract $70/hr - $90/hr A small tech consulting company is looking to bring on an Architect with several years of Software Development experience to work on conversational AI projects. The company is working with clients in food service and fast food to build out their conversational AI capabilities for...

  • Principle AI Engineer

    2 months ago

    Boston, United States Unusual Ventures Full time

    About The JobHey there, AI trailblazer! We're a cutting-edge FinTech startup revolutionizing the financial world with our advanced AI-driven SaaS tools. Our mission is to transform risk assessment in financial decisioning, making it smarter, faster, and more efficient for institutions globally. This role is based in Waltham, MA with an expectation to work...

  • AI/ML Technical Consultant

    7 days ago

    South Boston, United States RIT Solutions, Inc. Full time

    Title- AI/Client Technical Consultant Location - Canton/Boston, MA Target Start - asap Length of Assignment - 3 months initially, possible extension 6-9 more months 10 years overall experience with at least 3 years in AIML. 10 years of experience with at least 3 years with Databricks or AI/Client. So not a junior resource. They will be facing off with an...

  • Chief Revenue Growth Officer

    4 days ago

    Boston, Massachusetts, United States Reliant AI Full time

    About UsAt Reliant AI, we're revolutionizing the way organizations harness the power of generative AI to drive informed decision-making. With a strong foundation in reinforcement learning and natural language processing, our cutting-edge algorithms analyze key information sources to provide comprehensive answers for complex queries.We're a team of...

  • Global Head of Sales

    4 weeks ago

    Boston, United States Protex AI Full time

    About us: Protex AI is a VC-backed technology company building a privacy-preserving computer vision platform to enable proactive Health and Safety (EHS) workflows. We leverage the domain knowledge of EHS teams to help our computer vision system understand the concept of danger, preventing accidents before they occur. Every worker has the right to go home...