Global IT LLM Engineer Manager

2 weeks ago

Boston, United States Boston Consulting Group Full time

Who We Are

BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.

What You'll Do

 

To realize our aspirations to build a Gen AI assistant that will transform the way BCG works, we are looking for LLM engineers who are passionate about designing, developing, and optimizing GenAI products. You will work as a Squad Member in your domain of expertise, helping to advance the work and using your experience to maximize Squad performance. You will also be committed to maintaining and developing your own expertise and knowledge to ensure that you and your Chapter members bring the latest thinking to your roles. You will bring expertise in full stack development, Performance, and stability of custom-built products. This role is involved in all aspects of backend development including API and core functional logic, with add on skill of frontend development. This may include developing API development, backend development in technologies like python, Typescript, React. Work would also involve documentation of all designs and development. It would be required to attend agile ceremonies and demo/present the development work incrementally. 

Among your responsibilities, you will: 

  • Continuously develop Chapter expertise 
    • Maintaining best-in-class Chapter expertise and resources in order to deliver the right knowledge and skills to Squads. 
    • Staying abreast of relevant developments and innovations in domain area, both internally and externally. 
    • Maintaining your own technical knowledge through learning and continuous improvement. 
  • Develop Chapter members and the Chapter as a whole 
    • Overseeing, providing feedback, and developing Chapter members to help improve domain knowledge and better serve the Squads in which they work. 
    • Discussing Chapter development progress and opportunities with the Tech Area Lead. 
  • Share knowledge and expertise within and outside of the Chapter 
    • Ensuring the “how” of the work performed by Chapter members is aligned with established technical roadmaps and guardrails to drive strategy. 
    • Sharing relevant insights and developments within area of expertise with Chapter members and related Chapters. 
    • Actively sharing knowledge and expertise across the organization with other Chapters. 
  • Identify resource needs throughout the organization 
    • Engaging Product Owners, Tribe Leads, and Tech Area Leads to allocate Chapter members and ensure Squads have proper technical resourcing and functional expertise. 
    • Identifying expertise and resource gaps and training or hiring the talent needed to  address them. 
  • Work in a Squad to realize its mission 
    • Advancing the work of the Squad based on items in the backlog and priorities set by the Product Owner. 
    • Sharing expertise with Squad members and working cross-functionally to advance the work of the Squad. 
  • Enable the organization’s new way of working 
    • Modelling behaviors to support the organization’s transformation to a new way of working. 
    • Actively creating and maintaining a positive culture within the Chapter based on Agile leadership behaviors. 
You're Good At  

  • Being a great hands-on engineer and mentoring other team members. 

  • Inspiring and motivating your team. 

  • Comfortable with both planning and execution. 

  • Influencing and being a technical thought partner with Product Owners. 

  • Committing to cross-functional collaboration to achieve the best results for the organization.  

  • Enjoying coaching and developing people to improve their performance, knowledge and expertise. 

  • Are passionate, intellectually curious, and enjoy learning new skills and capabilities. 

  • Bring a data-driven approach to decision-making and problem-solving, both in day-to-day management and in making strategic trade-offs. 

  • Capability to think and work at a systems level, combining data science and engineering skills 

What You'll Bring

  • BA degree in Computer Science, Statistics, or related field with a focus on Artificial Intelligence, Machine Learning, Natural Language Processing, or similar field preferred 

  • 2+ years of experience developing and experimenting with LLMs 

  • 6+years of experience developing AI/ML technologies within large and business critical applications 

Experience & Skills (Mandatory) 

  • Proficiency in Python and all associated DS libraries and frameworks 

  • Strong knowledge in AI, machine learning, and natural language processing 

  • Experience with leveraging, training and fine-tuning Foundation Models, including multimodal inputs and outputs 

  • Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex) 

  • Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios. 

  • Experience with unstructured.io or similar libraries for handling various document formats and extracting structured information from unstructured data. 

  • Expertise in using LlamaIndex for building and querying knowledge bases, including its data connectors, indexing strategies, and query engines. 

  • Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets. 

  • Proficiency in generating and working with text embeddings using models like BERT, GPT, or domain-specific embedding models. Understanding of embedding spaces and their applications in semantic search and information retrieval. 

  • Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores. Understanding of ontology design and graph-based reasoning. 

  • Experience with RAG concepts and fundamentals (vectorDBs, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with generative AI models. 

Experience & Skills (Nice to have) 

  • Experience with cloud infrastructure for AI/ML 

  • Experience with LLM guardrails 

  • Experience with LLM monitoring and observability 

  • Experience with security related to LLM integration 

Who You'll Work With

  • Your AI Engineering chapter, by setting their direction, establishing objectives and key results, working on the staffing and development of your chapter, and ensuring that you maximize outputs and working products. 

  • Tribe Leaders, Product Owners and other Tribe Chapter Leads with whom you shall work to manager chapter resources and ensure a positive collaboration. 

  • Agile Coaches and Scrum Masters, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation. 

  • Squad members of a specific squad, led by a Product Owner. 

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.
BCG is an E - Verify Employer. Click here for more information on E-Verify.

  • Senior LLM Engineer

    3 weeks ago

    boston, United States Motion Recruitment Full time

    Boston, MassachusettsHybridFull Time$165k - $180kWe're currently working with a large company in the content streaming industry that is looking for a strong LLM Engineer to join their team. The role will be focused on using LLMs and NLP for content customization and personalization to increase the quality of experience for daily users.  The ideal candidate...

  • Global IT Software Engineer Director

    4 weeks ago

    Boston, United States Boston Consulting Group Full time

    Locations: Boston | Atlanta Who We Are BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and...

  • Global IT Software Engineer Senior Manager

    1 week ago

    Boston, United States Boston Consulting Group Full time

    Locations: Boston | AtlantaWho We AreBCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and...

  • Global IT Software Engineer Senior Manager

    2 weeks ago

    Boston, United States Boston Consulting Group Full time

    Locations: Boston | Atlanta Who We Are BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and...

  • Global IT GenAI Software Engineer Director

    4 weeks ago

    Boston, United States Boston Consulting Group Full time

    WHAT YOU'LL DO As a Global IT GenAI Software Engineer Director & Chapter Lead, you will be at the forefront of BCG’s AI-driven transformation journey. BCG is committed to leveraging AI to enhance business operations and client solutions, and your role will be crucial in this mission. You will lead the design, development, testing, and deployment of a...

  • LLaMa3 LLM Data Scientist

    4 months ago

    Boston, United States SS&C Technologies Holdings Full time

    Job Description Data ScientistLocation: Waltham, MAGet To Know The Team:Your deep experience with artificial intelligence, LLaMa2, OpenLLaMa, large language models and advanced analytics is matched by a passion to build great products, lead innovation, be a mentor and guide to other Engineering team members. In the past you have been part of a startup or...

  • Global IT GenAI Software Engineer Director

    4 weeks ago

    Boston, United States Boston Consulting Group Full time

    Locations: Boston | AtlantaWho We AreBCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and...

  • Staff Software Engineer I, Application, Global Engineering

    4 days ago

    Boston, United States Advanced Engineering Group LLC Full time

    WHO YOU'LL WORK WITH Bain’s Global Engineering leads the firm’s software development efforts and defines engineering standards for Bain globally. The team ships software solutions to address client and internal needs, ranging from iterative prototypes to enterprise-grade production software. You will solve cutting-edge problems for a variety of...

  • Staff Software Engineer II, Application, Global Engineering

    4 days ago

    Boston, United States Advanced Engineering Group LLC Full time

    WHO YOU'LL WORK WITH Bain’s Global Engineering leads the firm’s software development efforts and defines engineering standards for Bain globally. The team ships software solutions to address client and internal needs, ranging from iterative prototypes to enterprise-grade production software. You will solve cutting-edge problems for a variety of...

  • Lead Machine Learning Engineer

    3 weeks ago

    Boston, United States Manulife Insurance Malaysia Full time

    Lead MLOps / LLM Ops (Director Level)Apply locations: CAN, Ontario, Toronto, 250 Bloor Street East; USA, Massachusetts, Boston, 200 Berkeley StreetTime type: Full timePosted on: Posted 8 Days AgoTime left to apply: End Date: December 1, 2024 (8 days left to apply)Job requisition id: JR24061008The OpportunityThe Lead MLOps / LLM Ops will own the design,...

  • Machine Learning Engineer, Generative AI

    2 days ago

    Boston, United States Amazon Full time

    Machine Learning Engineer, Generative AIJob ID: 2833804 | Amazon.com Services LLCWork on State of the Art runtime systems hosting cutting edge Large Language Models (LLM). We work in a fast paced dynamic environment to rapidly experiment and deliver scaled runtime solutions based on cutting edge experiments and research in the LLM space.Key job...

  • Senior AI Engineer

    3 weeks ago

    Boston, United States Discover International Full time

    I am delighted to be partnering with our Boston-based biotech client. They are at the forefront of innovation, leveraging artificial intelligence and machine learning to drive advancements in Genetics. We are seeking a highly skilled Senior Data Science/AI Engineer with extensive experience in large language models (LLMs) and Python development. This role...

  • Senior AI Engineer

    3 weeks ago

    Boston, United States Discover International Full time

    I am delighted to be partnering with our Boston-based biotech client. They are at the forefront of innovation, leveraging artificial intelligence and machine learning to drive advancements in Genetics. We are seeking a highly skilled Senior Data Science/AI Engineer with extensive experience in large language models (LLMs) and Python development. This role...

  • Machine Learning Engineer, Generative AI

    2 days ago

    Boston, United States Amazon Full time

    Machine Learning Engineer, Generative AIJob ID: 2833804 | Amazon.com Services LLCWork on State of the Art runtime systems hosting cutting edge Large Language Models (LLM). We work in a fast paced dynamic environment to rapidly experiment and deliver scaled runtime solutions based on cutting edge experiments and research in the LLM space.Key job...

  • Software Engineer

    2 days ago

    Boston, United States Valence Full time

    Valence has built the first-ever, first-to-market AI coaching platform for enterprise, offering personalized, expert, and human-like guidance and support to any leader or employee. At Valence, we're not just talking about the future of work we're actively shaping it. From your first interaction with us, you'll notice we're different. We're not just offering...

  • Software Engineer

    1 week ago

    Boston, United States Valence Full time

    Valence has built the first-to-market AI native coaching platform for enterprise, offering personalized, expert, and human-like guidance & support to any leader or employee. At Valence, we're not just talking about the future of work - we're actively shaping it. From your first interaction with us, you'll notice we're different. By working here you won't...

  • Software Engineer

    1 week ago

    Boston, United States Valence Full time

    Valence has built the first-to-market AI native coaching platform for enterprise, offering personalized, expert, and human-like guidance & support to any leader or employee. At Valence, we're not just talking about the future of work - we're actively shaping it. From your first interaction with us, you'll notice we're different. By working here you won't...

  • Global Project Manager- CAPEX

    4 months ago

    Boston, United States Cabot Corporation Full time

    Your Role at Cabot Global Project Manager will manage large capital projects from project initiation through execution and closeout. The Project Manager will identify and develop the project requirements and then develop the project scope and plan to meet those requirements. Lead cross-functional teams, applying project management knowledge, skills,...

  • Principle AI Engineer

    4 weeks ago

    boston, United States Unusual Ventures Full time

    About The JobHey there, AI trailblazer! We're a cutting-edge FinTech startup revolutionizing the financial world with our advanced AI-driven SaaS tools. Our mission is to transform risk assessment in financial decisioning, making it smarter, faster, and more efficient for institutions globally. This role is based in Waltham, MA with an expectation to work...

  • Principle AI Engineer

    4 weeks ago

    boston, United States Unusual Ventures Full time

    About The JobHey there, AI trailblazer! We're a cutting-edge FinTech startup revolutionizing the financial world with our advanced AI-driven SaaS tools. Our mission is to transform risk assessment in financial decisioning, making it smarter, faster, and more efficient for institutions globally. This role is based in Waltham, MA with an expectation to work...