Conversational AI Software Engineer

2 weeks ago

East Palo Alto, California, United States Amazon Full time
Overview:

Join a pioneering team at Amazon, recognized globally for its commitment to outstanding Customer Service. Our focus is on innovation and a deep-seated customer obsession, particularly within the Customer Engagement Technology (CET) division.

Role Summary:
We are on the lookout for skilled Software Developers who are enthusiastic about utilizing Machine Learning and cutting-edge Large Language Models (LLMs) to tackle everyday customer challenges.

Key Responsibilities:
As a vital member of our engineering team, you will:

  • Develop and sustain the inference infrastructure for Amazon's conversational AI customer service chatbots, utilizing large language models (LLMs).
  • Manage the deployment pipelines for the integration and deployment of LLM models into production, ensuring thorough testing and validation.
  • Design and implement the ML inference service that coordinates interactions among various models, such as issue prediction, item recommendation, and response generation, to deliver coherent and contextual replies.
  • Collaborate with cross-functional teams to enable retrieval-augmented generation (RAG) systems, merging language models with external knowledge sources to provide informative and actionable responses.
  • Enhance observability and logging systems to proactively identify and resolve issues, while maintaining dialogue state for offline training and model enhancement.
  • Work closely with Product Managers, UX designers, Applied Scientists, and experienced Software Development Engineers to effectively apply machine learning models and deliver superior conversational AI experiences.
  • Exhibit expertise in designing and implementing real-time inference services for large-scale conversational AI systems, focusing on optimizing model performance for low latency and high transactions per second (TPS) in a customer service context.
  • Demonstrate a strong understanding of the LLM domain, including experience with model compression techniques, quantization, and efficient serving strategies for conversational AI applications.

Daily Responsibilities:
We thrive on addressing complex challenges to innovate for our customers. By pushing technological boundaries, we create unmatched experiences that allow us to adapt swiftly in a dynamic environment. Our decisions are data-driven, and we collaborate with engineering, science, and product teams to foster an innovative learning atmosphere.

Qualifications:
We seek candidates with:

  • 3+ years of professional software development experience.
  • 2+ years of experience in design or architecture of new and existing systems.
  • Proficiency in at least one programming language.

Preferred Qualifications:
Additional experience in:

  • Full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • A Bachelor's degree in computer science or a related field.

About the Team:
Join our team of scientists and engineers dedicated to developing and deploying LLM-based Conversational AI systems to enhance Amazon's customer service experience. We focus on innovative solutions that assist customers in resolving their issues efficiently, as well as products that support our customer service workforce.

Commitment to Diversity:
Amazon is committed to fostering a diverse and inclusive workplace, welcoming individuals from various backgrounds and experiences.

  • Senior AI Software Engineer

    1 month ago

    Palo Alto, California, United States HP Inc. Full time

    ACS (Advanced Compute & Solutions) is seeking a Senior Software Engineer to lead ACS Software Development in our high growth, future-oriented businesses, including Data Science, AI and other emerging areas. This role will work with some of the most exciting up-and-coming products in HP.The Senior Software Engineer will play a pivotal role in designing and...

  • Senior AI Software Engineer

    3 days ago

    Palo Alto, California, United States Hewlett Packard Enterprise Full time

    About the RoleWe are seeking a highly skilled and experienced AI Software Engineer to join our dynamic team at Hewlett Packard Enterprise. As an AI Software Engineer, you will play a crucial role in developing cutting-edge AI and machine learning solutions.Key ResponsibilitiesDesign and Develop AI Algorithms and ModelsIntegrate AI Solutions into Software...

  • Director of Software Engineering and AI Experimentation

    6 hours ago

    Palo Alto, California, United States Beck Region - Modern Woodmen of America Full time

    Job SummaryWe are seeking a highly skilled and experienced Director of Software Engineering and AI Experimentation to lead our team at Beck Region - Modern Woodmen of America. As a key member of our Core Engineering team, you will be responsible for driving innovation and impact by developing technical solutions across departments.Key ResponsibilitiesOversee...

  • Software Development Expert

    7 days ago

    Palo Alto, California, United States Lutra AI Full time

    Leading Technology Company Seeks AI ExpertLutra AI is a pioneering technology firm focused on harnessing the power of AI to revolutionize our daily lives. Our team, comprised of skilled professionals with expertise in AI, is based in the San Francisco Bay Area.If you have a passion for exploring and implementing cutting-edge AI technologies to create...

  • Senior Software Engineer, AI Systems

    2 months ago

    Palo Alto, California, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.SambaNova SuiteTM is the first full-stack, generative AI platform, from chip to model, optimized...

  • Research/Compiler Engineer

    4 days ago

    Palo Alto, California, United States Lightning AI Full time

    About UsLightning AI is a pioneering company redefining the development of artificial intelligence products. Our mission is to simplify the lifecycle of machine learning development, making it accessible to individuals and enterprises alike.Our ValuesWe are committed to building an inclusive company and developing ethical AI that improves humanity. Our...

  • Software Engineering Manager, Generative AI

    1 month ago

    Palo Alto, California, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.SambaNova SuiteTM is the first full-stack, generative AI platform, from chip to model, optimized...

  • Principal Applied Scientist, Search and Conversational Shopping AI team

    1 month ago

    Palo Alto, California, United States Amazon Full time

    Amazon is hiring a Principal Applied Scientist (PAS) to join the Search and Conversational Shopping AI team. In this role, you will be responsible for the architectural design and technological advancements of the customer experience of Amazon Rufus, our next-generation, AI-driven search and shopping assistant. This innovative role focuses on developing...

  • Industrial AI Solutions Engineer

    7 days ago

    Palo Alto, California, United States Brain Gain Recruiting Full time

    Industrial AI Solutions EngineerWe are seeking a skilled Industrial AI Solutions Engineer to contribute to a pioneering start-up specializing in aerospace analytics and supply chain efficiency. This organization, established by a Stanford academic, is recognized as a frontrunner in Enterprise AI tailored for supply chain applications, boasting a robust...

  • Industrial AI Systems Engineer

    2 weeks ago

    Palo Alto, California, United States Brain Gain Recruiting Full time

    AI Operations EngineerWe are seeking an experienced AI Operations Engineer to contribute to a pioneering Industrial AI firm specializing in aerospace analytics and supply chain enhancement. This organization, established by a leading academic in the field, is recognized as a frontrunner in Enterprise AI solutions with a robust demand from clients and...

  • Industrial AI Systems Engineer

    7 days ago

    Palo Alto, California, United States Brain Gain Recruiting Full time

    AI Solutions Operations SpecialistWe are seeking an innovative AI Solutions Operations Specialist to contribute to a pioneering company specializing in aerospace analytics and supply chain efficiency. This organization is recognized as a frontrunner in Enterprise AI, showcasing robust demand and significant growth prospects.The selected candidate will be...

  • AI Software Engineering Program Lead

    2 weeks ago

    Palo Alto, California, United States Hewlett-Packard Full time

    Position OverviewThis role is pivotal in steering the architecture, creation, and enhancement of embedded software and firmware tailored for hardware innovations at Hewlett-Packard, particularly in the realm of new AI form factors.Key ResponsibilitiesIn this capacity, you will:Direct the formulation and generation of technical documentation for firmware...

  • AI Software Engineering Program Lead

    2 weeks ago

    Palo Alto, California, United States Hewlett-Packard Full time

    Position OverviewThis role is pivotal in steering the design, development, and enhancement of embedded software and firmware for innovative hardware products associated with the advancement of new AI form factors at Hewlett-Packard.Key ResponsibilitiesDirects the creation and preparation of technical documentation for firmware operations.Manages resource...

  • Senior DevOps Engineer

    2 months ago

    Palo Alto, California, United States Typeface AI Full time

    Who we are? Typeface is on a mission to help everyone express their unique imagination. We believe technology is a creative partner that empowers any company to tell their unique stories faster and easier than ever before. Generative AI platforms represent a major breakthrough to create content at tremendous speed and scale. For enterprises to successfully...

  • AI Engineer

    4 days ago

    Palo Alto, California, United States Brain Gain Recruiting Full time

    Job DescriptionThis is a unique opportunity to join a team of experts at Brain Gain Recruiting, a leading industrial AI start-up founded by a renowned Stanford professor and led by recognized thought leaders in AI/ML and aerospace analytics.Our main product is a cutting-edge enterprise SaaS for supply chain in aircraft fleet maintenance, built around...

  • AI Software Engineering Program Lead

    7 days ago

    Palo Alto, California, United States Hewlett-Packard Full time

    Position OverviewThis role is pivotal in steering the design, development, and enhancement of embedded software and firmware tailored for hardware products associated with the creation of innovative HP AI form factors.The incumbent will ensure the prompt identification and resolution of software and firmware challenges, facilitating timely and effective...

  • AI Software Engineering Program Lead

    2 weeks ago

    Palo Alto, California, United States Hewlett-Packard Full time

    Position OverviewThis role is pivotal in steering the design, development, and enhancement of embedded software and firmware tailored for hardware products focused on innovative HP AI form factors.The individual in this position will be tasked with identifying and resolving software and firmware challenges, ensuring prompt and effective solutions....

  • Machine Learning Engineer

    4 hours ago

    Palo Alto, California, United States Voltai Full time

    About VoltaiVoltai is a pioneering technology company that aims to revolutionize the physical world by harnessing the power of artificial intelligence. Our mission is to accelerate the pace of hardware innovation by developing cutting-edge AI systems that can understand and improve complex technologies, such as semiconductors and electronics.About the RoleWe...

  • Lead Platform Engineer for Healthcare AI

    6 days ago

    Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a highly skilled Technical Lead / Platform Engineer to spearhead the advancement of our Generative AI for Healthcare Software as a Service (SaaS) platform. As a pivotal member of our foundational engineering team, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring...

  • VP of Sales

    1 month ago

    Palo Alto, California, United States AI Fund Full time

    Palo Alto, CALanding AI – Business /Full time /HybridLanding AI Landing AI delivers the leading data-centric AI, no-code platform for computer vision. Our flagship product, LandingLens,uses cutting-edge AI technology to enable computer vision applications to be built and deployed 10x faster than before, thereby creating significant ROI. Our deep learning...