Lead Generative AI Engineer/Scientist

1 month ago


Palo Alto, United States Tykhe Inc Full time

About the Company: One of our well-established start-up clients in Palo Alto, CA are looking for an experienced Lead Generative AI Engineer/Scientist to train, optimize, scale, and deploy a variety of generative AI models such as large language models, voice/speech foundation models, vision and multi-modal foundation models using cutting-edge techniques and frameworks. In this hands-on role, you will architect and implement state of art neural architecture, robust training and inference infrastructure to efficiently take complex models with billions of parameters to production while optimizing for low latency, high throughput, and cost efficiency.


Responsibilities:

  • Architect and refine foundation model infrastructure to support the deployment of optimized AI models with a focus on C/C++, CUDA, and kernel-level programming enhancements.
  • Implement state-of-the-art optimization techniques, including quantization, distillation, sparsity, streaming, and caching, for model performance enhancements.
  • Spearhead the development of Vision pipelines, ensuring scalable training and inference workflows of 10s and 100s of billions of parameter foundation models.
  • Should be able to innovate for the state-of-the-art architectures involving Panoptic Segmentation, Image Classification and Image Generation. It is expected that the candidate experiments with the internals of Vision Transformers and convolutional Models like ConvNext, CLIP, Visual Question Answering (VQA) and Diffusion Models. Practice around AI Arts, Image Prompts, Conditional Image Generation will be an additional advantage.
  • Design, develop, and innovate state-of-the-art in large multimodal models like GPT-4o, Gemini, Chameleon. Make architectural choices across dense / Mixture-of-experts, early fusion / deep fusion, choice of modality encoders (VQ-GAN, ViT, CLIP/SigLIP), decoders (Stable diffusion, Stable cascade, AudioLDM).
  • Execute training and inference processes with a key emphasis on minimizing latency and maximizing throughput, utilizing GPU clusters and custom hardware.
  • Innovate on current model deployment platforms, employing AWS, GCP, and GPU clusters, to enable high scalability and responsiveness.
  • Integrate and tailor frameworks such as PyTorch, TensorFlow, DeepSpeed, Lightening, FSDP, and Habana for the advancement of super-fast model training and inference.
  • Advance the deployment infrastructure with MLOps frameworks such as KubeFlow, MosaicML, Anyscale, Terraform, ensuring robust development and deployment cycles.
  • Enhance post-deployment mechanisms with exhaustive testing, real-time monitoring, and sophisticated explainability and robustness checks.
  • Drive continuous improvement initiatives for deployed models with automated pipelines for drift detection and performance degradation.
  • Lead the charge in model management, encompassing version control, reproducibility, and lineage tracking.
  • Cultivate a culture of high-performance computing and optimization within the AI/ML domain, propagating best practices and knowledge sharing.


Qualifications:

  • Ph.D. with 5+ years or MS with 8+ years of experience in ML Engineering, Data Science, or related fields.
  • Demonstrated expertise in high-performance computing with proficiency in Python, C/C++, CUDA, and kernel-level programming for AI applications.
  • Extensive experience in the optimization of training and inference for large-scale AI models, including practical knowledge of quantization, distillation, and Vision Pipelines.
  • It will be of additional benefit if the Candidate understands Diffusion Models (DDPM), Variational Autoencoders, Bayesian Modelling, Stochastic Variational Inference (SVI) and Reinforcement Learning.
  • Experience in building 10s and 100s of billions of parameters generative AI foundation models.
  • AI training job scheduling, orchestration, and management via SLURM and Kubeflow.
  • Proven success in deploying optimized ML systems on a large scale, utilizing cloud infrastructures and GPU resources.
  • In-depth understanding and hands-on experience with advanced model optimization frameworks such as DeepSpeed, FSDP, PyTorch, TensorFlow, and corresponding MLOps tools.
  • Familiarity with contemporary MLOps frameworks like MosaicML, Anyscale, Terraform, and their application in production environments.
  • Strong grasp of state-of-the-art ML infrastructures, deployment strategies, and optimization methodologies.
  • An innovative problem-solver with strategic acumen and a collaborative mindset.
  • Exceptional communication and team collaboration skills, with an ability to lead and inspire.


For more details, please reach out to Jia at jia@lagomtechnologies.com and setup sometime to discuss the role



  • Palo Alto, United States Tykhe Inc Full time

    About the Company: One of our well-established start-up clients in Palo Alto, CA are looking for an experienced Lead Generative AI Engineer/Scientist to train, optimize, scale, and deploy a variety of generative AI models such as large language models, voice/speech foundation models, vision and multi-modal foundation models using cutting-edge techniques and...

  • AI Trust

    1 month ago


    Palo Alto, United States Tykhe Inc Full time

    Would you like to be a part of a well established startup in Bay area, CA who are looking to hire AI Trust & Safety Engineer/Scientist to spearhead their efforts in developing safe, ethical, and reliable AI systems. In this role, you will work closely with their product and research teams to ensure their foundation models, including large language models and...

  • AI Trust

    4 weeks ago


    Palo Alto, United States Tykhe Inc Full time

    Would you like to be a part of a well established startup in Bay area, CA who are looking to hire AI Trust & Safety Engineer/Scientist to spearhead their efforts in developing safe, ethical, and reliable AI systems. In this role, you will work closely with their product and research teams to ensure their foundation models, including large language models and...


  • Palo Alto, California, United States Qualified Health Full time

    Job SummaryWe are seeking a highly skilled and experienced Senior Machine Learning Engineer to lead our technical team at Qualified Health. This role is ideal for someone who has a deep understanding of deploying scalable AI systems and has a track record of innovation and excellence in a high-stakes environment, preferably with both hyperscaler and startup...


  • Palo Alto, United States Tykhe Inc Full time

    Would you be interested in working for a fast-growing start-up in Palo Alto, CA who are building AI infrastructure and seeking an experienced AI Interpretability Staff Research Scientist to drive their efforts in developing transparent, explainable, and reliable AI systems?In this role, you will work closely with our product and research teams to ensure our...


  • Palo Alto, United States Tykhe Inc Full time

    Would you be interested in working for a fast-growing start-up in Palo Alto, CA who are building AI infrastructure and seeking an experienced AI Interpretability Staff Research Scientist to drive their efforts in developing transparent, explainable, and reliable AI systems?In this role, you will work closely with our product and research teams to ensure our...


  • Palo Alto, California, United States Amazon Full time

    About the RoleWe are seeking a highly experienced Senior Principal Applied Scientist to join our Search Experience Science team at Amazon. As a technical lead, you will be responsible for the architectural design and technological advancements of our next-generation, AI-driven search and shopping assistant, Rufus.Key ResponsibilitiesDesign and develop...


  • Palo Alto, California, United States Tykhe Inc Full time

    Opportunity Overview: We are seeking a highly skilled individual to join Tykhe Inc. as a Lead Research Scientist/Engineer. Our organization is at the forefront of developing advanced GenAI infrastructure, focusing on Voice, Audio, Speech, Vision, and Multi-modal platforms.Role Responsibilities:Design, develop, and optimize state-of-the-art models in the...


  • Palo Alto, California, United States Beck Region - Modern Woodmen of America Full time

    Job SummaryWe are seeking a highly skilled and experienced Director of Software Engineering and AI Experimentation to lead our team at Beck Region - Modern Woodmen of America. As a key member of our Core Engineering team, you will be responsible for driving innovation and impact by developing technical solutions across departments.Key ResponsibilitiesOversee...


  • Palo Alto, California, United States Aitopics Full time

    Senior AI/ML Technical LeadWe are seeking a highly skilled and experienced Senior AI/ML Technical Lead to join our team at Aisera and drive our AI and ML initiatives to new heights.Key ResponsibilitiesLead a team of AI/ML engineers and data scientists to design, develop, and deploy state-of-the-art AI/ML models and solutions.Serve as the technical expert on...


  • Palo Alto, California, United States Tykhe Inc Full time

    Exciting Opportunity for a Lead Research Scientist/EngineerWe are a dynamic start-up focused on advancing GenAI infrastructure, particularly in the realms of Voice, Audio, Speech, Vision, and Multi-modal platforms.Your Role: As a key player in our organization, you will engage in the design, development, training, fine-tuning, and deployment of...


  • Palo Alto, California, United States Lightning AI Full time

    About UsLightning AI is a pioneering company redefining the development of artificial intelligence products. Our mission is to simplify the lifecycle of machine learning development, making it accessible to individuals and enterprises alike.Our ValuesWe are committed to building an inclusive company and developing ethical AI that improves humanity. Our...

  • Senior AI Engineer

    2 days ago


    Palo Alto, California, United States Qualifiedhealthai Full time

    Job Summary:We are seeking a highly skilled and experienced Principal Machine Learning Engineer to lead our technical team at Qualifiedhealthai. This role is ideal for someone who has a deep understanding of deploying scalable AI systems and has a track record of innovation and excellence in a high-stakes environment, preferably with both hyperscaler and...


  • Palo Alto, California, United States Amazon Full time

    About the RoleWe are seeking a highly experienced Senior Principal Applied Scientist to join our Search Experience Science team at Amazon. As a technical lead, you will be responsible for the architectural design and technological advancements of our next-generation, AI-driven search and shopping assistant, Rufus.This innovative role focuses on developing...


  • Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a highly skilled Technical Lead / Platform Engineer to spearhead the advancement of our Generative AI for Healthcare Software as a Service (SaaS) platform. As a pivotal member of our foundational engineering team, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring...


  • Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a seasoned Technical Lead / Platform Engineer to spearhead the evolution of our Generative AI for Healthcare Software as a Service (SaaS) platform. As a pivotal member of our initial engineering cohort, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring the...


  • Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a seasoned Technical Lead / Platform Engineer to spearhead the advancement of our Generative AI platform tailored for the healthcare sector. As a pivotal figure in our foundational engineering team, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring the effective...


  • Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a highly skilled Technical Lead / Platform Engineer to spearhead the development of our Generative AI platform tailored for the healthcare sector. As a pivotal member of our engineering team, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring the effective delivery...


  • Palo Alto, California, United States Qualifiedhealthai Full time

    Position Overview:We are seeking a seasoned Technical Lead / Platform Engineer to spearhead the advancement of our Generative AI platform tailored for the healthcare sector. As a pivotal figure in our initial engineering cohort, you will play a crucial role in defining the system architecture, guiding engineering initiatives, and ensuring the effective...


  • Palo Alto, California, United States Amazon Full time

    Amazon is hiring a Principal Applied Scientist (PAS) to join the Search and Conversational Shopping AI team. In this role, you will be responsible for the architectural design and technological advancements of the customer experience of Amazon Rufus, our next-generation, AI-driven search and shopping assistant. This innovative role focuses on developing...