Senior GenAI Model Research Architect

7 days ago


Palo Alto, California, United States Tykhe Inc Full time
Job Title: Senior GenAI Model Research Architect/Engineer

We are seeking a highly skilled Senior GenAI Model Research Architect/Engineer to join our team at Tykhe Inc in Palo Alto, CA. As a key member of our research team, you will be responsible for architecting and implementing scalable training methodologies for our Frontier and Foundational LLMs.

Key Responsibilities:
  • Architect Distributed Training Systems: Design and implement highly scalable distributed training pipelines for LLMs and frontier models, leveraging model parallelism (tensor, pipeline, expert) and data parallelism techniques.
  • Optimize Performance: Utilize deep knowledge of CUDA, C++, and low-level optimizations to enhance model training speed and efficiency across diverse hardware configurations.
  • Implement Novel Techniques: Research and apply cutting-edge parallelism techniques like Flash Attention to accelerate model training and reduce computational costs.
  • Framework Expertise: Demonstrate proficiency in deep learning frameworks such as PyTorch, TensorFlow, and JAX, and tailor them for distributed training scenarios.
  • Scale to Hundreds of Billions of Parameters: Work with massive models, ensuring stable and efficient training across distributed resources.
  • Evaluate Scaling Laws: Design and conduct experiments to analyze the impact of model size, data, and computational resources on model performance.
  • Collaborate: Partner closely with research scientists and engineers to integrate research findings into production-ready training systems.

Please contact Jia for more information about the role and our company.



  • Palo Alto, California, United States Tykhe Inc Full time

    Role OverviewWe are seeking a highly skilled Senior GenAI Model Research Architect/Engineer to join our team at Tykhe Inc in Palo Alto, CA. As a key member of our research team, you will be responsible for architecting and implementing scalable training methodologies for our frontier and foundational large language models.Key ResponsibilitiesArchitect...


  • Palo Alto, California, United States Tykhe Inc Full time

    Unlock the Future of GenAI InfrastructureAt Tykhe Inc, we're pushing the boundaries of GenAI infrastructure, focusing on Voice/Audio/Speech, Vision, and Multi-modal platforms. If you're an expert in designing, developing, training, and fine-tuning state-of-the-art models using cutting-edge technologies and frameworks, we want to hear from you.Key...


  • Palo Alto, California, United States Tykhe Inc Full time

    Join Our Team as a Lead Research Scientist/EngineerWe are seeking a highly skilled and experienced Lead Research Scientist/Engineer to join our team at Tykhe Inc in Palo Alto, CA. Our company specializes in building cutting-edge GenAI infrastructure, focusing on Voice/Audio/Speech, Vision, and Multi-modal platforms.If you have expertise in designing,...


  • Palo Alto, California, United States Tykhe Inc Full time

    Join Our Team as a Lead Research Scientist/EngineerWe are seeking a highly skilled and experienced Lead Research Scientist/Engineer to join our team at Tykhe Inc in Palo Alto, CA. Our company specializes in building cutting-edge GenAI infrastructure, focusing on Voice/Audio/Speech, Vision, and Multi-modal platforms.If you have expertise in designing,...


  • Palo Alto, California, United States Tykhe Inc Full time

    Exciting Opportunity for a Lead Research Scientist/EngineerWe are a dynamic start-up focused on advancing GenAI infrastructure, particularly in the realms of Voice, Audio, Speech, Vision, and Multi-modal platforms.Your Role: As a key player in our organization, you will engage in the design, development, training, fine-tuning, and deployment of...


  • Palo Alto, California, United States BHO Tech Full time

    About BHO TechWe are a cutting-edge technology company based in historic Palo Alto, right next to Stanford campus. Our team is led by professors from Stanford, Berkeley, and MIT, and we are focused on moving mature research into the hands of industry.Job DescriptionWe are seeking a highly skilled Senior Software Architect to join our team. As a key member of...


  • Palo Alto, California, United States Tykhe Inc Full time

    Opportunity Overview: We are seeking a highly skilled individual to join Tykhe Inc. as a Lead Research Scientist/Engineer. Our organization is at the forefront of developing advanced GenAI infrastructure, focusing on Voice, Audio, Speech, Vision, and Multi-modal platforms.Role Responsibilities:Design, develop, and optimize state-of-the-art models in the...


  • Palo Alto, California, United States Dynarobotics Full time

    Senior AI Research ScientistAt Dyna Robotics, we're revolutionizing robotic manipulation with cutting-edge foundation models. As a Senior AI Research Scientist, you'll research and develop innovative AI models for dexterous robotic manipulation, driving the future of general-purpose robots.Key Responsibilities:Research and develop new computer vision...


  • Palo Alto, California, United States Luma AI Full time

    Job DescriptionWe are seeking a highly skilled Senior Research Engineer to join our team at Luma AI. As a key member of our research team, you will be responsible for designing and implementing cutting-edge AI models and systems.Key ResponsibilitiesDevelop and implement efficient models and systems for data processing, training, and deployment.Collaborate...


  • Palo Alto, California, United States Pennsylvania State University Full time

    Job DescriptionWe are seeking a highly skilled Senior RF Research Engineer to join our team at the Applied Research Laboratory at Penn State University.Job SummaryThe successful candidate will be responsible for managing complex RF Propagation projects, contributing to customers' strategic objectives, mentoring staff, and developing relationships to seek...


  • Palo Alto, California, United States Penn State University Talent Acquisition Full time

    Job DescriptionPenn State University Talent Acquisition is seeking a highly skilled Senior RF Research Engineer to join our team at the Applied Research Laboratory. As a key member of our team, you will be responsible for managing complex RF Propagation projects, contributing to customers' strategic objectives, mentoring staff, and developing relationships...


  • Palo Alto, California, United States Penn State University Full time

    Job Title: Postdoctoral Scholar: Root ModelingWe are seeking a highly motivated Postdoctoral Scholar to join our research team at Penn State University. The successful candidate will have a strong background in plant or crop modeling, preferably in OpenSimRoot, plant physiology, and programming experience.Job Summary:The Postdoctoral Scholar will be part of...


  • Palo Alto, California, United States Luma AI Full time

    Job Title: Senior Research EngineerWe are seeking a highly skilled Senior Research Engineer to join our team at Luma AI. As a key member of our research team, you will be responsible for designing, developing, and deploying cutting-edge AI solutions using PyTorch and other deep learning frameworks.Responsibilities:Design and implement efficient algorithms...

  • Research Engineer

    4 weeks ago


    Palo Alto, California, United States Inflection AI Full time

    About the RoleWe are seeking a highly skilled Research Engineer to join our Inference Team at Inflection AI. As a key member of our team, you will be responsible for optimizing model inference processes, reducing latency, and improving throughput without compromising model performance.Key Responsibilities:Deploy and optimize Large Language Models (LLMs) for...

  • AI Research Scientist

    2 weeks ago


    Palo Alto, California, United States Unreal Gigs Full time

    Unlock the Power of Machine Learning with Unreal GigsAt Unreal Gigs, we're pushing the boundaries of innovation in machine learning. As a Senior Machine Learning Engineer, you'll be at the forefront of our AI initiatives, leading the development of state-of-the-art machine learning models and systems.Key Responsibilities:Algorithm Development: Design,...


  • Palo Alto, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Senior Research Engineer to join our team at Acceler8 Talent. As a Senior Research Engineer - Inference Optimization, you will play a pivotal role in optimizing and deploying state-of-the-art models for real-world applications.Key Responsibilities:Optimize and deploy large language models (LLMs) for inference...

  • Senior Architect

    2 weeks ago


    Palo Alto, California, United States GE Healthcare Full time

    Job DescriptionThis Senior Architect position will be responsible for guiding and developing ASICs for applications within Magnetic Resonance (MR) systems. The successful candidate will interface with ASIC simulation & design teams, and Hardware Subsystem teams to help deliver mixed-signal and digital ASIC design solutions.Key ResponsibilitiesGuide ASIC...

  • AI Research Scientist

    2 weeks ago


    Palo Alto, California, United States Unreal Gigs Full time

    Unlock the Power of Machine Learning with Unreal GigsAt Unreal Gigs, we're pushing the boundaries of innovation in machine learning. Our mission is to revolutionize industries and empower businesses with cutting-edge AI-driven solutions. As a Senior Machine Learning Engineer, you'll be at the forefront of our AI initiatives, leading the development of...

  • Research Engineer

    4 weeks ago


    Palo Alto, California, United States Inflection AI Full time

    About the RoleThe Pretraining Team at Inflection AI is responsible for creating and refining the foundational models that power our AI capabilities for enterprise applications. Research Engineers in this role focus on developing large-scale training datasets, optimizing training processes, and innovating on model architectures to push the boundaries of what...

  • Senior Economist

    2 weeks ago


    Palo Alto, California, United States Cornerstone Research Full time

    Senior Economist Role at Cornerstone ResearchCornerstone Research is a leading economic and financial consulting firm that provides expert testimony and analysis in complex disputes and regulatory investigations. We are seeking a highly skilled Senior Economist to join our team.About the RoleAs a Senior Economist at Cornerstone Research, you will work at the...