Machine Learning Engineer

4 days ago

San Francisco, California, United States Together AI Full time $160,000 - $230,000 per year

About The Role
Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale. If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI

Responsibilities

  • Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale.
  • Develop and optimize runtime inference services for large-scale AI applications.
  • Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world.
  • Conduct design and code reviews to ensure high standards of quality.
  • Create services, tools, and developer documentation to support the inference engine.
  • Implement robust and fault-tolerant systems for data ingestion and processing.

Requirements

  • 3+ years of experience writing high-performance, well-tested, production-quality code.
  • Proficiency with Python and PyTorch.
  • Demonstrated experience in building high performance libraries and tooling.
  • Excellent understanding of low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale.
  • Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum
  • Preferred: Knowledge of AI inference techniques such as speculative decoding.
  • Preferred: Knowledge of CUDA/Triton programming.
  • Nice to have: Knowledge of Rust, Cython and compilers.

About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society. Together, we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI. Our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey to build the next-generation AI infrastructure.

Compensation
We offer competitive compensation, startup equity, health insurance, and other competitive benefits. The US base salary range for this full-time position is $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level, and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunities to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy

  • Machine Learning Engineer

    6 days ago

    San Francisco, California, United States Acceler8 Talent Full time $120,000 - $200,000 per year

    Machine Learning Engineer (Inference)We are seeking an Inference focussed Machine Learning Engineer to join a Stanford spin out scale up building a foundational infrastructure layer for AI inference.The team were founded on the back of a successful exit, with the core of the previous founding team creating their new venture. Their aim is to dramatically...

  • Machine Learning Engineer

    5 days ago

    San Francisco, California, United States Facebook Full time $125,000 - $175,000 per year

    Company DescriptionMeta, formerly known as Facebook, builds technologies that help connect people, find communities, and grow businesses. Launched in 2004, Facebook revolutionized the way people connect, and subsequent apps like Messenger, Instagram, and WhatsApp further empowered billions globally. Meta is progressing beyond 2D screens toward augmented and...

  • Machine Learning Engineer

    5 days ago

    San Francisco, California, United States TechLink Resources, Inc Full time $120,000 - $200,000 per year

    Computer Vision/ Machine Learning EngineerAd Platforms organization within Company Technology is fully responsible for building, enhancing and maintaining the high-performance, distributed, microservice-based Advertising Platform across all of Company online properties. We build and maintain proprietary technology, ranging from ad serving and ad delivery,...

  • Machine Learning Engineer

    5 days ago

    San Francisco, California, United States Gameer Full time $200,000 - $250,000 per year

    Company DescriptionGameer is the first AI game generator that turns text prompts into fully playable worlds in less than one minute. We see instant world generation as a gateway to a new era of gaming, where anyone can become a game creator without code. Our vision is to democratize game creation and open up new possibilities for creativity in the gaming...

  • Machine Learning Engineer

    5 days ago

    South San Francisco, California, United States Pharmaceutical Company Full time $200,000 - $250,000 per year

    Machine Learning EngineerHybrid Working Model - Need Local Candidate onlyWe are looking for talented Machine Learning Engineers to join Prescient Design, a division devoted to developing structural and machine learning-based methods for molecular design.The successful candidate will manage projects deploying new techniques for machine learning-based...

  • Machine Learning Engineer

    1 day ago

    San Francisco, California, United States Ema Full time $135,000 - $200,000 per year

    Who We AreEma is building the next generation AI technology to empower every employee in the enterprise to be their most creative and productive. Our proprietary tech allows enterprises to delegate most repetitive tasks to Ema, the AI employee. We are founded by ex-Google, Coinbase, Okta executives and serial entrepreneurs. We've raised capital from notable...

  • Camera Machine Learning Engineer

    3 days ago

    San Francisco, California, United States Apple Full time $147,400 - $272,100 per year

    Are you a passionate Machine Learning Engineer with a deep love for photography? Join Apple's Camera Hardware Engineering team and help us redefine the camera experience for millions of users worldwide. As a key player in our innovative team, you will collaborate closely with hardware, software, and image processing specialists to develop cutting-edge camera...

  • Senior Machine Learning Engineer

    5 days ago

    San Francisco, California, United States Apple Full time $181,100 - $272,100 per year

    Our team is looking for you to help make iOS more intelligent, proactive and personal. Our team is part the core iOS experience, using privacy preserving on-device intelligence to drive new experiences that touch the lives of millions of Apple customers every day. We are responsible for personalizing core system experiences, such as helping you manage and...

  • Machine Learning Engineer II

    5 days ago

    San Francisco, California, United States Uber Full time $167,000 - $185,500 per year

    About the RoleUber Marketplace is at the core of Uber's business, and Delivery Pricing is a strategically critical component of Marketplace. The mission of the team is to foster growth and increase profitability of Uber by pushing the frontiers of machine learning, data science, and economics and developing highly reliable and scalable platforms to...

  • Machine Learning Engineer

    3 days ago

    San Francisco, California, United States Plaid Full time $202,800 - $279,600 per year

    We believe that the way people interact with their finances will drastically improve in the next few years. We're dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with...