ML Research Engineer

2 months ago

San Francisco, California, United States Twelve Labs Full time

Who we are

At Twelve Labs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.

With a remarkable $77 million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA's NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.

We are a global company that values the uniqueness of each person's journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.

About the role

As an ML Research Engineer at Twelve Labs, you will drive our applied efforts in video embedding and retrieval, multimodal language modeling, and intelligent agents. You will collaborate closely with other engineers and scientists to build the next generation of Twelve Labs models, services, and infra. Scaling our models, data, and training + inference platform, while improving the reliability of our core systems, is the essence of the role. This role is a perfect fit for research minded engineers who want to build SOTA video, vision, and video-language modeling systems

In this role, you will

  • Deliver top-notch applied research solutions to problems like VLM finetuning, auto-labeling of video-text datasets, and model-based filtering of said datasets to optimize (end-)model performance
  • Collaborate with our science org to optimize the (e.g.) training/inference performance of our core model stack
  • Define a systematic prompt generation and selection strategy for our flagship VLM
  • Mentor junior engineers/researchers, and hold a high bar around code quality / engineering best practices
  • Lead by example in interviewing, hiring, and onboarding passionate and empathetic engineers
  • Work across teams to understand and manage project priorities and product deliverables, evaluate trade-offs, and drive technical initiatives from ideation to execution to shipment
  • Advance our industry-leading enterprise video solutions by incorporating already-great research into fault tolerant, low latency e2e systems

You may be a good fit if you have:

  • 10+ years of industry experience (or 7+ with a PhD in a related technical domain)
  • A PhD, or a Master's degree, in machine learning or a closely related discipline
  • Led teams of 5+ engineers as a technical lead, or formally managed engineering teams comprised of both junior and senior engineers
  • Published research/engineering work on LLMs, VLMs, video models, or contrastive multimodal models in top-tier AI conferences such as NeurIPS, ICML, ICLR, etc., or have scaled distributed foundation model data acquisition, training, inference, evaluation, etc.
  • Expertise optimizing model inference with TensorRT, ONNX, Triton Inference Server, or directly related technologies
  • Built Kubernetes-based systems for distributed data/ML workflows or worked extensively with HPC tools such as Slurm
  • A passion for, and experience in, both ML modeling and ML/AI systems software engineering
  • Strong Python expertise and considerable prior work history with at least one statically typed language (we use Golang)
  • An applied bent / are not a pure theoretician: we are an applied science and engineering group at an applied science and engineering company
  • Strong communication skills in written and spoken English

Interview and Onboarding Process:

1) Recruiter Phone Screen

2) Initial Technical Assessment

3) Final round technical assessment & culture interview

4) Reference Checks

We're also excited to share that we'll do global onboarding in Seoul for all new hires (paid company travel).

Even if there are a few checkboxes that aren't ticked through your prior experience, we still encourage you to apply If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs.

We welcome applicants from all walks of life and are committed to equal-opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger.

Benefits and Perks

An open and inclusive culture and work environment.

Work closely with a collaborative, mission-driven team on cutting-edge AI technology.

Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.

Remote-flexible, offices in San Francisco and Seoul and coworking stipend.

  • ML Research Engineer/Scientist

    3 weeks ago

    San Francisco, California, United States n34t, LLC Full time

    ML Research Engineer/Scientist – Riffusion Generative Music July 02, :02Company: RiffusionHostname: Location: San Francisco, CALooking for world–class ML research engineers and scientists to join our core team building the future of music. If you love creativity, large scale diffusion models, fast infrastructure, and early startup energy, our team may be...

  • Foundation Models ML Engineer

    6 days ago

    San Francisco, California, United States Wispr AI, Inc. Full time

    About Wispr AI, Inc.Wispr AI is pioneering a more intuitive method for engaging with technology through advanced neural interfaces. Our exceptional team comprises engineers, product designers, and research scientists dedicated to creating innovative solutions.We have successfully secured $25M in funding from prestigious venture capital firms such as NEA and...

  • Foundation Models ML Engineer

    2 weeks ago

    San Francisco, California, United States Wispr AI, Inc. Full time

    About Wispr AI, Inc.Wispr AI is pioneering a more intuitive approach to technology interaction through advanced neural interfaces. Our distinguished team comprises top-tier engineers, product designers, and research scientists dedicated to creating transformative solutions.We have successfully secured $25M in funding from leading venture capital firms,...

  • AI Research Engineer

    2 weeks ago

    San Francisco, California, United States n34t, LLC Full time

    ML Research Engineer/Scientist - n34t, LLCCompany Overview: n34t, LLC is at the forefront of technological innovation in the music industry, focusing on generative music solutions.Position Summary: We are seeking exceptional ML research engineers and scientists to contribute to groundbreaking projects in music generation. Our ideal candidates are passionate...

  • Foundation Models ML Engineer

    2 weeks ago

    San Francisco, California, United States Wispr AI, Inc. Full time

    About Wispr AI, Inc.Wispr AI is pioneering a more intuitive method for technology interaction through advanced neural interfaces. Our team comprises top-tier engineers, product designers, and research scientists dedicated to creating innovative solutions.We have successfully secured $25M in funding from prestigious venture capital firms such as NEA and 8VC....

  • Staff ML Engineer

    4 weeks ago

    San Francisco, California, United States Uber Full time

    About the RoleThere are many different types of users, opening the app in many contexts, and we need to match them to the many services and content we have available. Rider Experience drives and enables the critical trip booking funnel within the Rides app that makes up almost all of the trip transactions and contributes tremendously to business growth. We...

  • AI/ML Engineer

    1 month ago

    San Francisco, California, United States Magical Full time

    Impact-Driven Senior/Staff AI/ML Engineer for Productivity AutomationWe are looking for a highly skilled Senior/Staff AI/ML Engineer to join our team in Toronto and work on revolutionizing productivity through automation. Your role will involve designing and developing AI/ML models and algorithms to automate tasks and contribute to shaping our data graph...

  • Senior AI/ML Engineer

    4 days ago

    San Francisco, California, United States salesforce, inc. Full time

    About Salesforce:We're a global leader in customer relationship management, empowering businesses to connect with customers in a whole new way. Our mission is to help companies across every industry blaze new trails and connect with customers in a whole new way.Position: Lead Machine Learning EngineerJoin our Marketing AI/ML Algorithms and Applications team...

  • Founding Engineer

    3 weeks ago

    San Francisco, California, United States Giga ML Full time

    Location: San Francisco (Relocation required)CTC: USD 150k-250k (Base salary) + 0.5% - 1.0% (Equity)Investors: Backed by Y Combinator and Nexus Venture Partners. Angel investor: Garry Tan, CEO of YC.Key Qualifications:For All Applicants (United States and India):Back-end Skills: Strong background in Python. Familiarity with Django is a plus.Front-end Skills:...

  • Senior AI/ML Engineer

    6 days ago

    San Francisco, California, United States Hinge-Health Full time

    About the RoleWe are seeking a highly skilled and experienced Principal Software Architect to join our team at Hinge Health. As a key member of our engineering team, you will play a pivotal role in guiding and accelerating the evolution of our AI and related Infrastructure initiatives.Key ResponsibilitiesTechnical Leadership: Provide technical leadership and...

  • Senior ML Engineering Lead

    2 weeks ago

    San Francisco, California, United States Strativ Group Full time

    Senior ML Engineering LeadCompensation: up to $450k base + ~1-1.5% equityWe are collaborating with a well-funded startup that is transforming the domain of language models (LLMs) through advanced intelligence and optimization techniques, allowing both businesses and individuals to leverage LLMs tailored to their specific requirements.This organization has...

  • Lead AI/ML Data Science Director

    3 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead AI/ML Data Science DirectorJob Summary:We are seeking a highly experienced and skilled Lead AI/ML Data Science Director to join our team at Unreal Gigs. As a key member of our data science team, you will be responsible for leading the development and deployment of advanced AI and ML models to drive business growth and innovation.Key...

  • AI/ML Engineering Manager

    2 weeks ago

    San Francisco, California, United States Sephora Full time

    Job Overview:As a pivotal member of our team, you will take on the role of AI/ML Engineering Manager, driving the advancement of Data Science and Machine Learning initiatives across the organization. Your expertise will be instrumental in transforming how we engage with our customers in the beauty sector through innovative AI/ML solutions.Key...

  • Staff Software Engineer, ML Platform

    4 weeks ago

    San Francisco, California, United States Discord Full time

    Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...

  • Senior Engineer in ML Infrastructure

    6 days ago

    San Francisco, California, United States Block Full time

    Job OverviewCompany OverviewBlock is a unified organization composed of various teams, all driven by a shared mission of economic empowerment. Our foundational teams — including People, Finance, Legal, Hardware, Information Security, and Platform Infrastructure Engineering — provide essential support and guidance at the corporate level. They collaborate...

  • Director, ML Pre-Sales Engineering Leader

    9 hours ago

    San Francisco, California, United States Genai Works Full time

    About the RoleWe are seeking a highly experienced and skilled Director, ML Pre-Sales Engineering to join our team at Genai Works. As a key member of our organization, you will be responsible for leading a team of machine learning solution engineers and driving the development of our pre-sales strategy.Key ResponsibilitiesTeam Leadership: Lead a team of...

  • Senior Engineering Manager

    7 days ago

    San Francisco, California, United States Gusto Full time

    About GustoGusto is a modern, online business management platform that helps small and medium-sized businesses manage their teams efficiently. Our platform offers a range of services, including payroll, health insurance, 401(k)s, expert HR, and team management tools. We serve over 300,000 businesses nationwide, with offices in Denver, San Francisco, and New...

  • Senior Product Manager

    4 days ago

    San Francisco, California, United States GlaxoSmithKline Full time

    About the RoleWe are seeking a highly skilled and experienced Director for our AI/ML, Analysis and Computing Platforms products at GlaxoSmithKline. As a key member of our Onyx Research Data Platform organization, you will be responsible for developing the product strategy of our AI/ML Analysis and Computing platform to meet customer needs.Key...

  • Senior Product Manager

    2 days ago

    San Francisco, California, United States GlaxoSmithKline Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Product Manager to lead the development of our AI/ML and Computing Platforms products. As a key member of our Onyx Research Data Platform organization, you will be responsible for developing and executing a comprehensive product strategy that aligns with our overall goals and objectives.Key...

  • Applied ML Engineer, LLM

    1 month ago

    San Francisco, California, United States Speak Full time

    About usOur mission is to reinvent the way people learn, starting with language. We begin by teaching the next billion people English, Spanish, and French.English is the global language of business, culture, and communication, and over 1.5 billion people around the world are actively trying to learn right now. Others dream of communicating with the...