ML Research Engineer
3 weeks ago
Who we are
At Twelve Labs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.
With a remarkable $107 million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA’s NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.
We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.
About the role
As an ML Research Engineer at Twelve Labs, you will drive our applied efforts in video embedding and retrieval, multimodal language modeling, and intelligent agents. You will collaborate closely with other engineers and scientists to build the next generation of Twelve Labs models, services, and infrastructure. Scaling our models, data, and training + inference platform, while improving the reliability of our core systems, is the essence of the role. This role is a perfect fit for research-minded engineers who want to build SOTA video, vision, and video-language modeling systems
In this role, you will
- Deliver top-notch applied research solutions to problems like VLM finetuning, auto-labeling of video-text datasets, and model-based filtering of said datasets to optimize (end-)model performance
- Collaborate with our science organization to optimize the training/inference performance of our core model stack
- Define a systematic prompt generation and selection strategy for our flagship VLM
- Mentor junior engineers/researchers, and hold a high bar around code quality and engineering best practices
- Lead by example in interviewing, hiring, and onboarding passionate and empathetic engineers
- Work across teams to understand and manage project priorities and product deliverables, evaluate trade-offs, and drive technical initiatives from ideation to execution to shipment
- Advance our industry-leading enterprise video solutions by incorporating already-great research into fault-tolerant, low latency end-to-end systems
You may be a good fit if you have:
- 10+ years of industry experience (or 7+ with a PhD in a related technical domain)
- A PhD, or a Master's degree, in machine learning or a closely related discipline
- Led teams of 5+ engineers as a technical lead, or formally managed engineering teams comprised of both junior and senior engineers
- Published research/engineering work on LLMs, VLMs, video models, or contrastive multimodal models in top-tier AI conferences such as NeurIPS, ICML, ICLR, etc., or have scaled distributed foundation model data acquisition, training, inference, evaluation, etc.
- Expertise optimizing model inference with TensorRT, ONNX, Triton Inference Server, or directly related technologies
- Built Kubernetes-based systems for distributed data/ML workflows or worked extensively with HPC tools such as Slurm
- A passion for, and experience in, both ML modeling and ML/AI systems software engineering
- Strong Python expertise and considerable prior work history with at least one statically typed language (we use Golang)
- An applied bent / are not a pure theoretician: we are an applied science and engineering group at an applied science and engineering company
- Strong communication skills in written and spoken English
Interview and Onboarding Process:
- Recruiter Phone Screen
- Initial Technical Assessment
- Final round technical assessment & culture interview
- Reference Checks
We're also excited to share that we'll do global onboarding in Seoul for all new hires (paid company travel).
Even if there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs.
We welcome applicants from all walks of life and are committed to equal-opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger.
Benefits and Perks
- An open and inclusive culture and work environment.
- Work closely with a collaborative, mission-driven team on cutting-edge AI technology.
- Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.
- Remote-flexible, offices in San Francisco and Seoul and coworking stipend.
-
Founding ML Research Engineer
1 day ago
San Francisco, United States ats.rippling.com- ATS Full timeBronco is an applied AI lab helping chipmakers keep Moore’s law going. Our mission is to build AI silicon engineers that can automate chip design and verification from initial spec to final tape-out. We are starting with the first AI Design Verification Engineer to help close the verification gap, which is where the bottleneck currently is and where we...
-
Founding ML Research Engineer
2 months ago
San Francisco, United States ats.rippling.com- ATS Full timeBronco is an applied AI lab helping chipmakers keep Moore’s law going. Our mission is to build AI silicon engineers that can automate chip design and verification from initial spec to final tape-out. We are starting with the first AI Design Verification Engineer to help close the verification gap, which is where the bottleneck currently is and where we...
-
ML Research Engineer
1 week ago
San Francisco Bay Area, United States Acceler8 Talent Full timeAbout the CompanyWe are a startup focused on building generative models for the highly complex electronics and semiconductor industry. Based in the SF Bay Area, we are backed by top investors in Silicon Valley and collaborate with some of the world’s largest semiconductor companies. Our team is composed of former Stanford researchers and engineers from...
-
ML Research Engineer
1 week ago
San Diego, United States Life Science People Full timeAbout the RoleWe are seeking an experienced ML Research Engineer to drive innovation in machine learning for small molecule drug discovery. This role is focused on advancing generative and predictive models for molecular systems, blending state-of-the-art techniques in deep learning with computational physics and chemistry to enable groundbreaking...
-
Founding ML Research Engineer
4 weeks ago
San Francisco, CA, United States ats.rippling.com- ATS Full timeBronco is an applied AI lab helping chipmakers keep Moore’s law going. Our mission is to build AI silicon engineers that can automate chip design and verification from initial spec to final tape-out. We are starting with the first AI Design Verification Engineer to help close the verification gap, which is where the bottleneck currently is and where we...
-
Senior AI/ML Engineer
2 weeks ago
San Francisco, California, United States Magical Tome Full timeAbout Magical TomeMagical Tome is a unified platform for enterprise sellers and account managers. We use cutting-edge models to simplify complex research and strategic planning for sellers. Our system is tuned and customized by a team of experienced sellers, engineers, and researchers. We design and build Magical Tome in close partnership with our early...
-
AI/ML Infrastructure Engineer
2 weeks ago
San Francisco, California, United States Magical Tome Full timeAbout Magical TomeTome is a unified platform for enterprise sellers and account managers. Our mission is to simplify complex research and strategic planning for sellers by leveraging state-of-the-art models.We use our expertise in AI/ML to surface the most actionable knowledge about a customer from within internal systems as well as from public information...
-
Core ML Researcher
1 day ago
San Francisco, United States Vast.ai Full timeAbout Us:At Vast.ai, we value creativity, energy, drive and teamwork. We are looking for talented people who share these values to join as we grow our team. Our vision is to widely distribute AI computing to reshape our future for the good of humanity. Come join us. If witnessing the birth of AGI excites you, we can’t wait to hear from you!Vast.ai is a...
-
Founding Engineer
3 weeks ago
San Francisco, United States Pear VC Full timeAbout Us: Mustafa and Varun met at Harvard, where they both did research in the intersection of computation and evaluations. Between them, they have authored multiple published papers in the machine learning domain and hold numerous patents and awards. Drawing on their experiences as tech leads at Snowflake and Lyft, they founded NomadicML to solve a...
-
Research Engineer, LLM
2 days ago
San Francisco, United States Anyscale Full timeAbout Anyscale:At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have...
-
Research Engineer, LLM
12 hours ago
San Francisco, United States Anyscale Full timeAbout Anyscale:At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have...
-
Staff Research Engineer
1 month ago
San Francisco, United States Strativ Group Full timeStaff Research Engineer We are currently partnered with a well-backed AI Safety startup who are on a mission to improve humanity's understanding of complex AI models and improve the safety and reliability of AI on a global scale. The Founding team consists of experienced, successful entrepreneurs and pioneering leaders from some of the world's top Research...
-
ML Engineer San Francisco
2 days ago
San Francisco, United States Tbwa ChiatDay Inc Full timeNavier AI is building engineering software for physics-driven design. We are starting by making Computational Fluid Dynamics simulations that are 1000x faster than current solutions. We're leveraging cutting-edge physics machine learning to accelerate traditionally compute-intensive simulations. Why? Because Engineers deserve better tools to drive...
-
ML Engineer San Francisco
2 months ago
San Francisco, United States Tbwa ChiatDay Inc Full timeNavier AI is building engineering software for physics-driven design. We are starting by making Computational Fluid Dynamics simulations that are 1000x faster than current solutions. We're leveraging cutting-edge physics machine learning to accelerate traditionally compute-intensive simulations. Why? Because Engineers deserve better tools to drive...
-
ML Systems Engineer
1 month ago
San Francisco, California, United States MERU Full timeMERU is seeking an experienced Machine Learning Architect to join our team.The role will involve working closely with our CTO to optimize our agent-based retrieval, including model architecture research, latency optimization, cloud infrastructure, and product roadmap.We're looking for someone with demonstrable experience in deep learning research, cloud...
-
Founding ML Research Engineer
16 hours ago
San Francisco, United States Recruiting from Scratch Full timeWho is Recruiting from Scratch: Recruiting from Scratch is a talent firm that focuses on placing the best candidate for our clients. Our team is 100% remote and we work with teams across North America, South America, and Europe to help them hire. https://www.recruitingfromscratch.com/ About Us: Our product is doing for LLMs what Google did for websites. In...
-
Research Engineering Leader
2 weeks ago
San Francisco, California, United States Autodesk Full timeAbout the JobWe're looking for a highly skilled Research Engineering Manager to join our team. In this role, you'll be responsible for leading the development of new ML-powered product features and working closely with AI researchers to build generative AI features in our products.Key ResponsibilitiesManage a team of research engineers to deliver...
-
Founding ML Research Engineer
2 days ago
San Francisco, United States Recruiting from Scratch Full timeWho is Recruiting from Scratch: Recruiting from Scratch is a talent firm that focuses on placing the best candidate for our clients. Our team is 100% remote and we work with teams across North America, South America, and Europe to help them hire. https://www.recruitingfromscratch.com/ About Us: Our product is doing for LLMs what Google did for websites. In...
-
Founding ML Research Engineer
11 hours ago
San Francisco, United States Recruiting from Scratch Full timeWho is Recruiting from Scratch: Recruiting from Scratch is a talent firm that focuses on placing the best candidate for our clients. Our team is 100% remote and we work with teams across North America, South America, and Europe to help them hire. https://www.recruitingfromscratch.com/ About Us: Our product is doing for LLMs what Google did for websites. In...
-
Founding ML Engineer
2 days ago
San Francisco, United States HealthLeap Full timeHealthLeap is pioneering AI-driven healthcare solutions, starting with malnutrition - one of medicine's most under diagnosed conditions. We are developing tools to identify, treat, and prevent malnutrition, improving patient outcomes while capturing missed financial value for our overburdened healthcare systems. But that's just the beginning. Our vision: a...
