Lead ML Systems Engineer

3 weeks ago

San Francisco CA, United States Twelve Labs Full time

Who we are

We’re a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world’s most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building foundation AI models that can accurately and instantly search exact moments within petabytes of video archives, generate coherent text summaries of videos, perform prompt-based video generation, and many more. The Twelve Labs platform provides access to its Large Visual Language Models (VLMs) through a suite of APIs that are trained on massive video datasets and learn to understand the meaning and context behind the visuals, conversations, and sounds within videos.

Twelve Labs recently raised $17M in seed funding, recognized as one of CB Insights’ AI 100 companies within a year of its founding, and secured a massive compute resource through partnering with Oracle. We are hyper focused on delivering the Twelve Labs platform to our customers so they can build video understanding into their products and power dream features they could have only imagined.

Part of the pathway to our rapid growth has been paved by the outstanding group of people united by the company’s mission. Beyond prominent venture capital firms such as Index Ventures and Radical Ventures, the Twelve Labs mission is backed by category building luminaries like Fei-Fei Li (Stanford HAI), Silvio Savarese (Salesforce), Oren Etzioni (AI2), Alexandr Wang (Scale), Lukas Biewald (W&B), Jack Conte (Patreon) and more.

We are committed to creating a diverse and inclusive work environment where our team members can bring their full selves to work, bring out their potential, and most importantly, thrive together. We welcome kind, brilliant, and open minded people from all walks of life to our team. If joining this mission speaks to you, we encourage you to apply

About the Role:

As the Lead ML Systems Engineer at Twelve Labs, you will lead the ML Engineering team, driving the development of optimal machine learning systems for video foundation (VFM) and language model (VLM) in production. Your role encompasses the entire spectrum of machine learning engineering, from optimizing and scaling the inference infrastructure, which involves extensive video processing both in the cloud and on-premise, to model deployment and operations, and data infrastructure. VFMOps & VLMOps is central to our user experience as it dictates the latency and deployment speed of the trained model.

For the first 3 to 6 months, you will be hands on and actively contribute as an individual contributor in our development process. As the lead, you will set the technical strategies and goals, recruit top talent, and be responsible for your team’s success, ensuring our machine learning systems exceed user expectations in terms of speed, efficiency, and reliability. Your expertise will be key in overcoming challenges related to processing vast amounts of video data and deploying sophisticated models in production. Together with your team, you will work to enhance our VFMOps & VLMOps, contributing to a superior user experience that distinguishes Twelve Labs from its competitors. Your leadership, technical expertise, and commitment to excellence will be critical to our team's success and our users' satisfaction.

You will:

  • Prioritize the team’s work in building and improving our machine learning systems in production for video foundation and language model (VFM & VLM), in collaboration with senior engineers and other stakeholders
  • Inference Infrastructure: Construct the most performant, scalable, and reliable inference engine optimized for Twelve Lab’s video foundation and language models
  • ML Deployment & Operations (VFMOps / VLMOps): Lead the initiative in serving the model in the most optimized manner, deploying the pipeline, and automating the model training to deployment process
  • Data: Oversee the data infrastructure and preparation of high-quality video data for our training runs
  • Design processes (e.g. postmortem review, incident response, on-call rotations) that help the team operate effectively
  • Coach and develop your reports to decide how they would like to advance in their careers and help them do so
  • Run the team’s recruiting efforts through a period of rapid growth

You may be a good fit if you have:

  • 10+ years of software development experience, including experience in machine learning engineering
  • 5+ years of experience in building end-to-end machine learning systems encompassing infrastructure, MLOps, and data management
  • You have experience working with engineers at different levels and have coached them in their career development
  • 2+ years of experience managing high output engineering teams
  • Proficiency in working with video processing and data pipelining
  • Experience in establishing and maintaining secure software and system development environments

Desired Experience:

  • MS or PhD in Computer Science, Math, or equivalent real-world experience
  • Fast-paced startup engineering experience
  • Experience working with large scale models
  • Experience working with both cloud and on-premise environment
  • ML research experience would be helpful, as this role requires interchangeable effort on both research side and software side
  • Experience in handling large-scale computing system and firm understanding on scale-up and scale-out approach in cloud environment

Relevant Tech Stack:

  • Language: Python, Golang, C++, CUDA
  • ML / Platform: PyTorch, Docker, Kubernetes, Terraform
  • ML Demo page: Gradio, Streamlit
  • MLOps: MLFlow, Weights and Biases
  • Data: Pachyderm, DVC
  • Automation: Airflow, Kubeflow
  • Model serving: Triton, FasterTransformer

Interview and Onboarding Process

Recruiter Phone Screen -> Phone Interview -> Technical Screen -> Onsite Interview -> Reference Checks

We're also excited to share that we'll do global onboarding in Seoul for all new hires (company-sponsored travel).

Even If there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs.

We welcome applicants from all walks of life and are committed to equal opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger.

Benefits and Perks

???? An open and inclusive culture and work environment.

????‍???? Work closely with a collaborative, mission-driven team on cutting-edge AI technology.

???? Full health, dental, and vision benefits

✈️ Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.

???? Remote-flexible, offices in San Francisco and Seoul and coworking stipend

???? VISA support (such as H1B and OPT transfer for US employees)#J-18808-Ljbffr

  • Research Engineer

    2 weeks ago

    San Francisco, United States Eon Systems PBC Full time

    Eon collects large-scale neuroscientific data sets to train machine learning based brain emulations. We believe it is possible to scale this technology in a safe, secure and trustworthy manner in the next decade and empower humanity in unprecedented ways. Role Collaborating with a diverse team, including product managers, researchers, and engineering...

  • Senior ML Engineer

    3 weeks ago

    San Francisco, United States Cleanlab Full time

    At Cleanlab you willPioneer novel software systems for the rapidly growing field of data-centric AI. Our tools enable data scientists/engineers (across all industries) to effectively diagnose/fix issues in their datasets thus improving the quality of their business’s core asset.Determine how to best leverage new Generative AI advances/infrastructure for...

  • Sr. Backend Software Engineer

    3 weeks ago

    San Francisco, United States Abnormal Security Full time

    Job DescriptionJob DescriptionAbout the RoleAbnormal Security is looking for a Senior ML Infra Engineer to join the Detection Team. The Detection Division is focused on building the world's most advanced technology for identifying and stopping email and cloud-based attacks that were previously undetectable and help make the world a safer place. As an ML...

  • Staff Engineer, ML Foundations

    1 day ago

    San Francisco, United States Stripe Full time

    Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of...

  • ML Engineer

    6 days ago

    San Jose, United States Agile Datapro Full time

    Job DescriptionJob DescriptionAbout the CompanyOur client's robust infrastructure and commitment to innovation, it has become a trusted name in digital finance, facilitating seamless transactions for individuals and businesses alike. Founded in 1998, It's global reach and user-friendly interface continue to redefine the way we engage in financial...

  • Sr ML Engineer

    3 weeks ago

    San Jose, United States Avance Consulting Full time

    Role: Sr ML EngineerLocation: San Jose CA - Onsite3+ years of experience working on large feed products, especially in improving feed quality5+ years experience in Product management.Prior experience with AI/ML is a mustAbility to deep dive into technical details of ML systems with engineers, and metrics with the Data Science teamExposure to AI model...

  • Sr ML Engineer

    3 weeks ago

    San Jose, United States Avance Consulting Full time

    Role: Sr ML EngineerLocation: San Jose CA - Onsite3+ years of experience working on large feed products, especially in improving feed quality5+ years experience in Product management.Prior experience with AI/ML is a mustAbility to deep dive into technical details of ML systems with engineers, and metrics with the Data Science teamExposure to AI model...

  • Sr ML Engineer

    2 days ago

    San Jose, United States Tech MahindraAvance Consulting Full time

    Sr ML Engineer Location :- San Jose CA ( Day 1 onsite) 3+ years of experience working on large feed products, especially in improving feed quality 5+ years experience in Product management. Prior experience with AI/ML is a must Ability to deep dive into technical details of ML systems with engineers, and metrics with the Data Science team Exposure to...

  • Technical Lead-AIML

    2 weeks ago

    San Francisco, United States Devsinc LLC Full time

    Devsinc is seeking a highly skilled Artificial Intelligence and Machine Learning (AIML) Engineer to join our team. As an AIML Engineer, you will be responsible for developing and implementing AI and ML solutions to solve complex business problems. You will collaborate with cross-functional teams to design and deploy AI-powered applications and algorithms....

  • ML Engineering Manager

    3 weeks ago

    San Mateo, United States Next Ventures Full time

    A Series A Start-Up, is looking to transform the online shopping experience by offering a platform, where shoppers can engage and transact directly within a conversation thread (i.e. Whats App, FB Messenger, etc).At this time, they are seeking Machine Learning Engineering Manager where you will own the product road map and scale their AI products and...

  • ML Engineering Manager

    2 weeks ago

    San Mateo, United States Next Ventures Full time

    A Series A Start-Up, is looking to transform the online shopping experience by offering a platform, where shoppers can engage and transact directly within a conversation thread (i.e. Whats App, FB Messenger, etc).At this time, they are seeking Machine Learning Engineering Manager where you will own the product road map and scale their AI products and...

  • ML Engineering Manager

    2 weeks ago

    San Mateo, United States Next Ventures Full time

    A Series A Start-Up, is looking to transform the online shopping experience by offering a platform, where shoppers can engage and transact directly within a conversation thread (i.e. Whats App, FB Messenger, etc).At this time, they are seeking Machine Learning Engineering Manager where you will own the product road map and scale their AI products and...

  • Senior Software Engineer

    2 weeks ago

    San Francisco, United States Focal Systems Full time $160,000 - $180,000

    Location: onsite in office 2x per week.Salary: $160 - 180k + stock options.Company Description:Focal Systems is the industry leader in retail AI solutions. We are a Silicon Valley based startup that has more than doubled in size every year since our founding. We are a Deep Learning first company. Our mission is to automate and optimize brick and mortar...

  • Full Stack

    3 weeks ago

    San Francisco, United States Model ML Full time

    About ModelML Model ML is an AI tool that speeds up research and due diligence for the financial sector: investment banks, family offices, private equity, VCs etc. We're two brothers both building our second YC company. Arnie previously built Fancy (S17), raised ~$6 million in funding, and later sold to Gopuff. Chaz previously built FatLlama (S17), raised...

  • ML Engineer

    2 weeks ago

    San Francisco, United States Anthropic Limited Full time

    As a ML Engineer on our Solutions Architect team, you will drive the adoption of frontier AI by developing bespoke and finetuned LLM solutions for top enterprises. You’ll leverage your customer-facing engineering experience and technical skills to architect innovative solutions that address our customers' business needs, meet their technical requirements,...

  • Technical Lead-AIML

    3 weeks ago

    San Francisco, United States Devsinc, LLC Full time

    Devsinc is seeking a highly skilled Artificial Intelligence and Machine Learning (AIML) Engineer to join our team. As an AIML Engineer, you will be responsible for developing and implementing AI and ML solutions to solve complex business problems. You will collaborate with cross-functional teams to design and deploy AI-powered applications and...

  • Machine Learning

    6 days ago

    San Jose, United States Epik Solutions Full time

    Job DescriptionJob DescriptionML Engineer San Jose, CA (Remote)Interview Process: 3 Rounds of InterviewJob Description:We are seeking a talented Machine Learning Engineer with expertise in software engineering to join our team. As a Machine Learning Engineer, your primary responsibility will be to develop machine learning (ML) solutions that focus on...

  • ML Engineer

    6 days ago

    San Jose, United States enexusglobal Full time

    Job DescriptionJob DescriptionML Engineer (W2 Only)Sanjose, CA Remote is fine Exp: 7+ Skills: Machine Learning, Python, Hadoop Job Description:We are seeking a talented Machine Learning Engineer with expertise in software engineering to join our team. As a Machine Learning Engineer, your primary responsibility will be to develop machine learning (ML)...

  • Staff Machine Learning Engineer, Applied ML Accelerator

    1 week ago

    San Francisco, United States Stripe Full time

    Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of...

  • Lead QA

    2 days ago

    San Francisco, United States NovumTech Partners Full time

    Responsibilities Developing and hardening our quality pipeline Breaking down stories into testable components Developing and executing test plans Expanding our test automation environment Requirements MS or BS in a relevant field - e.g., Software Engineering, Computer Engineering, Computer Sci-ence, Information Technology 6+ years professional QA...