Software Engineer, ML Infrastructure

2 weeks ago


San Francisco, United States Twelvelabs Full time

Who we are We’re a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world’s most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building foundation AI models that can accurately and instantly search exact moments within petabytes of video archives, generate coherent text summaries of videos, perform prompt-based video generation, and many more. The Twelve Labs platform provides access to its Large Visual Language Models (VLMs) through a suite of APIs that are trained on massive video datasets and learn to understand the meaning and context behind the visuals, conversations, and sounds within videos. Twelve Labs recently raised $17M in seed funding, recognized as one of CB Insights’ AI 100 companies within a year of its founding, and secured a massive compute resource through partnering with Oracle. We are hyper focused on delivering the Twelve Labs platform to our customers so they can build video understanding into their products and power dream features they could have only imagined. Part of the pathway to our rapid growth has been paved by the outstanding group of people united by the company’s mission. Beyond prominent venture capital firms such as Index Ventures and Radical Ventures, the Twelve Labs mission is backed by category building luminaries like Fei-Fei Li (Stanford HAI), Silvio Savarese (Salesforce), Oren Etzioni (AI2), Alexandr Wang (Scale), Lukas Biewald (W&B), Jack Conte (Patreon) and more. We are committed to creating a diverse and inclusive work environment where our team members can bring their full selves to work, bring out their potential, and most importantly, thrive together. We welcome kind, brilliant, and open minded people from all walks of life to our team. If joining this mission speaks to you, we encourage you to apply About the Role: As a Software Engineer - ML Infrastructure at Twelve Labs, you will play a crucial role in the ML Platform team, where your primary focus will be scaling the infrastructure to host one of the industry's most powerful video foundation models. Your responsibility will be to ensure the scalability, performance, and reliability of our model inference pipeline, which involves handling high volumes of traffic, video processing, and model deployment. As a Software Engineer - ML Infrastructure at Twelve Labs, you will:

Develop an end-to-end video processing pipeline that processes multimodal data (images, audio, etc.) in a video to fit the required format for models. Deploy ML models, ensuring consistent and optimal performance in both cloud (like AWS, Azure, GCP) and on-premise environments. Collaborate closely with DevOps and system engineering teams to ensure seamless deployments, rollbacks, and updates. Engage in troubleshooting and quick resolution of any deployment-related issues, ensuring minimal downtime and optimal user experience. You may be a good fit if you have:

Proficiency in Python and Go 3 years + experience in building and designing ML infrastructure. 5 years + software development experience, including experience in building ML infrastructure. Strong understanding of container ecosystems such as Docker and Kubernetes. Experience in deploying AI/ML models on cloud platforms such as AWS, Azure, GCP. Ability to communicate effectively in English with individuals from diverse language backgrounds and different timezones Desired Experience:

MS or PhD in Computer Science, Math, or equivalent real-world experience Experience in leading a team of engineers Experience in training deep learning models Experience in model deployment using Triton and TensorRT Proficiency in GPU Computing (i.e. CUDA) Interview Process Recruiter Phone Screen -> CTO Chat -> (Take-home Assignment) -> Technical Interview -> Culture Interview -> Reference Checks Even If there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs. We welcome applicants from all walks of life and are committed to equal opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger. Benefits and Perks

#J-18808-Ljbffr



  • San Francisco, United States Instabase Full time

    At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing some of the largest and most complex organizations in the world, and investors like Greylock, Andreessen Horowitz, and Index Ventures, our...


  • San Francisco, United States Instabase Full time

    At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing some of the largest and most complex organizations in the world, and investors like Greylock, Andreessen Horowitz, and Index Ventures, our...

  • Software Engineer

    19 hours ago


    San Francisco, CA, United States Karkidi Full time

    You’ll help in executing the roadmap for data infrastructure and systems to power the world’s first AI recruiter built by Moonhub. You'll play a pivotal role in the development of tools and infrastructure that democratize data access and enable core capabilities across the organization You’ll architect offline and online data pipelines to...


  • San Francisco, CA, United States X Corp. Full time

    Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we're on a mission to become a trusted global digital public square, committed to minimal censorship within legal boundaries. Our goal is to empower every user to freely create and share ideas, fostering open public...


  • San Francisco, CA, United States Replicate, Inc. Full time

    You're an infrastructure engineer, ideally with ML experience. We're growing fast and need your help scaling. We serve machine learning models. We deal with GPUs, optimize models, write prediction servers, set up clusters, and so on. All the hard stuff that companies doing ML would rather not deal with. Instead of being an ML infrastructure engineer at a...


  • San Francisco, CA, United States Replicate, Inc. Full time

    You're an infrastructure engineer, ideally with ML experience. We're growing fast and need your help scaling. We serve machine learning models. We deal with GPUs, optimize models, write prediction servers, set up clusters, and so on. All the hard stuff that companies doing ML would rather not deal with. Instead of being an ML infrastructure...


  • San Francisco, CA, United States Figma Full time

    We’re looking for engineers with a Machine Learning and Artificial Intelligence background to improve our products and build new capabilities. You will be building the core infrastructure to serve and deploy models efficiently, as well as world-class tooling that enables us to iterate on models quickly. . You will be combining industry best practices and...


  • San Jose, United States Conductor Full time

    What You’ll Do The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while...


  • San Jose, CA, United States Conductor Full time

    What You’ll Do The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while...


  • San Francisco, CA, United States CentML Full time

    About Us We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential. Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts...


  • San Francisco, CA, United States Twelve Labs Full time

    Who we are We’re a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world’s most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building...


  • San Francisco, California, United States Unlearn Full time

    We are advancing AI to power the future of medicine.At Unlearn, our purpose is to advance artificial intelligence (AI) to eliminate trial and error in medicine. We are innovating advanced machine learning methods to leverage generative AI in forecasting patient outcomes, starting with the domain of clinical trials. We produce AI-generated digital twins of...


  • San Francisco, CA, United States TRM Labs Full time

    The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Senior Software Engineer on the Data Platform team, you will collaborate and partner with Data Scientists and Machine Learning teams to...


  • San Francisco, United States Unlearn.AI Full time

    We are advancing AI to power the future of medicine. At Unlearn, our purpose is to advance artificial intelligence (AI) to eliminate trial and error in medicine. We are innovating advanced machine learning methods to leverage generative AI in forecasting patient outcomes, starting with the domain of clinical trials. We produce AI-generated digital twins of...


  • San Francisco, United States Twelve Labs Full time

    Who we are We're a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world's most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building...


  • San Francisco, United States Twelve Labs Full time

    Who we are We're a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world's most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building...


  • San Francisco, United States Abnormal Security Full time

    Job DescriptionJob DescriptionAbout the RoleAbnormal Security is looking for a Senior ML Infra Engineer to join the Detection Team. The Detection Division is focused on building the world's most advanced technology for identifying and stopping email and cloud-based attacks that were previously undetectable and help make the world a safer place. As an ML...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of machine learning operations! At our company, we're driving the next wave of AI revolution through cutting-edge ML operations technologies. Our mission is to develop scalable and reliable ML systems that empower businesses and revolutionize industries. Join us and be part of a...


  • San Francisco, CA, United States X Corp. Full time

    Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we're on a mission to become a trusted global digital public square, committed to minimal censorship within legal boundaries. Our goal is to empower every user to freely create and share ideas, fostering open public...

  • Software Engineer

    6 days ago


    San Francisco, California, United States Equilibrium Energy Full time

    About our CompanyEquilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...