Director, Data Engineering

1 month ago


San Francisco CA, United States Tubi Tv Full time

The Director of Data Engineering will own and build the core components of Tubi’s batch and Streaming data platform. This includes building out and running small teams to focus on the data lake, governance, batch compute and streaming pipelines for our data. With realtime data becoming more important for reactive AI pipelines, Tubi’s data infrastructure is key to being able to build and iterate quickly with high volume datasets that update at 100s of thousands of events per second.

An integral pillar of the Data Platform team, you will be responsible for directing, growing, and up-leveling a hybrid remote team of engineers. You will work closely with your leadership peers to refine and grow Tubi’s data platform into a well oiled data mesh. A hands on leadership role, this role will require you to get your hands dirty to lead by example when necessary, as well as handle the direction and strategy for your team.

Responsibilities:

  • Own data infrastructure at Tubi, including small teams that handle
    • ML Data Infrastructure
    • Job orchestration
    • Data Governance / Data Retention
    • Streaming Infrastructure
  • Cost Containment / Forecasting
  • Security and Infrastructure Planning
    • Work closely with the Tubi infrastructure team to make sure data infrastructure is secure and easily maintained
    • Own infrastructure as code tooling to help engineers easily deploy data infrastructure
  • Hiring & Mentoring
    • Manage and grow a team of 8 hybrid engineers and managers, turning them into self-sustaining, high functioning teams.

Your Background:

  • You've been in the trenches building high volume batch & streaming data pipelines and the cloud infrastructure to support them
  • You have 4+ years of experience in a leadership role, directly managing managers & engineers
  • You were/are an expert coder with 5+ years of hands on development experience (preferably in python, scala, or java)
  • You have significant experience with big data streaming platforms (Spark Streaming or Flink)
  • Experience with job orchestration tools like Airflow or Dagster
  • Experience with cloud platforms (Preferably AWS)
  • Experience building out and supporting privacy compliance for GDPR or CCPA

#LI-Remote #LI-MQ1

#J-18808-Ljbffr

  • San Francisco, United States Strandberg Engineering Full time

    DIRECTOR OF OPERATIONSStrandberg Engineering is a 24-person structural engineering firm located in the heart of the diverse and lively Mission District of San Francisco. We enjoy working in a collaborative environment, bringing architectural visions to life, and coordinating creative solutions during design and construction.   Strandberg is currently...


  • San Francisco, United States Strandberg Engineering Full time

    DIRECTOR OF OPERATIONSStrandberg Engineering is a 24-person structural engineering firm located in the heart of the diverse and lively Mission District of San Francisco. We enjoy working in a collaborative environment, bringing architectural visions to life, and coordinating creative solutions during design and construction.   Strandberg is currently...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...


  • San Francisco, United States VAST Data Full time

    Description VAST Data is looking for a Regional Sales Director to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history.In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through...


  • San Francisco, United States Nobell Foods Full time

    Nobell Foods is creating cheese and other dairy products from plant-derived dairy proteins for the 99% of people who are unwilling to compromise on taste and price. Nobell is made up of a team of passionate scientists, explorers, and storytellers on a mission to radically change the way we make food, so it’s better for you, the animals, and the planet. We...


  • San Francisco, United States VAST Data Full time

    DescriptionVAST Data is looking for a Regional Sales Director to join our growing team!This is a great opportunity to be part of the fastest-growing infrastructure company in history.In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...


  • San Francisco, United States Snorkel AI, Inc. Full time

    We are looking for a Director of Engineering to lead our AI Platform team. Our AI Platform team builds innovative software systems to power the Snorkel Flow platform. This includes services to train and serve generative AI and machine learning models using novel data-centric techniques, libraries to support AI workflows for a variety of data modalities and...

  • Data Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    4 weeks ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...


  • San Francisco, United States Gulfstream SP Full time

    Commercial HVAC/Plumbing Director of Engineering, PE - San Francisco Bay Area About Us We are a leading engineering firm delivering exceptional mechanical, electrical, and plumbing (MEP) services. With headquarters in the San Francisco Bay Area, we specialize in large-scale commercial projects across various sectors, including stadiums, educational...


  • San Francisco, CA, United States Discord Full time

    Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...


  • Alameda, CA, United States Abbott Full time

    Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.The...

  • Lead Data Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Data Engineer

    1 month ago


    San Francisco, California, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD


  • San Francisco, CA, United States Rippling Full time

    About RipplingRippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first time ever, you can manage and automate every part of the employee lifecycle in a single system.Take onboarding, for example....


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    3 weeks ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...


  • San Diego, United States Qureator Full time

    Qureator, Inc.About UsHeadquartered in San Diego, California, we are an early-stage, well-funded Techbio company specializing in innovative drug discovery solutions. Our proprietary 3D organ-on-a-chip platform, Curiochips, offers significant advantages in accurately recapitulating both normal and disease states of the human body. This capability has been...


  • San Diego, United States Qureator Full time

    Qureator, Inc.About UsHeadquartered in San Diego, California, we are an early-stage, well-funded Techbio company specializing in innovative drug discovery solutions. Our proprietary 3D organ-on-a-chip platform, Curiochips, offers significant advantages in accurately recapitulating both normal and disease states of the human body. This capability has been...


  • San Diego, United States Qureator Full time

    Qureator, Inc.About UsHeadquartered in San Diego, California, we are an early-stage, well-funded Techbio company specializing in innovative drug discovery solutions. Our proprietary 3D organ-on-a-chip platform, Curiochips, offers significant advantages in accurately recapitulating both normal and disease states of the human body. This capability has been...