Data Engineering Leader

5 days ago


San Francisco, California, United States Windfall Full time

We're seeking a highly skilled Data Engineering Leader to join our core data team at Windfall. As a key member of our team, you will be responsible for designing and building the core data asset that everything else at Windfall is built on top of.

Key responsibilities include constructing data pipelines to ingest and merge billions of individual entities into Windfall's core data asset, working closely with our data science team to run ML models on top of billions of data points, and building supporting data services and applications to orchestrate and monitor our data systems.

Some technology you will use includes cloud platform - GCP, programming languages - Java, Python, and Kotlin, data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra, distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark, and orchestration - Airflow.

Requirements include 8+ years of professional data engineering experience, significant experience working with Apache Beam/Spark/Flink or MapReduce, strong object-oriented programming ability, expert knowledge of distributed data processing, familiarity with different datastores, their differences, and appropriate usages, and experience at a sub-200 person company.

Preferred qualifications include previous experience in a player-coach role, proven experience taking a large project from ideation to production, experience leading greenfield projects, and working knowledge of cloud-native data engineering infrastructure.

We offer a comprehensive benefits package and a salary range of $140k - $200k in California and $120k - $200k in Colorado.



  • San Francisco, California, United States Kikoff Full time

    Job Title: Data Engineering LeaderWe are seeking a highly skilled Data Engineering Leader to join our team at Kikoff. As a key member of our data engineering function, you will be responsible for designing, building, and scaling high-leverage data models, foundational datasets, and scalable infrastructure that enables analytics, modeling, and...


  • San Francisco, California, United States Windfall Full time

    Windfall is seeking a seasoned Data Engineer to lead the development of our core data asset. As a key member of our data team, you will design and build scalable data pipelines to ingest and merge massive datasets, working closely with our data science and engineering teams.With a strong focus on collaboration and communication, you will ensure seamless...


  • San Francisco, California, United States Windfall Full time

    At Windfall, we're seeking a seasoned Data Engineer to spearhead the development of our core data asset. As a key member of our data team, you'll be responsible for designing and building scalable data pipelines that fuel our business.This is a unique opportunity to leverage your expertise in distributed data processing and cloud-native technologies to drive...


  • San Jose, California, United States TechnoGen Full time

    We are seeking a highly skilled Data Engineering Leader to join our team at TechnoGen. As a key member of our Data Science and Engineering team, you will be responsible for designing, building, and launching efficient and reliable data pipelines to support our business needs.Key Responsibilities:Partner with leadership, engineers, and data scientists to...


  • San Francisco, California, United States California Water Data Consortium Full time

    The California Water Data Consortium is seeking a visionary leader to serve as its next Chief Executive Officer.The ideal candidate will be an excellent communicator and proven leader who demonstrates a spirit of entrepreneurship and can provide thought leadership on California's highest impact water data opportunities.The successful candidate will have at...


  • San Francisco, California, United States California Water Data Consortium Full time

    The California Water Data Consortium is seeking a visionary leader to serve as its next Chief Executive Officer.The ideal candidate will have a proven track record of strategic planning, program development, and team management.They will oversee and help expand a talented small team of professionals, which will manage regular meetings of the Board of...


  • San Francisco, California, United States Pendulum Full time

    Pendulum is a revolutionary company leading a global movement to improve physical and mental health by understanding, restoring, and enhancing the human microbiome.The company has made significant breakthroughs in the field, creating proprietary probiotic pipelines and a unique discovery platform to identify key bacterial strains and prebiotics.As a Director...

  • Data Science Leader

    2 weeks ago


    San Francisco, California, United States Robotics Technologies LLC Full time

    Job Title: Director of Data ScienceOur client, a leading company in San Francisco, is seeking a highly skilled Director of Data Science to lead their analytics team. The ideal candidate will have a strong background in data analysis, machine learning, and programming, with excellent leadership and communication skills.The Director of Data Science will be...


  • San Francisco, California, United States California Water Data Consortium Full time

    The California Water Data Consortium is seeking a visionary leader to serve as its next Chief Executive Officer.The ideal candidate will have a proven track record of strategic planning, programmatic execution, and financial management.They will oversee and help expand a talented team of professionals, which will manage regular meetings of the Board of...

  • Data Science Leader

    1 week ago


    San Francisco, California, United States LHH Recruitment Solutions Full time

    We are seeking a highly skilled Data Science Leader to join our Ads Data Science team. This individual will play a key role in shaping the future of our advertising strategy by developing and executing advanced machine learning models and algorithms.Key Responsibilities:Developing and executing advanced machine learning models and algorithms to address...


  • San Francisco, California, United States STONE Resource Group Full time

    Unlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...


  • San Francisco, California, United States California Water Data Consortium Full time

    The California Water Data Consortium is seeking a visionary leader to serve as its next Chief Executive Officer.The ideal candidate will have a proven track record of strategic planning, programmatic execution, and financial management.They will oversee and help expand a talented team of professionals, which will manage regular meetings of the Board of...

  • Data Science Leader

    2 weeks ago


    San Francisco, California, United States LHH Recruitment Solutions Full time

    Job OverviewAs a key member of our Ads Data Science team, we are seeking a highly skilled Data Science Leader to drive the implementation of machine learning solutions across the organization. This individual will play a critical role in shaping the future of our advertising strategy and will be responsible for guiding the development and execution of...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States SS&C Technologies Full time

    Job DescriptionSS&C Technologies is seeking a highly skilled Senior Data Engineer to join our team in San Francisco, California. As a Senior Data Engineer, you will be responsible for designing and implementing a leading cloud platform using the latest big data, cloud native, and machine learning technologies.The ideal candidate will have a strong background...

  • Data Science Leader

    3 weeks ago


    San Francisco, California, United States LHH Recruitment Solutions Full time

    Job OpportunityWe are seeking a highly skilled Principal Data Scientist to join our Ads Data Science team in San Francisco, CA.This individual will play a key role in shaping the future of our advertising strategy, leveraging machine learning solutions to drive business growth.Responsibilities will include:Developing and executing advanced machine learning...


  • San Francisco, California, United States Pendulum Full time

    Pendulum is revolutionizing the way we understand and interact with the human microbiome. As a Director of Data Engineering, you will play a pivotal role in building and maintaining our data platform and infrastructure, driving data-driven decision-making and AI/ML initiatives.Key Responsibilities:Lead and mentor a high-performing data engineering team,...


  • San Francisco, California, United States Technology Partners Full time

    Job Title: Senior Engineering LeaderTechnology Partners is seeking a highly skilled Senior Engineering Leader to guide software development teams in crafting innovative solutions for the agriculture industry.Key Responsibilities:Lead innovation: Develop solutions aligning with strategic goals.Build relationships: Cultivate strategic partnerships internally...

  • Data Engineer

    5 days ago


    San Francisco, California, United States Syntricate Technologies Full time

    Data EngineerJob Summary: We are seeking a highly skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and other data engineering tools. You will work closely with our data team to ensure the accuracy and...


  • San Francisco, California, United States Robust Intelligence Full time

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our ML Data and Quality team at Robust Intelligence. As a key member of our team, you will be responsible for building the ML data infrastructure based on the requirements of the ML team and the product needs.Key Responsibilities:Design, develop, and deploy innovative AI solutions...

  • Data Engineer

    3 weeks ago


    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...