Data Engineer

2 weeks ago


San Francisco, United States Harnham Full time

Data Engineer

1 Year Contract

Hybrid (2 Days Onsite)

$75-85/hr


We are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge technologies to process large volumes of data, integrate machine learning models, and build scalable data pipelines that will power our e-commerce platforms and improve customer experiences.


Role Overview


As a data engineer, you will play a key role in shaping and implementing our data strategy. You will be responsible for leading the development and deployment of data processing pipelines, driving machine learning model integration, and ensuring high-quality, scalable, and reliable data platforms.


Key Responsibilities

  • Drive the design, implementation, and optimization of data pipelines for heavy-volume data processing, including ETL workflows using Spark and Python.
  • Build and enhance large-scale data platforms, data lakes, and data warehouses using technologies like Databricks and Delta Lake.
  • Oversee the integration of machine learning models into production systems. Work through all phases of model development, including data preprocessing, feature engineering, and model deployment.
  • Ensure near-real-time, batch, and real-time data pipelines are efficient, accurate, and meet the required performance metrics.
  • Work hands-on with deep learning frameworks such as PyTorch, TensorFlow, and Keras to integrate ML models in a production environment.


Required Skills and Experience

  • 8-10 years of experience in data engineering, data processing, data platforms, or equivalent.
  • Strong proficiency in Python and Spark (5+ years of hands-on experience) for building scalable ETL workflows and data pipelines.
  • Hands-on experience in ETL workflows using Spark and Python.
  • Designing and implementing large-scale data processing pipelines for batch and real-time data flows.
  • Building and deploying ML models in a production environment, with expertise in data preprocessing, feature engineering, and model engineering.
  • Experience with Databricks or similar data platforms for managing and processing large-scale data workflows.



  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • Data Engineer

    2 weeks ago


    san francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 weeks ago


    san francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 weeks ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...


  • San Francisco, California, United States Amazon Data Services, Inc. Full time

    About Amazon Data Services, Inc.At Amazon Data Services, Inc., we're passionate about delivering exceptional customer experiences. As the world's most comprehensive and broadly adopted cloud platform, we're committed to innovation and excellence in all that we do.We're seeking a highly skilled Data Center Operations Specialist to join our team. In this...

  • Lead Data Engineer

    2 weeks ago


    san francisco, United States Unreal Gigs Full time

    DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business...

  • Data Engineer

    2 months ago


    San Francisco, United States Replicate Full time

    You’re a generalist data and analytics expert who builds data infrastructure at scale. You act like an owner and have a desire to lead. You’ve likely been a data engineer at traditional companies but you’re ready to be the first data hire at a startup.Replicate is a complex business and we need solid data infrastructure to guide it. You’ll own this...

  • Data Engineer

    2 months ago


    san francisco, United States Replicate Full time

    You’re a generalist data and analytics expert who builds data infrastructure at scale. You act like an owner and have a desire to lead. You’ve likely been a data engineer at traditional companies but you’re ready to be the first data hire at a startup.Replicate is a complex business and we need solid data infrastructure to guide it. You’ll own this...

  • Data Engineer

    1 month ago


    san francisco, United States Replicate Full time

    You’re a generalist data and analytics expert who builds data infrastructure at scale. You act like an owner and have a desire to lead. You’ve likely been a data engineer at traditional companies but you’re ready to be the first data hire at a startup.Replicate is a complex business and we need solid data infrastructure to guide it. You’ll own this...

  • Software Engineer

    4 weeks ago


    San Francisco, United States Factory Full time

    Factory is looking for highly capable engineers focused on harnessing and managing data that powers both our internal AI-driven systems and external customer-facing features. What you will do and achieve Design, build, and maintain optimal data pipelines that support a variety of data consumers, from internal teams focused on Droid optimization to external...

  • Data Engineer

    5 days ago


    San Francisco, United States ZipRecruiter Full time

    Job DescriptionAre you passionate about designing, building, and maintaining data pipelines that support robust data architectures and facilitate seamless data flow? Do you excel in creating scalable solutions that empower data-driven decision-making? If you’re ready to develop and optimize data systems that drive impactful analytics, our client has the...

  • AWS Data Engineer

    1 month ago


    san francisco, United States Norconsulting Global Recruitment Full time

    In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...

  • AWS Data Engineer

    1 month ago


    San Francisco, United States Norconsulting Global Recruitment Full time

    In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...


  • San Francisco, California, United States SynergisticIT Full time

    We are seeking a highly motivated and skilled Data Scientist/Engineer to join our team at SynergisticIT. As a Data Scientist/Engineer, you will be responsible for designing, developing, and implementing data-driven solutions to drive business growth and improve operational efficiency.Key Responsibilities:Design and develop data models and algorithms to solve...

  • Cloud Data Engineer

    6 months ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team...

  • Senior Data Engineer

    1 month ago


    San Francisco, United States Neon Redwood Full time

    About Neon Redwood Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities. ...


  • San Francisco, United States Braintrust Data Full time

    About the companyBraintrust is the end-to-end developer platform for building world-class AI products. AI development is a relatively new paradigm combining code and datasets, incrementally refining both using frequent evaluations. Our product lets you evaluate LLM applications and iteratively improve them, with a rich set of tools to visualize changes and...

  • Data Engineering Lead

    4 weeks ago


    San Francisco, California, United States Windfall Full time

    About the Role:Windfall is seeking a highly skilled Data Engineer to join our core data team. As a Sr. Data Engineer, you will be responsible for designing and building the pipelines for massive datasets, taking them from inception to exploration to production and customer use.Key Responsibilities:Construct data pipelines to ingest and merge billions of...


  • San Francisco, United States Rockerbox, Inc Full time

    Senior Data Engineer (Senior Software Engineer II)Rockerbox empowers marketing executives to confidently make data-driven decisions, helping brands such as Tula, Figs, and Burton with the strategic decision-making that drives growth. To do so, Rockerbox offers a unique suite of product lines that centralize data and offer diversified measurement...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States Rockerbox, Inc Full time

    Senior Data Engineer (Senior Software Engineer II)Rockerbox empowers marketing executives to confidently make data-driven decisions, helping brands such as Tula, Figs, and Burton with the strategic decision-making that drives growth. To do so, Rockerbox offers a unique suite of product lines that centralize data and offer diversified measurement...