Data Engineer

2 months ago


san francisco, United States Harnham Full time

Data Engineer

1 Year Contract

Hybrid (2 Days Onsite)

$75-85/hr


We are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge technologies to process large volumes of data, integrate machine learning models, and build scalable data pipelines that will power our e-commerce platforms and improve customer experiences.


Role Overview


As a data engineer, you will play a key role in shaping and implementing our data strategy. You will be responsible for leading the development and deployment of data processing pipelines, driving machine learning model integration, and ensuring high-quality, scalable, and reliable data platforms.


Key Responsibilities

  • Drive the design, implementation, and optimization of data pipelines for heavy-volume data processing, including ETL workflows using Spark and Python.
  • Build and enhance large-scale data platforms, data lakes, and data warehouses using technologies like Databricks and Delta Lake.
  • Oversee the integration of machine learning models into production systems. Work through all phases of model development, including data preprocessing, feature engineering, and model deployment.
  • Ensure near-real-time, batch, and real-time data pipelines are efficient, accurate, and meet the required performance metrics.
  • Work hands-on with deep learning frameworks such as PyTorch, TensorFlow, and Keras to integrate ML models in a production environment.


Required Skills and Experience

  • 8-10 years of experience in data engineering, data processing, data platforms, or equivalent.
  • Strong proficiency in Python and Spark (5+ years of hands-on experience) for building scalable ETL workflows and data pipelines.
  • Hands-on experience in ETL workflows using Spark and Python.
  • Designing and implementing large-scale data processing pipelines for batch and real-time data flows.
  • Building and deploying ML models in a production environment, with expertise in data preprocessing, feature engineering, and model engineering.
  • Experience with Databricks or similar data platforms for managing and processing large-scale data workflows.



  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...


  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • Staff Data Scientist

    4 weeks ago


    San Francisco, United States Data Masked Full time

    This range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...


  • San Francisco, United States Data Masked Full time

    Experienced Data Scientist Machine Learning - Identity Verification We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions...

  • Data Engineer

    2 months ago


    San Francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 months ago


    san francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    4 hours ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    2 months ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    7 days ago


    San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at Databricks. As a Data Engineer, you will play a critical role in designing and developing scalable data processing systems that meet the needs of our customers.The ideal candidate will have 3-5 years of experience in customer-facing roles, such as Technical Account Management or...

  • Data Engineer

    3 weeks ago


    San Francisco, California, United States Perplexity AI Full time

    Perplexity AI is rapidly scaling both in number of use cases and users. We're seeking an experienced Data Engineer to help build our end-to-end data stack and flywheel.The successful candidate will collaborate closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure. Key responsibilities...

  • Data Engineer

    7 days ago


    San Francisco, United States Jacobs Full time

    Jacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...

  • Data Architect

    1 week ago


    San Francisco, California, United States People Data Labs Full time

    Job OverviewWe are a leading provider of high-quality B2B people and company data. Our innovative, fast-growing team is backed by world-class investors.Key Responsibilities:Develop self-serve product offerings to attract new customers and drive revenue growth.Design and implement core tools for our customer success team.Translate business requirements into...

  • Data Engineer

    1 week ago


    San Francisco, California, United States Tbwa ChiatDay Inc Full time

    We are seeking a skilled Data Engineer to join our talented team of engineers who share a mission to make data easily accessible. As part of our growing engineering team, you will be responsible for building and delivering world-class technology.The ideal candidate will have strong Computer Science fundamentals and 5+ years of industry experience building...


  • San Francisco, California, United States Unreal Gigs Full time

    About the Role:We're seeking an experienced Data Engineering Director to join our team at Unreal Gigs. As a key member of our data engineering team, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines.Responsibilities:Lead Data Engineering Efforts:...


  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.

  • Lead Data Engineer

    5 months ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...

  • Data Engineer

    5 hours ago


    San Francisco, United States Perplexity AI Full time

    Job DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...

  • Data Engineer

    4 weeks ago


    San Francisco, United States Perplexity AI Full time

    Job DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...

  • Data Engineer

    1 week ago


    San Francisco, California, United States EPAM Full time

    At EPAM, we are seeking a skilled Data Engineer to join our team. With a salary range of $160K - $170K, this role is an excellent opportunity for those looking to excel in the field of machine learning.We are a global leader in digital platform engineering and development services, committed to making a positive impact on our customers, employees, and...