Sr. Data Engineer

3 weeks ago

San Francisco, United States hims & hers Full time

We're looking for a savvy and experienced

Senior Data Engineer

to join the Data Platform Engineering team at Hims. As a Senior Data Engineer, you will work with the analytics engineers, product managers, engineers, security, DevOps, analytics, and machine learning teams to build a data platform that backs the self-service analytics, machine learning models, and data products serving 900,000+ Hims & Hers users.

You Will:

Architect and develop data pipelines to optimize performance, quality, and scalability

Build, maintain & operate scalable, performant, and containerized infrastructure required for optimal extraction, transformation, and loading of data from various data sources

Design, develop, and own robust, scalable data processing and data integration pipelines using Python, dbt, Kafka, Airflow, PySpark, SparkSQL, and REST API endpoints to ingest data from various external data sources to Data Lake

Develop testing frameworks and monitoring to improve data quality, observability, pipeline reliability, and performance

Orchestrate sophisticated data flow patterns across a variety of disparate tooling

Support analytics engineers, data analysts, and business partners in building tools and data marts that enable self-service analytics

Partner with the rest of the Data Platform team to set best practices and ensure the execution of them

Partner with the analytics engineers to ensure the performance and reliability of our data sources

Partner with machine learning engineers to deploy predictive models

Partner with the legal and security teams to build frameworks and implement data compliance and security policies

Partner with DevOps to build IaC and CI/CD pipelines

Support code versioning and code deployments for data Pipelines

You Have:

8+ years of professional experience designing, creating and maintaining scalable data pipelines using Python, API calls, SQL, and scripting languages

Demonstrated experience writing clean, efficient & well-documented Python code and are willing to become effective in other languages as needed

Demonstrated experience writing complex, highly optimized SQL queries across large data sets

Experience with cloud technologies such as AWS and/or Google Cloud Platform

Experience with Databricks platform

Experience with IaC technologies like Terraform

Experience with data warehouses like BigQuery, Databricks, Snowflake, and Postgres

Experience building event streaming pipelines using Kafka/Confluent Kafka

Experience with modern data stack like Airflow/Astronomer, Databricks, dbt, Fivetran, Confluent, Tableau/Looker

Experience with containers and container orchestration tools such as Docker or Kubernetes

Experience with Machine Learning & MLOps

Experience with CI/CD (Jenkins, GitHub Actions, Circle CI)

Thorough understanding of SDLC and Agile frameworks

Project management skills and a demonstrated ability to work autonomously

Nice to Have:

Experience building data models using dbt

Experience with Javascript and event tracking tools like GTM

Experience designing and developing systems with desired SLAs and data quality metrics

Experience with microservice architecture

Experience architecting an enterprise-grade data platform

#J-18808-Ljbffr

  • Sr. Data Engineer

    3 weeks ago

    San Francisco, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance...

  • Sr. Data Engineer

    3 weeks ago

    San Francisco, California, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...

  • Sr. Data Engineer

    4 days ago

    San Francisco, United States SS&C Technologies Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Sr. Data Engineer

    1 week ago

    San Francisco, United States SS&C Technologies Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Senior Data Engineer

    1 week ago

    San Francisco, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role in...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...

  • Sr Backend Engineer

    1 week ago

    San Francisco, United States TalentFish Full time

    Job Title: Sr Backend Engineer Primary Location: Remote Position Type: Direct Hire Overview TalentFish is casting a line for a Sr Backend Engineer. This is a remote direct hire role. This is a pivotal technical leadership role, crafting an immersive and user-friendly healthcare app using ReactJS, Firebase, and Node.js. What You Bring To The Role. Bachelor's...

  • Data Engineer

    2 days ago

    San Francisco, United States Bayone Full time

    Your role at Sephora: As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely with other team members like data architects and business analysts to understand...

  • Sr. Data Analyst

    1 week ago

    San Francisco, United States Windfall Full time

    At Windfall, we aim to democratize access to people data and insights. We use a vast and varied data asset to help non-profits exceed their donation goals, and commercial companies achieve higher ROI on their marketing spend. As a Sr. Data Analyst at Windfall, your role will be to contribute to a deeper understanding of these data assets, and how they can be...

  • Sr Data Engineer

    1 week ago

    San Francisco, United States Varite Full time

    Pay rate range: $80-90/hr. True Job Title-Senior Infrastructure Automation Engineer Location-this is a hybrid position but we can consider remote candidates with exceptional technical expertise. This role will be subject to level 2 screening. In this role, you will get an opportunity to broadly apply your engineering skills across various technology...

  • Sr Data Engineer

    3 days ago

    San Francisco, United States Varite Full time

    Pay rate range: $70-90/hr. True Job Title-Senior Infrastructure Automation Engineer Location-this is a hybrid position but we can consider remote candidates with exceptional technical expertise. This role will be subject to level 2 screening. In this role, you will get an opportunity to broadly apply your engineering skills across various technology...

  • Sr. Data Analyst

    1 week ago

    San Francisco, United States Windfall Full time

    At Windfall, we aim to democratize access to people data and insights. We use a vast and varied data asset to help non-profits exceed their donation goals, and commercial companies achieve higher ROI on their marketing spend. As a Sr. Data Analyst at Windfall, your role will be to contribute to a deeper understanding of these data assets, and how they can be...

  • Sr Data Architect/Data Modeler

    3 days ago

    San Francisco, United States Flexton Inc. Full time

    Title: Sr Data Architect/Data ModelerRemote-Bay Area localRate : Payrate $90- $95/hr on W2 6+month contractMust Haves: Snowflake, ETL-Datawarehouse background, Good in SQL, DataLakeExperience with Healthcare or Insurance domain is plusJob Description:Mastery of dimensional modeling concepts, including star schema, snowflake schema, fact, and dimension...

  • Sr Data Architect/Data Modeler

    3 days ago

    San Francisco, United States Flexton Inc. Full time

    Title: Sr Data Architect/Data ModelerRemote-Bay Area localRate : Payrate $90- $95/hr on W2 6+month contractMust Haves: Snowflake, ETL-Datawarehouse background, Good in SQL, DataLakeExperience with Healthcare or Insurance domain is plusJob Description:Mastery of dimensional modeling concepts, including star schema, snowflake schema, fact, and dimension...

  • Senior Engineer, Data Engineering

    1 week ago

    San Francisco, United States Bayone Full time

    Senior Engineer, Data Engineering Job ID: 240167 Location Name: FSC REMOTE SF/NY/DC -173(USA_0173) Address: FSC, Remote, CA 94105, United States (US) Job Type: Full Time Position Type: Regular Job Function: Information Technology Remote Eligible:Yes Company Overview: At Sephora we inspire our customers, empower our teams, and help them become the best...

  • Sr. Software Engineer

    2 weeks ago

    San Francisco, United States Undisclosed Full time

    Great Sr Software Engineering opportunity; Full time permanent with benefits. Must be able to be onsite in San Francisco daily (Downtown area) in office initially and then some flexibility for remote after ramp up period. Bachelors in Computer Science a must. This position is for the Sr. Software Engineer who has experience with commercial, front end UI...

  • Sr. Software Engineer

    4 weeks ago

    San Francisco, United States Undisclosed Full time

    Great Sr Software Engineering opportunity; Full time permanent with benefits. Must be able to be onsite in San Francisco daily (Downtown area) in office initially and then some flexibility for remote after ramp up period. Bachelors in Computer Science a must. This position is for the Sr. Software Engineer who has experience with commercial, front end UI...

  • Sr. Software Engineer

    3 weeks ago

    San Francisco, United States Undisclosed Full time

    Great Sr Software Engineering opportunity; Full time permanent with benefits. Must be able to be onsite in San Francisco daily (Downtown area) in office initially and then some flexibility for remote after ramp up period. Bachelors in Computer Science a must. This position is for the Sr. Software Engineer who has experience with commercial, front end UI...

  • Sr. Software Engineer

    1 day ago

    San Jose, United States Balbix, Inc. Full time

    ENGINEERING Balbix, Inc. in San Jose, CA seeks Sr. Software Engineer: Design technology architecture for data integrations & connectors. Implement & code for the designed architecture to handle data sources & integrations. Part-time telecommuting allowed. $184,662/yr. - $194,662/yr. Email res (must reference Job Code #41776) to HR@balbix.com.