Lead Data Engineer

3 weeks ago


San Francisco, United States CareerBuilder Full time

My client a Series A startup on track to be fully profitable in 6 months is seeking a talented and experienced Lead Data Engineer to join their dynamic team. They are a remote first team, west coast based but geographically distributed across the US.

As a Lead

Data Lead , you will be building a Big Data ecosystem using Spark and Scala. This will be someone who can stand up and lead a new function, helping to set the data vision and strategy for the company. While being heavily hands-on in the near to midterm, the ability to build and own a team in the future is possible in.

Role Lead Data Engineer

As the Lead Data Engineer you will be a key player in designing and implementing the robust data infrastructure to power our data-heavy company. You will collaborate with our cross-functional teams to build out our core data pipelines, store data in optimal engines and formats, and feed our machine learning models.

This is an individual contributor role that will lead and own the data function. You will work hand in hand with VP of Engineering to define and implement a strategic vision for data engineering within the organization. Expertise in Scala and Spark, is a must have for this role.

What You'll Do

Design and implement a robust data infrastructure using Spark with Scala.
Collaborate with our cross-functional teams to design data solutions that meet
business needs.
Build out our core data pipelines, store data in optimal engines and formats, and feed
our machine learning models.
Leverage and optimize AWS resources.
Collaborate closely with the Data Science and other corss functional teams.

How We'll Define Success

Successful design and implementation of scalable and efficient data infrastructure.
Timely delivery and optimization of ETL processes.
Effective collaboration with cross-functional teams.
Seamless integration with Data Science for machine learning pipelines.

Youll Be Successful in This Role if You Have

Minimum of 7 years of experience in data engineering.
Proven experience building data infrastructure using Spark with Scala.
Familiarity with data lakes, cloud warehouses, and storage formats.
Strong proficiency in AWS services.
Expertise in SQL for data manipulation and extraction.
Excellent written and verbal communication skills.
Bachelor's degree in Computer Science or a related field.

Working Arrangement

This is a full-time, remote position. We believe in work-life balance and offer flexible working hours. However, they require Core Hours: 9- 1 pm. PST/ 12- 4 pm. EST.

The salary is competitive depending on experience . This opportunity also includes an annual bonus and stock.

Benefits And Perks

Employer paid health, dental and vision insurance
Disability & Life Insurance
Wellness Programs & Mental Health Benefits
Unlimited paid time off
401k with a match
Annual professional development stipend

#J-18808-Ljbffr


  • Lead Data Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting, and business intelligence. Join us...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and lead our efforts in...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead...


  • San Francisco, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: San Francisco, California Hybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data /...


  • San Francisco, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: San Francisco, California Hybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data /...


  • San Francisco, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: San Francisco, California Hybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data /...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is at the cutting edge of leveraging real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join us...

  • Lead Data Architect

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data architecture solutions that enable efficient data management, storage, and...

  • Lead Data Scientist

    4 weeks ago


    San Francisco, United States Glo Full time

    Job DescriptionJob DescriptionPosition Overview:The Lead Data Scientist will formulate Glo’s data strategy and work with the Data Engineer to implement the appropriate architecture and execute on the strategy. This role will be responsible for enabling data-driven decisions across the Company by sourcing accurate data, building scalable infrastructure, and...

  • Lead Data Analyst

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven decision-making! Our company is committed to leveraging data analytics to drive strategic insights and inform business decisions. We're dedicated to unlocking the power of data to drive growth, optimize processes, and improve customer experiences. Join us and lead our...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data pipeline solutions that enable efficient data ingestion, processing, and...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is a pioneer in leveraging cutting-edge data science techniques to drive strategic insights and inform business decisions. We're committed to pushing the boundaries of data science to deliver innovative solutions and drive growth. Join us and lead our team in shaping the future...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a pioneer in leveraging cutting-edge data science techniques to drive strategic insights and inform business decisions. We're committed to pushing the boundaries of data science to deliver innovative solutions and drive growth. Join us and...