Data Engineer

3 weeks ago


San Francisco, United States Bayone Full time
Your role at Sephora:
As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely with other team members like data architects and business analysts to understand what the business is trying to achieve, move data from source to target, and design optimal data models. You will be also responsible for building and maintaining the data platform. This hands-on technical role demands excellent knowledge and can demonstrate best practices in the industry. Come be a part of a team that is starting this new journey.

Responsibilities:
• Streamline the intake of the raw data into our Azure Data lake.
• Perform production support and deployment activities.
• Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworks
• Build data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliability
• Leverage central data warehouse along with other data sources to create enriched customer information into CRM system
• Understand and translate business needs into data models to support long-term, scalable, and reliable solutions
• Create logical and physical data models using best practices to ensure high data quality and reduced redundancy
• Drive data quality across the organization; develop best practices for standard naming conventions and coding practices to ensure consistency of data models and tracking
• Define and manage SLA's for data sets and processes running in production
• Continuously improve our data infrastructure and stay ahead of technology
• Design a system for data backup in case of system failure
• Build strong cross-functional partnerships with Data Scientists, Analysts, Product Managers and Software Engineers to understand data needs and deliver on those needs

We are excited about you if you have:
• 5+ years of experience with large scale data warehouse projects .
• dvanced Proficiency in Scala, Spark and SQL.
• Excellent knowledge in data structures and design patterns
• Preferred experience with data integration tools
• Experience working with Retail/CRM/Finance datasets preferred
• Knowledge in designing facts, dimensions, snapshots, SCDs, etc
• Write SQL for processing raw data, data validation and QA
• Knowledge working with APIs to collect or ingest data
• Strong Database knowledge, SQL & No-SQL preferred
• Communication Skills Data Engineers are part of a team, working with database administrators, data analysts and management and need to be effective communicators.
• ttention to Detail Databases are complex, and a minute error can cause huge problems.
• Problem-Solving Skills Data Engineers look at an issue that needs to be solved and come up with solutions quickly.
• Experience designing and implementing cloud based and SaaS data warehouse (e.g. WS, Hadoop, NoSQL) and developing ETL/ELT pipelines
• Experience integrating and building data platform in support of BI, Analytics, Data Science, and real-time applications
• Strong communication skills, with the ability to initiate and drive projects proactively and accurately

  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Data Analyst

    7 days ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, CA, United States Data Masked Full time

    Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...

  • Data Engineer

    7 days ago


    San Francisco, United States Plaid Full time

    We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with...


  • San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    1 week ago


    San Francisco, California, United States teamworkonline Full time

    Company OverviewSwish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for...

  • Data Engineer

    1 month ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    3 days ago


    San Francisco, United States Sia Partners Full time

    Job DescriptionSia Partners is looking for a talented Data Engineer to support our activities within the Data Science Business Unit. You will be working alongside with our Data Science consultants and our clients on Data Engineering topics, including creating relevant data models, developing powerful data pipelines, exposing them through various mechanisms...


  • San Francisco, CA, United States Data Masked Full time

    When Square started, it was difficult and expensive (or just plain impossible) for some businesses to take credit cards. Square made credit card payments possible for all by turning a mobile phone into a credit card reader. Since then Square has been building an entire business toolkit of both hardware and software products including Banking, Commerce, Staff...

  • Lead Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Data Engineer

    1 week ago


    San Francisco, United States Speak Full time

    Job DescriptionJob DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish.English is the global language of business, culture, and communication, and over 1.5 billion people around the world are actively trying to learn right now. Others dream of...

  • Data Engineer

    2 months ago


    San Francisco, California, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD


  • San Francisco, United States SoFi Full time

    Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going...

  • Data Engineer

    1 week ago


    San Francisco, United States Rigil Corporation Full time

    Job DescriptionJob DescriptionRole: Data EngineerAbout Rigil:Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders.Location: San Francisco, CAJob Type: Full TimeData Engineer is integral to evolving Vision and its...

  • Data Engineer

    1 week ago


    San Francisco, United States Rigil Corporation Full time

    Role: Data Engineer About Rigil: Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders.Location: San Francisco, CAJob Type: Full TimeData Engineer is integral to evolving Vision and its underlying data and AI...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...


  • San Francisco, United States Premise Data Corporation Full time

    We all know every decision should be driven by data. But what about the data you don’t know? For years, the status quo in data aggregation has lacked visibility, moved slowly, and cost too much…leaving organizations to make critical decisions, day after day, without the whole picture. Premise changes that. Across 138 countries and counting, our...

  • Senior Data Engineer

    1 month ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...