Staff Data Engineer

16 hours ago


San Francisco CA United States Stars Group Full time

Responsibilities:

  • Leadership & Strategy: Lead and mentor a team of data engineers, driving best practices in data engineering and ensuring alignment with the overall data strategy.

  • Architecture & Development: Architect and develop highly scalable data pipelines and infrastructure using Apache Kafka, Apache Spark or Databricks, Python, Scala, and other relevant technologies.

  • Streaming & Real-Time Processing: Design and implement streaming data solutions using technologies such as Spark Structured Streaming, Kafka Streams, and others to process millions of events per day.

  • Data Governance & Quality: Ensure the integrity, quality, and consistency of data across our Data Lake and Data Warehouse, implementing rigorous data governance practices.

  • Cloud & NoSQL Management: Oversee the use of AWS managed services and manage NoSQL databases such as ElasticSearch, Redis, MongoDB, or ScyllaDB.

  • Operational Excellence: Continuously monitor and improve processes and best practices for managing data pipelines, ETL operations, CI/CD deployment and data infrastructure.

  • Cross-Functional Collaboration: Collaborate with stakeholders across the organization to understand data needs and deliver solutions that drive business value.

Requirements:

  • Expert Engineering Skills: A strong background in software engineering with deep expertise in abstraction, coding, and building distributed systems.

  • Advanced Programming Proficiency: Exceptional programming skills in Python or Scala, with a strong understanding of multi-threading and object-oriented programming.

  • Data Systems Expertise: Extensive experience with Spark, Kafka, real-time streaming systems, AWS, and Cloud Data Warehouses like Starburst Trino. Familiarity with containerization technologies such as Docker and Kubernetes.

  • Proven Leadership: Demonstrated ability to lead and develop high-performing data engineering teams, particularly within startup or high-growth environments.

  • Collaborative Team Player: Strong interpersonal skills, with the ability to collaborate effectively across teams and communicate complex technical concepts to non-technical stakeholders.

  • Visionary & Strategic Thinker: Capable of seeing the big picture, with the ability to align technical initiatives with broader business goals.

#J-18808-Ljbffr

  • Atlanta, GA, United States Data Engineer Jobs Full time

    *Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...


  • San Francisco, United States Data Masked Full time

    This range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...


  • San Francisco, CA, United States DoorDash USA Full time

    About the Team Data is at the foundation of DoorDash's success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization, and financial reporting. The team serves as the foundation for decision-making at DoorDash. About the Role DoorDash is looking for a Staff Software Engineer,...

  • Staff Data Engineer

    2 days ago


    San Francisco, CA, United States Faire Full time

    Staff Software Engineer - Data Platforms Faire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individually, they are small compared to these massive entities. At Faire, we're using the power of tech, data, and machine...

  • Staff Data Engineer

    16 hours ago


    San Francisco, CA, United States Trunk.io Full time

    At Trunk, we're on a mission to empower growing software organizations to deliver high-quality software quickly. We understand the challenges of merge conflicts, poor code quality or consistency, flaky tests, and other distractions that can drain productivity and morale. Our unique approach enables engineering teams to stay focused on designing,...


  • San Francisco, CA, United States ADVANCED ENGINEERING GROUP PC Full time

    About the Role: Demandbase is seeking creative, highly motivated, enthusiastic engineer individuals to be part of our product development team. You will work in a fast paced agile environment to build and deliver key features of the application. This is a great opportunity to work with a talented, high energy and creative team focused on building a...


  • San Francisco, CA, United States DoorDash USA Full time

    About the Team DoorDash is a data driven organization and relies on timely, accurate and reliable data to drive many business and product decisions. The Data Platform owns all the infrastructure necessary to run an operationally efficient analytical data stack. The Core Data part of this includes data ingestion (batch and real time), data compute &...

  • Data Engineer

    17 hours ago


    San Francisco, CA, United States Abridge AI Inc. Full time

    Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our enterprise-grade technology transforms patient-clinician conversations...


  • San Francisco, CA, United States Ellation, Inc. Full time

    Who We Are We're a cast of characters working to shine a spotlight on anime. Crunchyroll is an international business focused on creating both online and offline experiences for fans through content (licensed, co-produced, originals, distribution), merchandise, events, gaming, news, and more. Visit our About Us pages for more information about our...


  • San Francisco, United States DoorDash USA Full time

    About the Team Data is at the foundation of DoorDash's success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization, and financial reporting. The team serves as the foundation for decision-making at DoorDash. About the Role DoorDash is looking for a Staff Software Engineer,...

  • Staff Data Engineer

    3 weeks ago


    San Francisco, United States Faire Full time

    Staff Software Engineer - Data PlatformsFaire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individually, they are small compared to these massive entities. At Faire, we're using the power of tech, data, and machine...

  • Staff Data Engineer

    2 days ago


    Redwood City, CA, United States Karius Full time

    About KariusKarius is a venture-backed life science startup that is transforming the way pathogens and other microbes are observed throughout the body. By unlocking the information present in microbial cell-free DNA, we're helping doctors quickly solve their most challenging cases, providing industry partners with access to 1000's of biomarkers to...

  • Staff Data Engineer

    4 weeks ago


    San Francisco, United States Trunk.io Full time

    At Trunk, we're on a mission to empower growing software organizations to deliver high-quality software quickly. We understand the challenges of merge conflicts, poor code quality or consistency, flaky tests, and other distractions that can drain productivity and morale. Our unique approach enables engineering teams to stay focused on designing,...

  • Data Engineer

    2 days ago


    San Francisco, CA, United States Outdefine Full time

    As a skilled professional seeking career growth, you deserve access to the best job opportunities available. Join Outdefine's Trusted community today and apply to premier job openings with leading enterprises globally. Set your own rate, keep all your pay, and enjoy the benefits of a fee-free experience. Data Engineer Outdefine Partner Web3 10-50 ...


  • San Jose, CA, United States Zscaler Full time

    Our Engineering team built the world's largest cloud security platform from the ground up, and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint, the team has made us and our multitenant architecture today's cloud security leader, with more than 15 million users in 185 countries. Bring your...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, United States AirTree Ventures Pty Full time

    The Role As Staff Software Engineer for Linktree’s Data Platform team, you’ll play a crucial role in building a robust, scalable data platform that drives innovative experiences in our core product. Your contributions will unlock new opportunities for our tens of millions of users and our billions of visitors around the world, helping us achieve...

  • Staff Data Engineer

    2 months ago


    Austin, TX, United States Visa Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Data Engineer

    2 days ago


    San Francisco, CA, United States Woven Full time

    FORE is unlocking dormant operational data with advanced AI to diagnose operational challenges and support better performance. With close advisory from leading academic experts in Information and Operational Theory, we enable leaders across Healthcare, Private Equity, and Enterprise to understand the drivers of inefficiencies and how they can improve. At...


  • San Francisco, United States AirTree Ventures Pty Full time

    The RoleAs Staff Software Engineer for Linktree’s Data Platform team, you’ll play a crucial role in building a robust, scalable data platform that drives innovative experiences in our core product. Your contributions will unlock new opportunities for our tens of millions of users and our billions of visitors around the world, helping us achieve...