Senior Data Engineer

7 days ago

San Francisco, California, United States Zeta Global Full time

Zeta Global is a data-powered marketing cloud that leverages AI and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently.

Our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry's largest proprietary databases and AI.

We empower our enterprise customers across multiple verticals to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs.

The Role

You will work on server-side APIs and services that enable a highly distributed event pipeline and a stack that gets tens of thousands of messages per second as a senior member of the Software Engineering team.

As part of the group responsible for designing, developing, and owning the distributed systems CRM platform for Zeta, you will collaborate with your fellow Engineers and Product Managers to develop a roadmap and subsequent projects to build the next generation comprehensive, multichannel marketing solution that unifies and unlocks data across digital touch points, driving return on marketing investment.

You should have a deep knowledge of distributed systems and cloud architecture. You will need extensive design and development experience and be passionate about working with high-throughput systems where the issues of throughput, performance, redundancy, and concurrency are paramount.

Key Responsibilities:
  • Design, implement and launch new product features using technologies that are in-use currently within the company or propose alternative technologies, with proven significant cost and performance advantage.
  • Participate in evaluating technology alternatives, existing or emerging, to problems being solved in the product area of responsibility that can take the company to the next level of technology leadership in the market.
  • Engage in architectural discussions, influence the roadmap, and take ownership of key projects and initiatives.
  • Mentor and collaborate with team members to optimize current designs, data models, workflows, and APIs.
  • Partner with Product Managers to contribute to product design, aiming to create world-class products.
  • Work with the DevOps team to design system infrastructure, address problem areas, and lead in system monitoring, observability, and robustness.
Requirements & Qualifications:
  • Minimum of 15 years in software engineering, with prior meaningful experience in data engineering.
  • Expertise in web and data technologies such as Kafka, HDFS, Spark, EMR, Open Table Formats, Snowflake, Hive, HBase, Scylla, Django, and FastAPI.
  • Big Data Technologies: Expertise in big data technologies and frameworks such as Spark, HDFS, and Hive. Experience with interoperability of data formats with different data technologies.
  • Proficient in designing, deploying, and managing systems on AWS.
  • Experience with the complete software development lifecycle, from inception to production and monitoring.
  • Fluency in Python or substantial experience in Scala and Java.
  • Skilled in working with various data stores – equivalent of MySQL, Postgres, Scylla, DynamoDB, Aerospike and Redis.
  • Experience with schedulers like Apache Airflow, Apache Luigi, and Chronos.
  • Familiarity with agile software development processes.
  • Excellent interpersonal and communication abilities.
Benefits & Perks:
  • Unlimited PTO
  • Excellent medical, dental, and vision coverage
  • Employee Equity and Stock Purchase Plan
  • Employee Discounts, Virtual Wellness Classes, and Pet Insurance
  • And more
Compensation Range:

$200,000.00 - $250,000.00, depending on location and experience.

  • Senior Data Engineer

    6 days ago

    San Francisco, California, United States WEX, Inc. Full time

    Job Overview:WEX, Inc. is seeking a highly motivated and experienced Senior Data Engineer to join our Data team. As a key member of the team, you will be responsible for designing, developing, and implementing large-scale data platforms and systems that support business-critical applications.About the Role:In this role, you will work closely with...

  • Senior Data Engineer

    7 days ago

    San Francisco, California, United States Unity Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data & ML Platform team at Unity. This role involves designing and optimizing large-scale data platforms and machine learning infrastructure systems for efficiency, reliability, and cost-effectiveness.Key ResponsibilitiesDesign and optimize large-scale data platforms and machine...

  • Senior Product Designer

    6 days ago

    San Francisco, California, United States Zing Data, Inc. Full time

    Drive Data-Driven Growth">We are seeking an experienced Senior Product Designer to lead the design of our data-driven products. As a key member of our team, you will play a crucial role in shaping the user experience and driving business growth through innovative product design.">About the Role">">Design and develop new features: Collaborate with...

  • Senior Data Engineer for Big Data Platforms

    3 days ago

    San Francisco, California, United States TEKsystems Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team in supporting our data platform.This is a 6-month contract-to-hire opportunity with excellent growth prospects.Key ResponsibilitiesSupport our data platform, responsible for collecting, storing, processing, and analyzing vast amounts of data across the organization.Work...

  • Senior Data Analytics Engineer

    7 days ago

    San Francisco, California, United States ZipRecruiter Full time

    Unlock Business Growth with Data-Driven InsightsAbout the RoleWe are seeking a highly skilled Senior Data Analytics Engineer to join our team at ZipRecruiter. As a key member of our data science team, you will play a vital role in developing and implementing machine learning models that drive business growth and efficiency.The ideal candidate will have a...

  • Senior Data Systems Engineer

    6 days ago

    San Francisco, California, United States Amplitude Full time

    Company OverviewAmplitude is a leading digital analytics platform that empowers businesses to unlock the full potential of their products. By harnessing the power of data, we help companies drive growth and deliver exceptional customer experiences.Salary and BenefitsBased on Colorado law, this role comes with a total target cash range of $185,000 - $278,000...

  • Senior Data Architect

    3 weeks ago

    San Francisco, California, United States Ellation, Inc. Full time

    About the RoleWe're seeking a highly skilled Senior Data Engineer to join our Data Engineering team. As a key member of this team, you will play a pivotal role in designing, implementing, and optimizing data services and pipelines, ensuring that our data services support the needs of the business.As a Senior Data Engineer, you will collaborate with...

  • Senior Data Quality Engineer

    7 days ago

    San Francisco, California, United States Altruist Full time

    About Altruist:Altruist is a cutting-edge financial services company that offers a comprehensive solution for independent financial advisors. Our innovative platform combines a self-clearing brokerage firm with intuitive software for account opening, trading, reporting, and billing. By streamlining these processes, we enable financial advisors to reduce...

  • Senior Data Infrastructure Engineer

    7 days ago

    San Francisco, California, United States Monograph Full time

    At Monograph, we're on a mission to democratize data access and enable analytics capabilities across the organization. We're looking for a seasoned Senior Data Infrastructure Engineer to join our team and help us build scalable systems that power high-impact product features.

  • Senior Data Science Engineer

    5 days ago

    San Francisco, California, United States Baton Full time

    Baton, a technology innovation lab for Ryder, is seeking a skilled Senior Data Science Engineer to lead data science projects, develop machine learning models, and perform in-depth data analysis. The ideal candidate will have advanced proficiency in Python, strong SQL skills, experience with machine learning frameworks, and a solid background in statistical...

  • Senior Cloud Data Engineer

    7 days ago

    San Francisco, California, United States Amplitude Full time

    Unlock the Power of Real-Time AnalyticsAt Amplitude, we are seeking a highly skilled Senior Cloud Data Engineer to join our team and help drive innovation in the field of digital analytics. Our company is a leading provider of product analytics solutions, trusted by over 3,200 customers worldwide, including household names such as Atlassian, Jersey...

  • Senior Data Engineering Lead + Big Data/Hadoop

    7 days ago

    San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...

  • Senior Data Engineer

    5 days ago

    South San Francisco, California, United States Mytra Full time

    We are seeking a Senior Data Engineer to lead our data pipeline development. This role will require you to design, implement, and maintain the next generation of our data infrastructure. You will work closely with internal stakeholders to define and measure key metrics, and develop data models to empower internal teams to make key decisions.Key...

  • Senior Data Engineer

    7 days ago

    San Francisco, California, United States a16z Full time

    Join a16z as a Senior Data EngineerAs a seasoned data engineer at Andreessen Horowitz (a16z), you will be part of a dynamic team responsible for developing internal software tools that drive the firm's investing and operations. Your expertise in designing and implementing performant backend systems, secure data storage, and scalable infrastructure will play...

  • Senior Engineering Leader for Distributed Data Systems

    1 week ago

    San Francisco, California, United States Databricks Full time

    Job Title: Senior Engineering Leader for Distributed Data SystemsJob Summary:At Databricks, we are passionate about empowering data teams to tackle the world's most complex challenges. We achieve this by building and operating the world's leading data and AI infrastructure platform, enabling our customers to derive deep insights that drive their business...

  • Senior Data Infrastructure Engineer

    7 days ago

    San Francisco, California, United States Replica Inc. Full time

    **About Us:**We are Replica Inc., a privacy-centric urban data platform that delivers critical insights about the built environment. Our goal is to empower planners, scientists, analysts, and policymakers with better data, human context, and an intuitive design.Our team models travel behavior over time to show how people across the country live, move, and...

  • High-Performance Data Processing Systems Engineer

    3 days ago

    San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...

  • Senior Data Engineer for Digital Universe

    6 days ago

    San Francisco, California, United States AirTree Ventures Pty Full time

    About the RoleWe are seeking an experienced Senior Data Engineer to join our team at Linktree, a global leader in the digital universe space. As a key member of our Data Platform team, you will play a pivotal role in building and maintaining scalable data systems that drive innovation and growth.This is an exciting opportunity to work on cutting-edge...

  • Senior Data Engineering Leader, Cloud Architecture

    1 week ago

    San Francisco, California, United States WEX, Inc. Full time

    We are seeking a highly experienced Senior Data Engineering Leader to join our team at WEX, Inc.About the Role:The ideal candidate will have 10+ years of experience in software design and development, with strong technical skills in programming languages and cloud architecture tools. They will lead the technical vision and strategy of our Data Lake platform,...

  • Senior Data and ML Infrastructure Engineer

    3 weeks ago

    San Francisco, California, United States Unity Technologies Full time

    About the RoleWe're seeking a skilled Senior Data and ML Infrastructure Engineer to join our team at Unity. As a key member of our Data & ML Platform team, you will design and optimize large-scale data platforms and machine learning infrastructure systems for efficiency, reliability, and cost-effectiveness.Key Responsibilities:Design and optimize large-scale...