Big Data Systems Developer

5 days ago


San Francisco, California, United States Plaid Full time

Join Our Team

At Plaid, we're passionate about creating a world where everyone has access to financial services that are simple, transparent, and empowering. We're seeking a talented Data Architect to join our team and help us achieve our mission.

About the Role

As a Data Architect, you'll be responsible for leading our data engineering efforts, shaping the future of our data systems and culture. You'll collaborate with senior leadership to define and execute our data engineering strategy, working closely with cross-functional teams to deliver high-quality solutions.

Key Responsibilities

Serve as primary technical DRI, defining and executing the long-term technical roadmap to build and sustain a data-driven culture at Plaid.Collaborate with senior leadership to shape Plaid's data engineering strategy and roadmap, ensuring alignment with the company's product goals and overall vision.Design golden datasets that meet the needs of key stakeholders, providing reliable and actionable insights to inform business decisions.Lead critical data engineering projects that foster collaboration across teams, driving innovation and efficiency throughout the company.Mentor engineers and operations staff on best practices for data organization, ensuring seamless integration with existing systems.Evaluate emerging industry tools and practices, recommending adoption to maintain Plaid's position at the forefront of data engineering.Owning core SQL and Python data pipelines, ensuring their reliability, scalability, and efficiency in powering our data lake and warehouse.

Requirements

10+ years of experience in data engineering, with a proven track record of building scalable data systems and pipelines.Experience working with massive datasets, developing robust data models and pipelines on top of them.Deep appreciation for schema design and ability to evolve analytics schemas on top of unstructured data.Advanced knowledge of SQL as a flexible, extensible tool and experience with modern orchestration tools like DBT, Mode, and Airflow.Hands-on experience with performant data warehouses and lakes, such as Redshift, Snowflake, and Databricks.Building and maintaining batch and real-time pipelines, using technologies like Spark and Kafka.Champion for data privacy and integrity, always acting in the best interest of consumers.

What You'll Get

A competitive salary range of $204,120 - $360,000 per year, depending on factors such as scope and responsibilities, work experience, and location.A comprehensive benefit plan, including medical, dental, vision, and 401(k).
  • Big Data Developer

    2 weeks ago


    San Francisco, California, United States Omega Solutions Inc Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team at Omega Solutions Inc.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop, Spark, and Hive technologies.Maintain and optimize existing data pipelines on AWS cloud infrastructure.Develop and implement data science solutions using Python and...


  • San Francisco, California, United States USM Business Systems Full time

    Job DescriptionSenior Data Modeler/Data Architect + Big Data/HadoopAbout the RoleThis highly technical and hands-on position is an integral part of the Digital Insights & Architecture team within USM Business Systems. The successful candidate will lead the design, implementation, and support of data architecture deliverables for multiple projects.The role...


  • San Francisco, California, United States Diverse Lynx Full time

    Job Summary:Diverse Lynx LLC is seeking a highly skilled Big Data Platform Developer to join our team. As a key member of our big data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient big data platforms using various big data engineering technologies such as Hadoop, Spark, HBase, Flume, and Storm. Your...


  • San Francisco, California, United States Eppo, Inc Full time

    About Eppo, Inc.We are revolutionizing the way companies make decisions by harnessing the power of experimentation. Our innovative platform combines the modern data stack with high-velocity experimentation, empowering customers to unlock new insights and drive growth.Job OverviewThis role is ideal for a seasoned software engineer who is passionate about...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Chief Data Architect and Big Data StrategistLocation: Remote, open to candidates worldwideEstimated Salary: $150,000 - $200,000 per annum, depending on experienceJob Description:We are seeking an experienced Data Architect to join our Digital Insights & Architecture team. As a key member of the team, you will be responsible for leading the design,...


  • San Jose, California, United States ZipRecruiter Full time

    **About the Role**We are looking for a skilled Big Data Systems Lead Developer to lead the development of our data platform. The successful candidate will have experience in building large-scale distributed systems in a product environment.In this role, you will be responsible for designing and implementing reliable, scalable, robust, and extensible big data...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...

  • Big Data Architect

    2 weeks ago


    San Francisco, California, United States ZipRecruiter Full time

    Job Title:**Big Data Architect**OverviewWe are seeking an experienced Big Data Architect to join our team at ZipRecruiter. As a key member of our data engineering group, you will be responsible for designing and implementing scalable big data systems that support our analytics and business intelligence needs.The ideal candidate will have a strong background...

  • Big Data Engineer III

    2 weeks ago


    San Francisco, California, United States Omni Inclusive Full time

    Job Description:We are seeking a highly skilled Big Data Engineer III - Scalable Systems to join our team. The ideal candidate will have a strong background in Java, Hadoop, and Kafka, and experience in designing and developing scalable systems for big data processing.The role will involve working closely with our technology team to create effective...


  • San Francisco, California, United States ZipRecruiter Full time

    Job Description Data Platforms and SystemsWe are seeking a skilled Software Development Engineer to join our Data Platform team, responsible for building and optimizing large-scale data infrastructures and products.You will design and implement reliable, scalable, and robust big data systems that support our core products and business, leveraging your...


  • San Jose, California, United States HireIO Inc Full time

    At HireIO Inc, we're looking for a talented Big Data Systems Architect to lead the development of our next-gen A/B testing platform. This platform will empower our company to make data-driven decisions for our products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction, and service upgrades.As a software engineer...

  • Big Data Specialist

    2 weeks ago


    San Francisco, California, United States Jacobs Full time

    Jacobs is seeking a talented Senior Data Engineer to lead data engineering projects and help productize data products and algorithms into our scalable analytics platform. As a key member of our team, you will work closely with cross-functional teams to understand data needs and develop customized solutions for customers.The ideal candidate will have a strong...

  • Big Data Architect

    1 week ago


    San Francisco, California, United States Unreal Gigs Full time

    About the RoleWe are seeking an experienced Big Data Architect to join our team at Unreal Gigs. This role is a fantastic opportunity for a skilled professional to leverage their expertise in designing and implementing scalable big data platforms.


  • San Francisco, California, United States Eppo, Inc Full time

    About the CompanyEppo, Inc. is a leading provider of experimentation platforms, empowering businesses to make data-driven decisions.Job SummaryWe are seeking an experienced Senior Backend Developer to join our team and contribute to building high-scale systems that manage customer experiments using Big Query, Snowflake, and RedShift.ResponsibilitiesDesign...


  • San Jose, California, United States Tik Tok Full time

    TikTok is seeking a highly skilled Big Data Streaming Solutions Developer to join its team. In this role, you will design and develop scalable and efficient data processing systems that enable real-time analytics and drive business growth.RequirementsDeep understanding of computer principles, data structures, and algorithmsExperience with streaming computing...


  • San Francisco, California, United States WEX Full time

    About the JobWe are looking for a Big Data Solutions Architect to join our team at WEX. As a key member of our Data Engineering organization, you will be responsible for designing, developing, and implementing scalable data architectures and systems.Your primary focus will be on leading the technical architecture and development of our unified, scalable data...


  • San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...

  • Big Data Specialist

    2 weeks ago


    San Francisco, California, United States Unity Technologies Full time

    About UsWe are Unity Technologies, the world's leading platform for creating real-time 3D content. Our company overview highlights our commitment to innovation and customer satisfaction. We offer a dynamic work environment where you can grow your skills and advance your career.">This is an exciting opportunity to join our Unity Ads Data Engineering team as a...


  • San Francisco, California, United States HireIO Inc Full time

    Role Summary">This position requires a highly skilled Software Development Engineer to join our Data Platform team at HireIO Inc.Key Responsibilities">">Build efficient and reliable data transformations for various use cases">Implement big data systems that meet scalability and reliability requirements">Develop and maintain high-quality software...

  • Big Data Specialist

    2 weeks ago


    San Jose, California, United States Tik Tok Full time

    About the JobWe are seeking talented individuals to join our Global live Data BP team as Data Engineers. Your primary responsibility will be to construct offline and real-time data warehouses for TikTok Live business. You will handle large-scale data processing, providing services for the entire lifecycle of big data, covering data generation, transmission,...