Data Engineering Leader

2 days ago


Philadelphia, Pennsylvania, United States ZipRecruiter Full time

About Perpay

We're a financial technology company dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability.

Our mission is to make financial inclusion accessible to everyone, and we're looking for talented individuals like you to join our team.

What We Offer

  • A competitive salary of $180,000 per year, plus company equity
  • A comprehensive benefits package, including medical, dental, and vision insurance
  • A 401(k) plan with company match
  • Flexible spending account (FSA)
  • Relocation assistance
  • Pre-tax commuter benefit
  • Student loan repayment match
  • Gym subsidy with City Fitness
  • Cell phone plan
  • Paid parental leave
  • Unlimited PTO

The Role

We're seeking a Senior Data Engineer to lead our data engineering efforts and design scalable, high-performance data solutions. As a key member of our data team, you will work closely with cross-functional teams to deliver data-driven insights and drive business growth.

Your Responsibilities

  1. Design, implement, and maintain complex ETL pipelines using tools such as Apache Spark, Apache Airflow, and AWS Glue
  2. Collaborate with data producers to establish robust data contracts and develop advanced data models leveraging Redshift Spectrum and partitioned data lakes
  3. Implement advanced data governance strategies, including metadata management, data lineage tracking with tools like Open Lineage, and comprehensive data cataloging using Datahub
  4. Partner with cross-functional teams to deliver scalable, high-performance data solutions, optimizing performance and ensuring data quality
  5. Analyze and resolve complex data engineering challenges, employing techniques such as indexing, partitioning, and query optimization to enhance performance

Requirements

  • Bachelor's degree or higher in a quantitative/technical field (Computer Science, Statistics, Engineering, Mathematics, Physics, Chemistry)
  • 5+ years of experience in data engineering with a deep understanding of data pipeline design and architecture
  • Proficiency in SQL, Python, and familiarity with cloud-services on AWS, GCP, or Azure, including Redshift, BigQuery, or Synapse Analytics
  • Extensive experience with data warehousing solutions, ETL/ELT processes, and data orchestration tools such as Apache Airflow or Luigi
  • Strong understanding of data modeling principles, dimensional modeling, and schema design in both OLAP and OLTP contexts
  • Expert knowledge of distributed data processing frameworks like Apache Spark, Hadoop, or Flink

Why Join Us

At Perpay, we value diversity, inclusivity, and creativity. We offer a dynamic and collaborative work environment that fosters growth and innovation. If you're passionate about data engineering and want to be part of a team that makes a real impact, apply now



  • Philadelphia, Pennsylvania, United States Comcast Full time

    About the Job:We're seeking a highly skilled Cloud Data Engineer Leader to join our growing data teams. As a Cloud Data Engineer Leader, you'll design and build data processing pipelines using cutting-edge cloud technologies, manage data sources, and oversee the development of new data tools and frameworks. If you have a passion for data-driven decision...


  • Philadelphia, Pennsylvania, United States Capital One Full time

    Career Overview: As a Data Science Engineer Leader, you will play a critical role in driving the development and implementation of machine learning applications at Capital One. This position requires a strong understanding of machine learning concepts and the ability to lead large-scale initiatives with a customer-centric focus.Responsibilities: In this...


  • Philadelphia, Pennsylvania, United States Orionyx Engineering Ltd Full time

    Working EnvironmentThis is a full-time, remote role, requiring 40 hours of work per week, Monday to Friday, 8 hours daily. As a Data Entry Clerk, you will have the opportunity to work closely with project managers, engineers, and other departments to ensure the accurate and timely entry of data.The estimated salary range for this position is $22.50-$27.50...


  • Philadelphia, Pennsylvania, United States KickUp Full time

    About KickUpKickUp is a leading provider of professional growth platforms for educators. Our mission is to empower educational leaders to make data-driven decisions that improve student outcomes.We're seeking an experienced Senior Software Engineer to join our team as a technical leader. This role will involve collaborating with cross-functional teams to...


  • Philadelphia, Pennsylvania, United States Orionyx Engineering Ltd Full time

    About the Company: ORIONYX ENGINEERING LTD. is a reputable engineering services provider dedicated to delivering high-quality solutions in civil, structural, and architectural engineering, surveying, and forensic analysis.


  • Philadelphia, Pennsylvania, United States Saxon Global Full time

    Job DescriptionSaxon Global is seeking a highly skilled Data Modeler to join our team. The successful candidate will have expertise in Big Data Engineering, particularly in Data Vault 2.0 and ERwin.The ideal candidate will have at least 3 years of experience in Software Engineering, including Development Lifecycle and Test Driven Development. Additionally,...


  • Philadelphia, Pennsylvania, United States The Data Sherpas Full time

    Job DescriptionWe are seeking a highly skilled Senior Backend Software Engineer to join our team of talented engineers at The Data Sherpas. As a Senior Backend Software Engineer, you will lead a team of engineers to solve complex business opportunities with software and design technical solutions with little direction or guidance.The ideal candidate will...

  • Lead Data Engineer

    16 hours ago


    Philadelphia, Pennsylvania, United States Children's Hospital of Philadelphia Full time

    About the RoleThe Lead Data Engineer will lead a small team of data engineers to build and maintain our data platform. You will be responsible for ensuring the data platform is secure, scalable, and reliable. In this role, you will also collaborate with cross-functional teams to integrate data into various applications and tools.


  • Philadelphia, Pennsylvania, United States CV Library Full time

    Job Summary">We are seeking a highly skilled Data Engineer to join our team at CV Library. As a key member of our data engineering team, you will play a critical role in developing and maintaining our BI/data warehouse/data lake solutions.">About the Role">This is a hybrid role requiring three days in-office each week. You will report directly to our...


  • Philadelphia, Pennsylvania, United States Centraprise Full time

    Job Summary: Drive technological innovation as the lead of a team of developers and data engineers in Azure Data Analytics, leveraging expertise in Azure Databricks, Talend, and Azure services to design and implement scalable data analytics solutions.Effective leadership and mentoring skills to guide and motivate a team.Excellent problem-solving and...


  • Philadelphia, Pennsylvania, United States NetApp Full time

    Job OverviewWe are seeking a highly skilled Data Management Innovation Leader to join our team at NetApp. This is an exciting opportunity to shape the future of data storage and management solutions for Enterprise Storage and AI.


  • Philadelphia, Pennsylvania, United States pureIntegration Full time

    At pureIntegration, we are seeking a talented Data Engineering Specialist to join our team in the Philadelphia metro area. As a key member of our data engineering team, you will play a critical role in driving customer insights and client revenue growth.This is an excellent opportunity to leverage your expertise in large data sets, data pipelining, lineage,...


  • Philadelphia, Pennsylvania, United States Penn Interactive Full time

    About the RolePenn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. As a key member of our Data Engineering team you will collaborate with Data Science, Reporting,...


  • Philadelphia, Pennsylvania, United States Comcast Full time

    About Comcast:Comcast is a Fortune 30 global media and technology company, providing innovative solutions to its customers. Our mission is to deliver amazing products, platforms, and experiences that our customers love.We are seeking a Data Insights Engineer to join our team. As a key member of the Syndication Insights team, you will work closely with...


  • Philadelphia, Pennsylvania, United States Pennsylvania Medicine Full time

    Job SummaryEstimated Salary: $140,000 - $160,000 per yearAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Pennsylvania Medicine. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining robust data pipelines, ETL/ELT processes, and other data cleansing and...


  • Philadelphia, Pennsylvania, United States Saxon Global Full time

    Join Our TeamSaxon Global is looking for a highly motivated Big Data Engineer to join our team. The successful candidate will have expertise in Data Vault 2.0 and ERwin, as well as experience with Cloud Big Data Technologies.The ideal candidate will have at least 3 years of experience in Software Engineering, including Development Lifecycle and Test Driven...


  • Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    Job OverviewWe are a leading financial technology company seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering department, you will play a crucial role in designing, implementing, and maintaining complex data pipelines using Apache Spark, Apache Airflow, and AWS Glue. You will work closely with data...


  • Philadelphia, Pennsylvania, United States SysMind Tech Full time

    Job Title: Big Data Engineer and Architect at SysMind TechOverview: We are seeking an experienced Data Engineer to lead our team in designing and implementing large-scale data systems.Estimated Salary Range: $130,000 - $160,000 per year based on industry standards and location. Our company is located in a major city with a high cost of living.Job...


  • Philadelphia, Pennsylvania, United States rockITdata Full time

    Job OverviewWe are seeking a talented Data Engineer to join our team at rockITdata. As a seasoned expert in data engineering, you will be responsible for designing and implementing scalable data solutions to drive business growth and innovation.Key ResponsibilitiesData Ingestion and Integration: Design and implement efficient data ingestion pipelines to...


  • Philadelphia, Pennsylvania, United States ZipRecruiter Full time

    About PerpayWe're a financial technology company committed to creating simple and inclusive financial products that help our members create healthy habits and achieve economic stability. Our mission is to make financial inclusion accessible to everyone, and we're looking for talented individuals like you to join our team.The RoleWe're seeking a Senior Data...