Data Engineering Team Lead

2 days ago

Philadelphia, Pennsylvania, United States Cadent Full time

Cadent Overview

Cadent powers the evolution of TV brand advertising, providing data-driven solutions for buying and selling TV advertising. We connect brands with opportunities across national inventory sources—cable, broadcast, and digital media—improving efficiencies and boosting results of linear, addressable, and cross-screen campaigns.

We are seeking a self-motivated and talented Data Engineering Team Lead to join our team responsible for ingesting, processing, and distributing the data used and created by Cadent's data-driven business systems.

The ideal candidate should possess a deep understanding of data engineering principles, excellent leadership skills, and a passion for driving impactful data-driven solutions.

About You:

  • You have a strong aptitude for querying data sets from heterogeneous sources—both structured such as SQL Server, MYSQL and Vertica and unstructured like Excel,CSV using simple and advanced SQL.
  • You have hands-on experience with Databricks (Spark), the AWS ecosystem including (S3, Athena, Glue, Lambda, IAM, EC2).
  • You have hands-on experience in building large-scale distributed applications, including streaming and Batch pipelines and processing petabytes of data.
  • You have hands-on experience with the Databricks platform to create ETL pipelines using notebooks, scheduling jobs and create optimized spark cluster configuration for various ETL workloads.
  • You have experience using Atlassian products including JIRA, Confluence etc.
  • You have conducted code reviews to ensure code quality, adherence to coding standards, and best practices.
  • You are responsible for working closely with cross-functional teams, including product management and quality assurance, to ensure smooth and timely releases.
  • You can easily work with a diverse team to achieve a common goal and participate in scrum meetings.
  • You're willing to learn new skills and technologies.

What You Will Do:

  • Participate in scrums, design meetings, and collaborate with quality assurance, business stakeholders, data engineering coworkers, product, software development, and data scientists, as needed for each project.
  • Ability to understand and articulate requirements to/from technical and non-technical audiences working alongside a data science & engineering team.
  • Create design documentation and review it with peers and subject matter experts.
  • Learn the Cadent Data Lake architecture principles and libraries and actively participate in maintaining and improving the core codebase.
  • Build and maintain cost effective and performant Databricks workflows using various data sources through each layer of the Cadent Data Lake; and make data available for querying and reporting.
  • Support the business with ad hoc data analysis to answer data questions and do proof of concepts.
  • Learn the Cadent media and TV business as well as it's nomenclature, media math, and metrics.
  • Show initiative to identify critical problems and propose effective solutions, while exploring, learning and suggesting the most suitable technology for the problem.

Benefits:

Cadent is an Equal Opportunity Employer committed to supporting all its employees when it comes to Inclusion & Diversity. We provide equal opportunity for applicants & employees without regard to race, color, religion, creed, gender, gender identity or expression, sexual identity or orientation, age, national origin or ancestry, citizenship, disability or medical condition (including pregnancy, childbirth, or related medical condition), sexual and reproductive health decisions, genetic information, marital status (including domestic partnerships and civil unions), pregnancy, culture ancestry, familial or caregiver status, military status, veteran status, socioeconomic status, unemployment status, status as a victim of domestic violence or any other basis prohibited by law.

Cadent seeks to actively engage with our employees from a wide variety of cultures and to connect with our clients differently. Our workforce has generational diversity that supports greater innovation when we maximize representation of all diversity. Our active employee resource groups promote engagement across all groups of individuals that are represented within the company and externally.

  • Lead Data Engineer

    23 hours ago

    Philadelphia, Pennsylvania, United States Children's Hospital of Philadelphia Full time

    About the RoleThe Lead Data Engineer will lead a small team of data engineers to build and maintain our data platform. You will be responsible for ensuring the data platform is secure, scalable, and reliable. In this role, you will also collaborate with cross-functional teams to integrate data into various applications and tools.

  • Data Engineering Lead

    7 days ago

    Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    Job OverviewWe are a leading financial technology company seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering department, you will play a crucial role in designing, implementing, and maintaining complex data pipelines using Apache Spark, Apache Airflow, and AWS Glue. You will work closely with data...

  • Technical Team Lead

    2 days ago

    Philadelphia, Pennsylvania, United States The Data Sherpas Full time

    **About Us**The Data Sherpas is a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. With extensive experience in cloud technology, we assist our clients in navigating complex business opportunities through software solutions.

  • Cloud Data Engineering Lead

    2 days ago

    Philadelphia, Pennsylvania, United States Mindteck Full time

    Lead a Team of Data Engineers:We are looking for an experienced Cloud Data Engineering Lead to oversee the design, development, and implementation of our cloud-based data engineering platform. The ideal candidate will have 5+ years of experience in designing and delivering secure cloud solutions, as well as 3+ years of experience with Databricks. In this...

  • Engineering Data Clerk

    2 days ago

    Philadelphia, Pennsylvania, United States Orionyx Engineering Ltd Full time

    Working EnvironmentThis is a full-time, remote role, requiring 40 hours of work per week, Monday to Friday, 8 hours daily. As a Data Entry Clerk, you will have the opportunity to work closely with project managers, engineers, and other departments to ensure the accurate and timely entry of data.The estimated salary range for this position is $22.50-$27.50...

  • Cloud Data Engineer Lead

    1 day ago

    Philadelphia, Pennsylvania, United States Centraprise Full time

    Job Title: Cloud Data Engineer LeadAt Centraprise, we're seeking a seasoned Cloud Data Engineer Lead to spearhead our cloud data analytics initiatives. With a strong focus on innovation and collaboration, you'll drive the design, development, and implementation of scalable data processing workflows using Azure services.About the Role:We're offering an...

  • Data Engineering Lead

    3 weeks ago

    Philadelphia, Pennsylvania, United States Comcast Full time

    Company Overview:">We are FreeWheel, a Comcast company, providing comprehensive ad platforms for publishers, advertisers, and media buyers. Our innovative solutions empower all segments of The New TV Ecosystem. We power the technology, data enablement, and convergent marketplaces required to ensure buyers and sellers can transact across all screens, across...

  • Lead Data Analytics Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Phoenix Operations Group Full time

    About the JobEstimated salary: $120,000 - $180,000 per year. We are seeking a highly skilled Lead Data Analytics Engineer to join our team at Phoenix Operations Group. As a key member of our engineering services company, you will be responsible for designing and developing Big Data analytics solutions to support operational missions and product development...

  • Data Science Team Lead

    2 days ago

    Philadelphia, Pennsylvania, United States Penn Interactive Full time

    About the Job">The ideal candidate will possess a deep understanding of data science principles, techniques, and tools, as well as a proven expertise in personalization engines.You will work closely with stakeholders to identify business problems that can be solved through impactful personalization initiatives.You will utilize your mastery of recommender...

  • Technical Lead for Data Infrastructure

    2 days ago

    Philadelphia, Pennsylvania, United States DCM INFOTECH LIMITED Full time

    About the PositionWe are seeking a Technical Lead for Data Infrastructure to join our team at DCM INFOTECH LIMITED in Philadelphia, PA. This is a contract opportunity with an estimated annual salary of $150,000 - $190,000, depending on experience.Job DescriptionIn this role, you will lead the design and development of data infrastructure solutions,...

  • Lead Data Architect

    1 day ago

    Philadelphia, Pennsylvania, United States Diverse Lynx Full time

    Data Engineer Job DescriptionAt Diverse Lynx LLC, we are seeking a highly skilled Sr. Data Engineer to join our team in Philadelphia, PA.We offer a competitive salary of $170,000 - $200,000 per year, plus benefits and opportunities for professional growth.The successful candidate will have at least 10-12 years of experience in designing and implementing...

  • Software Engineering Team Lead

    2 days ago

    Philadelphia, Pennsylvania, United States Comcast Full time

    Comcast empowers innovation through cutting-edge technology. We're seeking a seasoned Software Engineering Team Lead to spearhead our data platform development efforts. This is an exciting opportunity to join a global company with offices across the globe and contribute to shaping the future of media and technology.About the Role:This position involves...

  • Senior Backend Software Engineer

    1 day ago

    Philadelphia, Pennsylvania, United States The Data Sherpas Full time

    Job DescriptionWe are seeking a highly skilled Senior Backend Software Engineer to join our team of talented engineers at The Data Sherpas. As a Senior Backend Software Engineer, you will lead a team of engineers to solve complex business opportunities with software and design technical solutions with little direction or guidance.The ideal candidate will...

  • Data Framework Development Lead

    7 days ago

    Philadelphia, Pennsylvania, United States DCM INFOTECH LIMITED Full time

    About the RoleWe are seeking a seasoned Data Framework Development Lead to join our team at DCM INFOTECH LIMITED in Philadelphia, PA. This is a contract opportunity with an estimated annual salary of $160,000 - $200,000, depending on experience.Job DescriptionIn this pivotal role, you will split your time equally between leading and guiding your team,...

  • Data Engineering Director Position

    3 weeks ago

    Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    OverviewThis role is responsible for leading the data engineering team at Comcast Corporation, a leading media and technology company. The successful candidate will oversee the design, development, and deployment of data architecture and solutions to support business operations.Job DescriptionThe Data Engineering Director will manage a team of professionals...

  • Senior Data Scientist Lead

    2 days ago

    Philadelphia, Pennsylvania, United States Diverse Lynx Full time

    We are looking for a skilled Sr. Data Engineer to lead our data engineering team at Diverse Lynx LLC. The successful candidate will have extensive experience in data architecture, development, and analytics.The estimated salary for this position is $150,000 - $220,000 per year, depending on location and experience.This role involves working closely with...

  • Data Center Project Lead

    1 week ago

    Philadelphia, Pennsylvania, United States Pkaza Full time

    Data Center Project Lead**Company Overview**Pkaza LLC is a third-party employment firm that specializes in engineering consulting services for data center and mission-critical projects. With a strong focus on reliability, energy efficiency, and sustainability, our client offers exciting opportunities for career growth and development.**Job Description**We...

  • Technical Team Lead

    2 days ago

    Philadelphia, Pennsylvania, United States The Data Sherpas Full time

    ResponsibilitiesThe successful candidate will be responsible for leading the team's organizational processes, such as planning, backlog refinement, and sprint reviews, to ensure effective collaboration and feedback. They will also be expected to design technical solutions, perform system analysis, troubleshooting, and debugging, and create and maintain APIs,...

  • Data Engineering Leader

    2 days ago

    Philadelphia, Pennsylvania, United States ZipRecruiter Full time

    About PerpayWe're a financial technology company dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability.Our mission is to make financial inclusion accessible to everyone, and we're looking for talented individuals like you to join our team.What We OfferA competitive salary of...

  • Data Engineering Specialist

    3 weeks ago

    Philadelphia, Pennsylvania, United States CV Library Full time

    Job Summary">We are seeking a highly skilled Data Engineer to join our team at CV Library. As a key member of our data engineering team, you will play a critical role in developing and maintaining our BI/data warehouse/data lake solutions.">About the Role">This is a hybrid role requiring three days in-office each week. You will report directly to our...