Sr Data Engineer- Ad Tech- Flink- Scala

4 days ago

Philadelphia, United States Comcast Corporation Full time
FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Summary

The FreeWheel Identity team is a global team whose mission is to power the identity and audience functionality in Freewheel products. We operate at a tremendous scale - 10+TB ingested per day and over datasets containing more than a trillion records. We build various services from real-time APIs that support millions of requests per second to big data ETL pipelines to serve both internal and external clients. As the team grows, we are looking for a savvy Senior Software Engineer to join the team and help build the next generation of Audience & Identity data platform that handles data at scale and uses state-of-the-art technologies to unlock the data’s business value.If you’re excited to work with a tightly-knit team of data engineers solving hard problems the right way using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud, this opportunity is for you.

Job Description

Core Responsibilities

  • Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
  • Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest,  process, and deliver data at scale.
  • Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
  • Collaborates with the serving team, report team,  and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
  • Works with Lead Engineers and Architects to share and contribute to the broader technical vision.
  • Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
  • Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
  • Oversees the documentation of all development activities.
  • Provides guidance and support to other Engineers.
  • Other duties and responsibilities as assigned.​

Requirements:

  • Ad Tech or Streaming experience
  • Flink Experience
  • Preferably, Scala experience but open to Java
  • 5+ years of hands-on work in the field of software development.
  • 3+ years of experience with data applications (Spark, Presto, Hive, etc)
  • 3+ years of experience in designing and building ETL pipelines to process data at scale
  • 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
  • 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
  • Excellent coding skills with Scala/Java, Python.
  • Must be versatile and an inquisitive problem solver.
  • Excellent communication and writing skills
  • Bachelor's or master’s degree in Computer Science or similar field of study

Seems like something you might be interested in?  We want to meet you to discuss this exciting opportunity. 

Employees at all levels are expected to:

  • Understand our Operating Principles; make them the guidelines for how you do your job.
  • Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
  • Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
  • Win as a team - make big things happen by working together and being open to new ideas.
  • Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
  • Drive results and growth.
  • Respect and promote inclusion & diversity.
  • Do what's right for each other, our customers, investors and our communities.

Disclaimer:

  • This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an EOE/Veterans/Disabled/LGBT employer.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law, including the Los Angeles Fair Chance Initiative for Hiring Ordinance and the San Francisco Fair Chance Ordinance.

Skills:

Amazon Web Services (AWS); Data Pipelines; Scala (Programming Language); Apache Spark; Big Data; Process Streamlining; Python (Programming Language)


Salary:

National Pay Range: $96,600.92 USD-$226,408.42 USD

Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.


The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.


Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

2-5 Years

  • Sr Data Engineer- Ad Tech- Flink- Scala

    5 days ago

    Philadelphia, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Sr Data Engineer- Ad Tech- Flink- Scala

    5 days ago

    Philadelphia, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Sr Data Engineer

    6 days ago

    Philadelphia, United States Diverse Lynx Full time

    Job Title: Sr Data Engineer Philadelphia PA Fulltime Relevant Experience (in Yrs) 10-12 years Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins, Experience Required 10 - 12 Years Roles & Responsibilities 1. Hands-on architecture/development of ETL pipelines using our internal...

  • Sr Data Engineer

    5 months ago

    Philadelphia, United States Diverse Lynx Full time

    Job Title: Sr Data Engineer Location: Philadelphia, PA (100% Onsite role from Day 1) Duration: Full Time/Permanent Job Description: Relevant Experience (in Yrs) 10-12 years Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins, Experience Required 10 - 12 Years Roles & Responsibilities ...

  • Data Engineer for Advanced Analytics

    4 days ago

    Philadelphia, Pennsylvania, United States rockITdata Full time

    We are seeking a skilled Data Engineer to join our team at rockITdata, a veteran-owned and minority woman-owned small business providing full-service consulting services. Our mission is to help companies build efficiencies, decrease costs, and drive better outcomes using industry-leading cloud-based artificial intelligence and machine learning...

  • Data Engineering Strategist

    1 week ago

    Philadelphia, Pennsylvania, United States SysMind Tech Full time

    Job SummaryWe are seeking a highly skilled Data Engineering Strategist to join our team at SysMind Tech. This role requires expertise in designing and developing ETL pipelines using Java, as well as hands-on experience with real-time data processing and streaming.

  • Data Engineer

    1 month ago

    Philadelphia, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Data Engineer

    4 weeks ago

    philadelphia, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Data Engineer

    1 month ago

    philadelphia, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Data Engineer III

    2 weeks ago

    Philadelphia, United States Children's Hospital of Philadelphia Full time

    SHIFT: Day (United States of America) Data Engineer III - Children's Hospital of Philadelphia (Philadelphia, PA): Execute data engineering projects from inception to completion, utilizing real-time streaming data platforms and cloud services for efficient data extraction and ingestion, performing code development, and creating actionable dashboards to...

  • Full Stack Data Engineer

    3 weeks ago

    Philadelphia, United States rockITdata Full time

    rockITdata, a veteran, minority, and woman-owned small business certified by the NWBOC, is a full-service consulting provider that specializes in providing management and IT services. We help companies build efficiencies, decrease cost, and drive better outcomes. We achieve these goals by leveraging industry leading cloud based artificial intelligence and...

  • Data Engineer for Innovative Solutions

    1 week ago

    Philadelphia, Pennsylvania, United States rockITdata Full time

    Job OverviewWe are seeking a talented Data Engineer to join our team at rockITdata. As a seasoned expert in data engineering, you will be responsible for designing and implementing scalable data solutions to drive business growth and innovation.Key ResponsibilitiesData Ingestion and Integration: Design and implement efficient data ingestion pipelines to...

  • Data Engineer, Services

    2 weeks ago

    Philadelphia, United States Penn Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Data Engineer

    1 month ago

    Philadelphia, PA, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Sr. PySpark Data Engineer

    2 weeks ago

    Philadelphia, United States SysMind Tech Full time

    1. Hands-on architecture/development of ETL pipelines using our internal framework written in Java 2. Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark 3. Interpret data, analyze results using statistical techniques and provide ongoing reports 4. Develop and implement databases, data collection...

  • Technical Lead

    2 days ago

    Philadelphia, United States Hexaware USAAvance Consulting Full time

    Primary Skill :  Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark   Build Data Transformation in ADB   Convert Scala Programs to PySpark Programs   Understand  the SCALA program in DataBricks   ADF Secondary Skills:   Azure data lake gen 2   Synapse analytics (dedicated SQL pool)    Exp in delta Lake    ...

  • Data Engineer

    1 week ago

    Philadelphia, Pennsylvania, United States Comcast Full time

    Cloud Data Engineer Job DescriptionWe are seeking an experienced Data Engineer to join our team as a Cloud Architect. As a key member of our engineering team, you will design, deploy, and maintain scalable and efficient data pipelines using cloud-based technologies.About the Role:Deploy, schedule, and monitor ETL workflows on cloud platforms like Databricks,...

  • Data framework Developer

    1 week ago

    Philadelphia, United States Atika Technologies Full time

    Hi Team Please share profiles for the below role Data Framework Developer Philadelphia, PA Locals preferred Rate - 60/hr , 10+ years of experiencePYSPARK development experience mustJOB DESCRIPTION: - We are seeking a talented and experienced Data Framework Development Technical Lead to join our growing team. In this exciting role, you will play a pivotal...

  • Data Architect IV

    1 week ago

    Philadelphia, Pennsylvania, United States Teleworld Solutions Full time

    Job DescriptionTeleWorld Solutions is seeking a skilled Software Developer IV to join our team. As a key member of our big data ecosystem, you will be responsible for building, testing, and enhancing software applications using Python, Java, SQL, and AWS tools.Key Responsibilities:Develop and support data flows, processing data in real-time from devices...

  • Senior Data Engineer

    4 months ago

    Philadelphia, United States Perpay - Career's Page Full time

    About Us: We believe everyone deserves a chance to improve their financial future. We're dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability. Some things we're excited about: $500 million in spending power used by our members Increasing members' credit by 36 points (on...