Sr Data Engineer- Ad Tech- Flink- Scala

3 days ago


Pittsburgh PA United States Comcast Corporation Full time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.
Job Summary The FreeWheel Identity team is a global team whose mission is to power the identity and audience functionality in Freewheel products. We operate at a tremendous scale - 10+TB ingested per day and over datasets containing more than a trillion records. We build various services from real-time APIs that support millions of requests per second to big data ETL pipelines to serve both internal and external clients. As the team grows, we are looking for a savvy Senior Software Engineer to join the team and help build the next generation of Audience & Identity data platform that handles data at scale and uses state-of-the-art technologies to unlock the data's business value. If you're excited to work with a tightly-knit team of data engineers solving hard problems the right way using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud, this opportunity is for you.
Job Description
Core Responsibilities

* Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
* Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
* Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
* Collaborates with the serving team, report team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
* Works with Lead Engineers and Architects to share and contribute to the broader technical vision.
* Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
* Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
* Oversees the documentation of all development activities.
* Provides guidance and support to other Engineers.
* Other duties and responsibilities as assigned.

Requirements:

* Ad Tech or Streaming experience
* Flink Experience
* Preferably, Scala experience but open to Java
* 5+ years of hands-on work in the field of software development.
* 3+ years of experience with data applications (Spark, Presto, Hive, etc)
* 3+ years of experience in designing and building ETL pipelines to process data at scale
* 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
* 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
* 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
* Excellent coding skills with Scala/Java, Python.
* Must be versatile and an inquisitive problem solver.
* Excellent communication and writing skills
* Bachelor's or master's degree in Computer Science or similar field of study

Seems like something you might be interested in? We want to meet you to discuss this exciting opportunity.

Employees at all levels are expected to:

* Understand our Operating Principles; make them the guidelines for how you do your job.
* Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
* Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
* Win as a team - make big things happen by working together and being open to new ideas.
* Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
* Drive results and growth.
* Respect and promote inclusion & diversity.
* Do what's right for each other, our customers, investors and our communities.

Disclaimer:

* This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an EOE/Veterans/Disabled/LGBT employer.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law, including the Los Angeles Fair Chance Initiative for Hiring Ordinance and the San Francisco Fair Chance Ordinance.
Skills:
Amazon Web Services (AWS); Data Pipelines; Scala (Programming Language); Apache Spark; Big Data; Process Streamlining; Python (Programming Language)

Salary:
National Pay Range: $96,600.92 USD-$226,408.42 USD
Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education
Bachelor's Degree
While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
Relevant Work Experience
2-5 Years



  • Philadelphia, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Philadelphia, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Atlanta, GA, United States Data Engineer Jobs Full time

    *Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...


  • Santa Monica, CA, United States Indotronix UK Full time

    JPC - 2708 - Looking for Sr Backend Engineer - Santa Monica (Hybrid) - Contract / Fulltime Location: Santa Monica, CA, United States | Posted: 04/02/24 We have an opportunity for a Sr Backend Engineer role with one of our clients in Santa Monica (Hybrid) . Please see the job details below and let me know if you would be interested in this role. If...

  • Sr Data Engineer

    4 weeks ago


    Sunnyvale, CA, United States DRISHTICON Inc Full time

    We have immediate requirements for Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA. • What are the top 3 skills needed/required? -Object Oriented Programing-Big Data Programing -Database Design• What skills...


  • Seattle, WA, United States Apple Inc. Full time

    Would you like to drive the future of Apple’s products, applications, and platform while having the unique opportunity to impact some of the most far-reaching software applications in the world? iCloud Data organization enables Apple to ship better products for iCloud users to access all their content across apps (Photos, Mail, Messages, FaceTime, Calendar...

  • Lead Data Engineer

    4 weeks ago


    Irving, TX, United States INSPYR Solutions Full time

    Title: Lead Data Engineer If you are interested in applying for this job, please make sure you meet the following requirements as listed below. Location: Irving, TX 75039 (Hybrid) Duration: Direct Hire Compensation: $175K - $200K Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Skillset / Experience: We are seeking a highly...


  • Seattle, WA, United States Amazon Full time

    Data Engineer II, Measurement, Ad Tech, and Data Science (MADS) Job ID: 2744531 | Amazon.com Services LLC The Advertising Amazon Marketing Cloud (AMC) teams build advanced analytics systems that are secure, privacy-safe, and provide a dedicated cloud-based environment in which advertisers can easily perform analytics across multiple, pseudonymized data sets...

  • Senior Data Engineer

    1 month ago


    Chicago, IL, United States Grubhub Full time

    We're all about connecting hungry diners with our network of over 300,000 restaurants nationwide. User-friendly platforms and streamlined delivery capabilities set us apart in the world of online food ordering. Grubhub is a place where authentically fun culture meets innovation and teamwork. We believe in empowering people and opening doors for new...


  • Palo Alto, CA, United States Mason Alexander Full time

    Software Engineer – Ads New York /Palo Alto/San Jose Full Time position directly with our client.Mason Alexander is working with one of the most transformational technology companies of our time. They have in production, a new payments platform, a creator marketplace, a sports app, video streaming and artificial intelligence; which will enable billions of...


  • Waltham, MA, United States Constant Contact Full time

    We have an opening for an exceptional Principal Engineer - Data to join our real-time data engineering team! As a technical leader, you'll be responsible for driving innovation and improvement in our real-time data-related infrastructure and workflows powering direct digital marketing product features for our customers. You'll work closely with...


  • United, United States TechnoGen Full time

    Job Title: Sr. Snowflake Data Engineer (with Python) Job Location:Pennsylvania, PA Duration: Contract Job Description:- Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems Participate in all aspects of the software development lifecycle for Snowflake solutions, including...


  • San Francisco, CA, United States DoorDash USA Full time

    About the Team Data is at the foundation of DoorDash's success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization, and financial reporting. The team serves as the foundation for decision-making at DoorDash. About the Role DoorDash is looking for a Staff Software Engineer,...


  • Seattle, WA, United States Amazon Full time

    Job ID: 2826662 | Amazon.com Services LLC Amazon Advertising seeks the world’s brightest and best leaders to drive next-generation solutions that enable advertisers to reach customers across our owned and operated sites, on other high-quality publisher sites across the web, and on millions of desktops, mobile, and connected TV devices. Our mission is to...

  • Sr. Big Data Engineer

    2 weeks ago


    Sunnyvale, CA, United States AAPRO Consulting Full time

    Sr. Big Data Engineer Qualifications, skills, and all relevant experience needed for this role can be found in the full description below. Skills Professional hand-on experience in Scala/Python. Professional hand-on experience in Sql and Query Optimization. Experience in programming design patterns. Experience in system design. Should have Experience with...


  • Chicago, IL, United States Tbwa ChiatDay Inc Full time

    Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 82M+ daily active unique visitors, Reddit is one of the...

  • Senior Data Engineer

    4 weeks ago


    Richmond, VA, United States SingleStone Full time

    As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...


  • Sunnyvale, CA, United States Walmart Global Tech Full time

    **Immigration Sponsorship is not available in this role & location. **About Team:Marketplace Engineering team is at the forefront of building core platforms and services to enable Walmart to deliver vast selection at competitive prices and with best-in-class customer experience by enabling third-party sellers to the marketplace platform, sell and manage...


  • Cupertino, CA, United States Apple Full time

    Senior Software Engineer, Ad Platforms Cupertino,California,United States Software and Services At Apple, we believe in the power of technology to enrich people's lives. Everything we build is designed to empower people, including our advertising platform. We deliver ads in a way that benefits both customers and advertisers — helping people discover...

  • Sr. Data Scientist

    1 day ago


    Cupertino, CA, United States Apple Full time

    Sr. Data Scientist - Marketplace, Ad Platforms Cupertino, California, United States Software and Services At Apple, we believe in the power of technology to enrich people's lives. Everything we build is designed to empower people, including our advertising platform. We deliver ads in a way that benefits both consumers and advertisers — helping people...