Principal Data Engineer

4 months ago


Philadelphia PA United States Comcast Corporation Full time
Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

The Technology, Product, Experience (TPX) organization works at the intersection of media and technology and our innovative teams are continually developing and delivering products and next-generation technologies that transform the customer experience. The Comcast Network and CONNECTivity (CONNECT) organization is a highly agile, fast-paced, dedicated group at the forefront of change focused on innovating, building, and operating the best in class, most reliable access network for our customers. We are looking for a Senior Data Engineer (Engineer 5) with Neo4j experience to join our Philadelphia-based team. As the senior member of the engineering team, you also influence coding practices, architecture, and team maturation.

Job Description

Technology Environment:

ROCI [Routing of Critical/Cable Infrastructure] is an enterprise graph data platform that acts as a logical and physical topology graph for Comcast’s entire access network from the headend (CMTS) to customer (CPE/Cable Modems). To build this topology graph, ROCI consumes data from a number of BSS/OSS, construction, provisioning, planning, and monitoring platforms to create linkages previously unseen across the company. Our unique enrichment methodology provides insight into our plant, utilization, and routing that will enable increased velocity in network expansion and provide new opportunities to pre-emptively prevent customer affecting events. Our ultimate vision is to build a digital twin that seamlessly represents our physical outside plant as observed by the eye and the logical representation of the network traffic flowing through those components.

This team is based in our cutting-edge Comcast Technology Center in downtown Philadelphia. We are in office on a hybrid schedule and this role is not eligible for remote/virtual employment.


Core Responsibilities:

  • Design, develop, test, and maintain big data ETL’s
  • Presents and defends architectural, design, and technical choices to internal audiences.
  • Assists leadership/architects throughout the design process and with technical guidance regarding practices, procedures, with focus on scale and long term sustainability
  • Responsible for creating and maintaining large Graph Data platforms.
  • Well versed with ingestion and processing large data sets and provide actionable recommendations using data analytics.
  • Develop software systems in an Agile development environment and on AWS cloud-based platform using Python, Spark, Scala, Databricks, NEO4J, and AWS
  • Contributes to the development of application metrics & work towards improving them.
  • Develop automated processes that identify patterns and make decisions with minimal human intervention.
  • Continually works on improving the quality of codebase. 
  • Advocating for improvements to data quality, security, and performance of the platform.    
  • Work with and mentor junior and Senior Software Development Engineers. 
  • Collaborate with data scientists and architects to build cross functional solutions to current and future business imperatives
  • Displays in-depth knowledge of and ability to apply software design, and redesign skills.
  • Integrates knowledge of business and functional priorities.
     

Required Skills:

  • Proficient in Python, with good knowledge of concurrent processing
  • Hands on experience in developing complex ETL applications with spark and SQL
  • Good to have knowledge of data-engineering systems such as data lake, file-formats, batch & stream processing (Kafka). Databricks experience is a must.
  • Experience in application development using Docker, Kubernetes, especially at high-scale is a bonus
  • Experience with CI/CD tools such as Git, Jenkins, Concourse
  • Experience with Graph DBs - Neptune/Neo4j
  • Knowledge of AWS ecosystem - S3, Lambda, EC2, EKS, Cloudwatch, Kinesis, SNS, SQS
  • Strong communication and debugging skills required
  • Experience with observability tools such as ELK, Prometheus, Grafana, Opentelemetry
  • Highly proficient in implementing and building practices around unit/integrating testing frameworks such as pytest, cucumber, etc on big data platforms
  • Knowledge of GraphQL, Cypher & Django


Candidate should have the required knowledge to implement the required tasks, test it, deploy it to different environments, and setup observability to view how the API/pipeline is behaving.

Qualifications

  • Bachelor's or Master's degree in Computer Science or a similar field of study
  • Extensive data engineering experience is required.
  • 7+ years of hands-on work in the field of software development.
  • 3+ years of experience with data applications and tools (Snowflake, Databricks, Spark, EMR, Presto, Datadog, DBT, etc.)
  • 3+ years of experience in designing and building ETL pipelines to process data at scale
  • 3+ years of hands-on experience with AWS services like S3, EC2, ECS, IAM, CloudWatch, Lambda, and other AWS services
  • 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
  • Must be versatile and an inquisitive problem solver with excellent communication and writing skills.
  • Strong skills in SQL and proven experience working with at least one of the major database platforms.

Employees at all levels are expected to:

  • Understand our Operating Principles; make them the guidelines for how you do your job.
  • Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
  • Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
  • Win as a team - make big things happen by working together and being open to new ideas.
  • Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
  • Drive results and growth.
  • Respect and promote inclusion & diversity.
  • Do what's right for each other, our customers, investors and our communities.

Disclaimer:

  • This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

About Our Perks & Benefits:

We are determined to create an environment where our employees feel valued, understand our business goals, and are motivated.

Here's a look at just some of the perks and benefits we make available to our US-based employees:

  • Medical & Dental
  • 401(k) Savings Plan
  • Generous paid time off
  • Life Milestones - from adoption assistance, childcare resources, pet insurance, and more, Comcast supports you at all life stages.
  • Courtesy Services - We offer all of our full-time employees in serviceable areas free digital TV and internet.
  • Discount tickets for Universal Resorts, including theme park tickets and onsite hotel rooms.

Learn more at jobs.comcast.com/life-at-comcast/benefits

Reasonable Accommodation

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Please contact us to request an accommodation.

Disclaimer:
  • This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.



Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.


Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

10 Years +



  • Philadelphia, United States Elsevier Full time

    Elsevier employs 9,200 people worldwide, including over 2,500 technologists. We have supported the work of our research and health partners for more than 140 years. Growing from our roots in publishing, we offer knowledge and valuable analytics that help our users make breakthroughs and drive societal progress. Digital solutions such as ScienceDirect,...


  • Philadelphia, United States Elsevier Full time

    Elsevier employs 9,200 people worldwide, including over 2,500 technologists. We have supported the work of our research and health partners for more than 140 years. Growing from our roots in publishing, we offer knowledge and valuable analytics that help our users make breakthroughs and drive societal progress. Digital solutions such as ScienceDirect,...


  • Philadelphia, PA, United States Comcast Corporation Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...


  • Philadelphia, PA, United States Comcast Corporation Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...


  • , IL, United States Discover Financial Services Full time

    Job Title: Principal Data ScienceDiscover Financial Services is seeking a highly skilled Principal Data Science to join our team. As a key member of our data science organization, you will be responsible for leading analytical initiatives to drive business growth and improve customer experience.Key Responsibilities:Develop and implement data-driven...

  • Principal Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States Westinghouse Electric Company, LLC Full time

    Job Title: Principal EngineerWe are seeking a highly skilled Principal Engineer to join our team at Westinghouse Electric Company, LLC. As a Principal Engineer, you will be responsible for leading the execution of the Turbine Island Design Plan for 50 Hz AP1000 design.Key Responsibilities:Lead the execution of the Turbine Island Design Plan for 50 Hz AP1000...


  • Philadelphia, United States Comcast Corporation Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...


  • Philadelphia, PA, United States Comcast Corporation Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...


  • Westlake, TX, United States Fidelity Investments Full time

    Job Description:Principal Data Modeler – RDBMS/DATA WAREHOUSING/OLAP/SNOWFLAKE/CLOUDThe RoleAs a Data Modeler, the candidate will collaborate with collaborators and multi-functional teams, Architects, Tech Leads and senior development resources across our team, as well as other technical and business collaborators across the organization in a fast paced...


  • Westlake, TX, United States Fidelity Investments Full time

    Job Description:Principal Data Modeler – RDBMS/DATA WAREHOUSING/OLAP/SNOWFLAKE/CLOUDThe RoleAs a Data Modeler, the candidate will collaborate with collaborators and multi-functional teams, Architects, Tech Leads and senior development resources across our team, as well as other technical and business collaborators across the organization in a fast paced...


  • Philadelphia, Pennsylvania, United States Westinghouse Electric Company, LLC Full time

    Job Title: Principal Project EngineerWestinghouse Electric Company, LLC is seeking a highly skilled and experienced Principal Project Engineer to join our team. As a key member of our Global Instrumentation & Control (GIC) AP300 Instrumentation & Control program, you will be responsible for managing and driving the schedule and cost of the project.Key...


  • Philadelphia, United States Liberty Personnel Services, Inc Full time

    Job DescriptionJob DescriptionPrincipal Software Engineer One of Philadelphia's hottest tech companies is hiring again due to continued growth. They are very cutting edge and always looking for the brightest minds in the industry to join their talented team. The position sits in a state of the art Center City office easily accessible by public transit....


  • Houston, TX, United States Sysco Full time

    Essential Functions: • Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization. • Partner with all facets of the business to include...

  • Principal Engineer

    2 weeks ago


    Philadelphia, Pennsylvania, United States Westinghouse Electric Company Full time

    Job Title: Principal EngineerWe are seeking a highly skilled Principal Engineer to join our team at Westinghouse Electric Company. As a key member of our organization, you will be responsible for leading the execution of the Turbine Island Design Plan for 50 Hz AP1000 design.Key Responsibilities:Lead the execution of the Turbine Island Design Plan for 50 Hz...


  • Philadelphia, Pennsylvania, United States Civil & Environmental Consultants, Inc. Full time

    Job Title: Bridge Engineer PrincipalCivil & Environmental Consultants, Inc. is seeking a highly skilled Bridge Engineer Principal to join our team in Pittsburgh, PA. As a key member of our bridge design team, you will be responsible for leading the design and delivery of bridge projects, collaborating with clients, and mentoring junior engineers.Key...


  • Austin, TX, United States Dell Full time

    Mechanical Senior Principal Engineer Join us as a Mechanical Senior Principal Engineer on our Custom Design and Emerging Technology team in Austin, Texas to do the best work of your career. The Custom Design and Emerging Technology team is focused on delivering next generation technologies through innovative solutions. If you have a passion for solving...


  • Manchaca, TX, United States Dell Full time

    Data Center Power Sr Principal Engineer Our Electrical Engineering team puts the spark into the full hardware development lifecycle, from concept to production. It takes experts in system architecture definition, design, analysis, prototyping, sourcing & the debugging and validation of layouts or routes to deliver state-of-the-art products for a changing...


  • Philadelphia, Pennsylvania, United States Westinghouse Electric Company Full time

    Job Title: Principal Project EngineerWestinghouse Electric Company is seeking a Principal Project Engineer to support the AP300 Instrumentation & Control program. The successful candidate will be responsible for managing and driving the schedule and cost, as well as driving an accurate demand signal to the functional areas.Key Responsibilities:Manage and...


  • Philadelphia, Pennsylvania, United States Westinghouse Electric Company, LLC Full time

    Join Westinghouse Electric Company, LLC as a Principal Project Engineer and be part of an innovative team that supports the company's mission to provide clean energy solutions. As a key member of the Global Instrumentation and Control (GIC) AP300 Instrumentation and Control program, you will play a critical role in supporting the design and delivery of this...


  • Philadelphia, Pennsylvania, United States Westinghouse Electric Company, LLC Full time

    Job Title: Principal Design EngineerWe are seeking a highly skilled Principal Design Engineer to join our team at Westinghouse Electric Company, LLC. As a key member of our engineering team, you will be responsible for designing and analyzing components for nuclear power plants, ensuring the highest level of safety, quality, and efficiency.Your Key...