Senior Data Engineer

4 days ago


Philadelphia, Pennsylvania, United States Comcast Corporation Full time
Job Title: Senior Data Engineer

Comcast Corporation is seeking a highly skilled Senior Data Engineer to join our team in Philadelphia. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and applications.

Key Responsibilities:
  • Design and develop big data ETLs using Python, Spark, and SQL
  • Present and defend architectural, design, and technical choices to internal audiences
  • Assist leadership and architects in the design process and provide technical guidance on practices and procedures
  • Responsible for creating and maintaining large Graph Data platforms
  • Well-versed in ingestion and processing large data sets and provide actionable recommendations using data analytics
  • Develop software systems in an Agile development environment and on AWS cloud-based platform using Python, Spark, Scala, Databricks, NEO4J, and AWS
  • Contribute to the development of application metrics and work towards improving them
  • Develop automated processes that identify patterns and make decisions with minimal human intervention
  • Continually work on improving the quality of the codebase
  • Advocate for improvements to data quality, security, and performance of the platform
  • Work with and mentor junior and senior software development engineers
  • Collaborate with data scientists and architects to build cross-functional solutions to current and future business imperatives
Requirements:
  • Proficient in Python, with good knowledge of concurrent processing
  • Hands-on experience in developing complex ETL applications with Spark and SQL
  • Good to have knowledge of data-engineering systems such as data lake, file-formats, batch & stream processing (Kafka). Databricks experience is a must
  • Experience in application development using Docker, Kubernetes, especially at high-scale is a bonus
  • Experience with CI/CD tools such as Git, Jenkins, Concourse
  • Experience with Graph DBs - Neptune/Neo4j
  • Knowledge of AWS ecosystem - S3, Lambda, EC2, EKS, Cloudwatch, Kinesis, SNS, SQS
  • Strong communication and debugging skills required
  • Experience with observability tools such as ELK, Prometheus, Grafana, Opentelemetry
  • Highly proficient in implementing and building practices around unit/integrating testing frameworks such as pytest, cucumber, etc on big data platforms
  • Knowledge of GraphQL, Cypher & Django
Qualifications:
  • Bachelor's or Master's degree in Computer Science or a similar field of study
  • Extensive data engineering experience is required
  • 7+ years of hands-on work in the field of software development
  • 3+ years of experience with data applications and tools (Snowflake, Databricks, Spark, EMR, Presto, Datadog, DBT, etc.)
  • 3+ years of experience in designing and building ETL pipelines to process data at scale
  • 3+ years of hands-on experience with AWS services like S3, EC2, ECS, IAM, CloudWatch, Lambda, and other AWS services
  • 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
  • Must be versatile and an inquisitive problem solver with excellent communication and writing skills
  • Strong skills in SQL and proven experience working with at least one of the major database platforms
What We Offer:
  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Recognition and rewards for outstanding performance

Comcast Corporation is an equal opportunity employer and welcomes applications from diverse candidates. We are committed to creating an inclusive and diverse workplace that reflects the communities we serve.


  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    Job Title: Senior Data EngineerComcast Corporation is seeking a highly skilled Senior Data Engineer to join our team in Philadelphia. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data platforms using Neo4j and other technologies.Key Responsibilities:Design and develop big data ETL pipelines using...

  • Senior Data Engineer

    2 weeks ago


    Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Comcast Corporation. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Neo4j and other big data technologies.Key Responsibilities:Design and develop complex ETL pipelines...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States InsideHigherEd Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at the University of Pennsylvania. As a Senior Data Engineer, you will be responsible for leading multi-disciplinary data analysis efforts and providing expertise in data engineering and analytics.About the Role:Develop and apply advanced data analysis...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States InsideHigherEd Full time

    Job Title: Senior Data EngineerJoin the Perelman School of Medicine at the University of Pennsylvania as a Senior Data Engineer and contribute to the development of innovative data analysis techniques for large-scale neuroimaging studies. As a member of the Lifespan Informatics and Neuroimaging Center (PennLINC), you will work closely with a...


  • Philadelphia, Pennsylvania, United States Data Intelligence Full time

    Job Title: Senior Cloud Software EngineerData Intelligence, LLC is seeking a highly skilled Senior Cloud Software Engineer to join our team in Philadelphia, PA. As a key member of our software development team, you will be responsible for designing, developing, and deploying cloud-based software systems.Job Responsibilities:Provide full software development...


  • Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    About Us:We're a financial technology company dedicated to building inclusive financial products that help our members improve their financial futures. Our mission is to create simple and accessible financial solutions that promote healthy financial habits and economic stability.Our Products:We've developed innovative products like Perpay Marketplace,...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States PENN Interactive Full time

    About the RolePenn Interactive is a leading interactive gaming company that is revolutionizing the gaming industry with its innovative and immersive experiences. We are seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of high-quality and sustainable data-driven solutions.As a key member of our Data Engineering...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    About PerpayWe're a financial technology company dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability.Our mission is to make financial inclusion a reality for everyone, and we're looking for talented individuals to join our team.The RoleWe're seeking a Senior Data Engineer to...


  • Philadelphia, Pennsylvania, United States Veeva Systems Full time

    About Veeva SystemsVeeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead.Our ValuesWe're guided by our core values: Do...

  • Senior Data Scientist

    3 weeks ago


    Philadelphia, Pennsylvania, United States InsideHigherEd Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist to join our team at the University of Pennsylvania. As a Senior Data Scientist, you will play a key role in developing and implementing data-driven solutions to drive business growth and improve patient outcomes.Job Summary:The Senior Data Scientist will work closely with...


  • Philadelphia, Pennsylvania, United States Harnham Full time

    Job Title: Senior Data ArchitectLocation:Fully RemoteContract Duration:6 Months (Possible Extensions)Compensation:$95-$115/hrAbout the Role:This company is seeking an individual with expertise in software and data engineering to drive transformative solutions in the pharmaceutical industry. This company is a renowned pharmaceutical manufacturer conducting...


  • Philadelphia, Pennsylvania, United States Partnerize Full time

    About PartnerizePartnerize is a leading provider of partnership marketing solutions, empowering brands to discover, engage, and convert audiences at scale while maintaining brand safety and control.Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist to join our team. As a key member of our data science team, you will be...


  • Philadelphia, Pennsylvania, United States Data Intelligence, LLC Full time

    Job Title: Senior Cloud Software DeveloperData Intelligence, LLC is seeking a highly skilled Senior Cloud Software Developer to support our U.S. Navy client in Philadelphia, PA. This is a remote potential opportunity.Job Responsibilities:Provide full software development lifecycle development and ongoing operation, maintenance, troubleshooting, and...


  • Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    Job SummaryThe Corporate Environmental Sustainability team at Comcast Corporation is seeking a highly skilled Sustainability Data Senior Manager to shape the company's overall environmental sustainability strategy. This role will work closely with business and division teams across the enterprise to develop, align, operationalize, and execute on the...


  • Philadelphia, Pennsylvania, United States ORBIS, Inc. Full time

    Job Title: Senior Engineer IIIAt ORBIS, Inc., we are seeking a highly skilled Senior Engineer III to join our team. This role will be responsible for providing engineering support to HM&E systems, including evaluating and interpreting data from the Fleet, providing engineering support for submarine systems, and offering shipboard troubleshooting and...


  • Philadelphia, Pennsylvania, United States Partnerize Full time

    About the RoleWe are seeking a highly skilled Senior Data Scientist to join our team at Partnerize. As a key member of our data science team, you will play a critical role in driving business growth through data-driven insights and machine learning solutions.Key ResponsibilitiesLead the development and deployment of machine learning models into production,...


  • Philadelphia, Pennsylvania, United States Saxon Global Full time

    Job Title: Senior Software EngineerSaxon Global is seeking an experienced Senior Software Engineer to join our team. As a key member of our development team, you will be responsible for designing and maintaining data-intensive MongoDB and GRPC-based APIs, as well as designing, implementing, and deploying new scalable and secure...

  • Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States rockITdata Full time

    Job Title: Full Stack Data EngineerWe are seeking a highly skilled Full Stack Data Engineer to join our team at rockITdata. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable data solutions that meet the needs of our clients.Key Responsibilities:Data Ingestion and Integration:Design and implement data...


  • Philadelphia, Pennsylvania, United States Clarivate Analytics Full time

    About the RoleWe are seeking an experienced Senior Search Engineer to join our product technology team. The ideal candidate will have a deep understanding of search solutions, data management, and integration platforms, as well as a strong background in designing and implementing scalable, high-performance data-driven solutions.Key ResponsibilitiesDevelop...

  • Data Engineer

    4 weeks ago


    Philadelphia, Pennsylvania, United States Constellation Search Group Full time

    Data Engineer Job DescriptionWe are seeking a skilled Data Engineer to join our dynamic team at Constellation Search Group. As a Data Engineer, you will play a crucial role in building and maintaining scalable data pipelines and ensuring seamless data integration, storage, and processing using the latest cloud technologies.Key Responsibilities:Develop and...