Senior Big Data Engineer

2 weeks ago


Philadelphia, United States Clarivate Analytic Full time

We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you

About You – experience, education, skills, and accomplishments

  • Bachelor's degree in computer science or equivalent experience in software development.
  • Minimum 3 years of relevant experience in developing Big Data systems.
  • Minimum 3 years' experience in working with all aspects of distributed processing, including Hadoop, Hive, Apache Spark and Cassandra.
  • Minimum 3 years' experience coding in key technologies like Java, Apache Spark, Hive, PostgreSQL, Scala, Git, Linux, AWS, and Greenplum.
  • Minimum 3 years' experience in AWS Ecosystem with hands-on knowledge of ec2, S3 and services
  • Minimum 3 years' experience in working with build tools like Maven, Gradle and CI/CD tools like Jenkins.

It would be great if you also had . . .

  • Experience in Big Data design and development
  • Experience on Spark streaming
  • An understanding of existing complex processes and workflows
  • Hands on experience with the full SDLC
  • Experience working in an Agile Scrum methodology

What will you be doing in this role?

  • Make modifications to existing software and integrating applications within the core pathway.
  • Must develop software using disciplined software development processes, adhering to team/company standards and software best practice guidelines, and corporate policies.
  • Deliver quality product to our QA and be responsible for creating and executing unit tests on the code that they write for their applications.
  • Able to write high-performance, reliable, and maintainable code.

Hours of Work

  • Full time, permanent
  • Hybrid working schedule 2-3 days/week on-site
  • Must live within a commutable distance to our Philadelphia, PA office

Clarivate is an Equal Opportunity Employer Vets/Minorities/Women/Disabled

#J-18808-Ljbffr

  • Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...


  • Philadelphia, United States Clarivate Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...


  • Philadelphia, United States Liberty Personnel Services Full time

    Python Hadoop Data Engineer ( 3 Positions)My client a global leader and top place to work has hired me to find for them a Python Hadoop Data Engineer. In this role you will develop and implement big data solutions. Experience with python, hadoop, hive, spark is preferred. This is a full time perm or contract role that will work a hybrid schedule. You will be...


  • Philadelphia, United States CareerBuilder Full time

    Big Data Hadoop Python Spark Engineers (3 Positions) Python Hadoop Data Engineer ( 3 Positions) My client a global leader and top place to work has hired me to find for them a Python Hadoop Data Engineer. In this role you will develop and implement big data solutions. Experience with python, hadoop, hive, spark is preferred. This is a full time perm or...


  • Philadelphia, United States CareerBuilder Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with Big Data Work with RDBMS and NoSQL Use of ETL/ELT technology (Extract,...


  • Philadelphia, United States TWO95 International Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT...


  • Philadelphia, United States EHS Technologies Full time

    Description Five (5) years of experience in identifying trends and problems through complex big data analysis, leading efforts to combine analysis from multiple data sources using a variety of techniques, ranging from simple data aggregation via statistical analysis to complex data mining independently. Experience architecting scalable process solutions...


  • Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Strategy: Define and implement the overarching data architecture and strategy for the organization. Design scalable, reliable, and efficient data pipelines, data warehouses, and data lakes to support business needs and objectives.Data Engineering Leadership: Provide...


  • Philadelphia, Pennsylvania, United States Two95 International Inc. Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of...

  • Data Engineer

    1 day ago


    Philadelphia, United States ClifyX Full time

    Open Position-GCP Data Engineer Rate-$65 Location-Philadelphia Skill Set • Python, Big Data, SQL, ETL • Tableau • GCP experience in Data Engg/Analytics - GCP Data Flow (Hands on experience in E2E pipeline creation is MUST) JD Experience working with Linux, DataBricks, and Azkaban or similar tools. Strong knowledge of SQL, nodejs,javascript,Python...


  • Philadelphia, Pennsylvania, United States Barbaricum Full time

    Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets. We leverage more than 15 years of support to stakeholders across the federal government, with established and growing capabilities across Intelligence, Analytics, Engineering,...


  • Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Design: Design and implement scalable and efficient data architectures, including data warehouses, data lakes, and data marts. Define data models, schemas, and standards to ensure consistency and reliability across the organization.Data Pipeline Development: Develop and...

  • Lead Software Engineer

    23 hours ago


    Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer - Python / AWS / ETL / Big Data at JPMorgan Chase within the Consumer and Community Bank, Connected Commerce Technology, you are an integral part of an agile team that works to enhance, build,...


  • Philadelphia, United States CareerBuilder Full time

    About the Role: As a Data Engineering Manager at Perpay, you will lead data engineers and work closely with data scientists and analysts to help drive our vision of building data products and insights for our stakeholders and customers, accelerating Perpays mission to create inclusive financial products that improve the lives of our members. We are actively...


  • Philadelphia, United States Red Spark LP Full time

    We are looking for a Senior Software Engineer who thrives on the challenge of building scalable software in a high-volume, big-data world. If you're a polyglot and can parachute (safely) into any project, join Red Spark in delivering intelligent advertising experiences to millions of consumers around the globe! What You’ll Do: Master the overall platform...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, United States PENN Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...


  • Philadelphia, United States Penn Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...