Senior Big Data Engineer

2 weeks ago

Philadelphia, United States Clarivate Full time

We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you

About You - experience, education, skills, and accomplishments

  • Bachelor's degree in computer science or equivalent experience in software development.
  • Minimum 3 years of relevant experience in developing Big Data systems.
  • Minimum 3 years' experience in working with all aspects of distributed processing, including Hadoop, Hive, Apache Spark and Cassandra.
  • Minimum 3 years' experience coding in key technologies like Java, Apache Spark, Hive, PostgreSQL, Scala, Git, Linux, AWS, and Greenplum.
  • Minimum 3 years' experience in AWS Ecosystem with hands-on knowledge of ec2, S3 and services
  • Minimum 3 years' experience in working with build tools like Maven, Gradle and CI/CD tools like Jenkins.
It would be great if you also had . . .
  • Experience in Big Data design and development
  • Experience on Spark streaming
  • An understanding of existing complex processes and workflows
  • Hands on experience with the full SDLC
  • Experience working in an Agile Scrum methodology
What will you be doing in this role?
  • Make modifications to existing software and integrating applications within the core pathway.
  • Must develop software using disciplined software development processes, adhering to team/company standards and software best practice guidelines, and corporate policies.
  • Deliver quality product to our QA and be responsible for creating and executing unit tests on the code that they write for their applications.
  • Able to write high-performance, reliable, and maintainable code.
Hours of Work
  • Full time, permanent
  • Hybrid working schedule 2-3 days/week on-site
  • Must live within a commutable distance to our Philadelphia, PA office


Clarivate is an Equal Opportunity Employer Vets/Minorities/Women/Disabled

  • Senior Big Data Engineer

    2 weeks ago

    Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...

  • Senior Big Data Engineer

    2 weeks ago

    Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...

  • Lead Big Data Engineer

    2 weeks ago

    Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...

  • Lead Big Data Engineer

    2 weeks ago

    Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...

  • Lead Big Data Engineer

    2 days ago

    Philadelphia, United States Clarivate Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...

  • Senior Azure Data Engineer

    2 weeks ago

    Philadelphia, United States TWO95 International Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT...

  • Senior-Level Senior Data Engineer

    3 weeks ago

    Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Strategy: Define and implement the overarching data architecture and strategy for the organization. Design scalable, reliable, and efficient data pipelines, data warehouses, and data lakes to support business needs and objectives.Data Engineering Leadership: Provide...

  • Senior Azure Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Two95 International Inc. Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of...

  • Data Engineer

    2 weeks ago

    Philadelphia, United States ClifyX Full time

    Open Position-GCP Data Engineer Rate-$65 Location-Philadelphia Skill Set • Python, Big Data, SQL, ETL • Tableau • GCP experience in Data Engg/Analytics - GCP Data Flow (Hands on experience in E2E pipeline creation is MUST) JD Experience working with Linux, DataBricks, and Azkaban or similar tools. Strong knowledge of SQL, nodejs,javascript,Python...

  • Mid-Level/Intermediate Senior Data Engineer

    3 weeks ago

    Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Design: Design and implement scalable and efficient data architectures, including data warehouses, data lakes, and data marts. Define data models, schemas, and standards to ensure consistency and reliability across the organization.Data Pipeline Development: Develop and...

  • Lead Software Engineer

    2 weeks ago

    Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer - Python / AWS / ETL / Big Data at JPMorgan Chase within the Consumer and Community Bank, Connected Commerce Technology, you are an integral part of an agile team that works to enhance, build,...

  • Sr Data Engineer

    6 days ago

    Philadelphia, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with...

  • Sr Data Engineer

    1 week ago

    Philadelphia, Pennsylvania, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with emerging...

  • Senior Software Engineer

    2 weeks ago

    Philadelphia, United States Red Spark LP Full time

    We are looking for a Senior Software Engineer who thrives on the challenge of building scalable software in a high-volume, big-data world. If you're a polyglot and can parachute (safely) into any project, join Red Spark in delivering intelligent advertising experiences to millions of consumers around the globe! What You’ll Do: Master the overall platform...

  • Senior Data Engineer

    2 weeks ago

    Philadelphia, United States Penn Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Senior Data Engineer

    1 month ago

    Philadelphia, United States PENN Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Senior Data Engineer, Data Lake

    2 days ago

    Philadelphia, United States Penn Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Senior Data Engineer, Data Lake

    3 days ago

    Philadelphia, Pennsylvania, United States Penn Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Senior Software Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Red Spark Full time

    We are looking for a Senior Software Engineer who thrives on the challenge of building scalable software in a high-volume, big-data world. If you're a polyglot and can parachute (safely) into any project, join Red Spark in delivering intelligent advertising experiences to millions of consumers around the globeWhat You'll Do:Master the overall platform...

  • Senior Software Engineer

    3 weeks ago

    Philadelphia, United States Red Spark Full time

    Job DescriptionJob DescriptionWe are looking for a Senior Software Engineer who thrives on the challenge of building scalable software in a high-volume, big-data world. If you're a polyglot and can parachute (safely) into any project, join Red Spark in delivering intelligent advertising experiences to millions of consumers around the globe!What You’ll...