Lead Big Data Engineer

2 weeks ago


Philadelphia, United States Clarivate Analytics Full time

We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you

About You – experience, education, skills, and accomplishments

  • Bachelor's degree in computer science or equivalent experience in software development.
  • Minimum 5 years of relevant experience in developing Big Data systems.
  • Minimum 5 years' experience in working with all aspects of distributed processing, including Hadoop, Hive, Apache Spark and Cassandra.
  • Minimum 5 years' experience coding in key technologies like Java, Apache Spark, Hive, PostgreSQL, Scala, Git, Linux, AWS, and Greenplum.
  • Minimum 5 years' experience in AWS Ecosystem with hands-on knowledge of ec2, S3 and services
  • Minimum 5 years' experience in working with build tools like Maven, Gradle and CI/CD tools like Jenkins.
  • Minimum 5 years' experience in optimizing Big Data system performance.

It would be great if you also had . . .

  • Experience in Big Data design and development
  • Experience on Spark streaming
  • Ability to guide developers—Front end, back end, and full-stack developers across different tech functions
  • An understanding of existing complex processes and workflows
  • Hands on experience with the full SDLC
  • Experience working in an Agile Scrum methodology

What will you be doing in this role?

  • Work closely with users, technical leads, project managers, and other cross-functional development teams to design and deliver software solutions.
  • Design software solutions, making modifications to existing software and integrating applications within the core pathway.
  • Must develop software using disciplined software development processes, adhering to team/company standards and software best practice guidelines, and corporate policies.
  • Responsible for applying working knowledge of OO design patterns to develop enterprise level and cloud native solutions.
  • Demonstrate ability of translating plain requirements into effective technical design and solutions
  • Deliver quality product to our QA and be responsible for creating and executing unit tests on the code that they write for their applications.
  • Able to write high-performance, reliable, and maintainable code.
  • Demonstrate excellent communication and collaboration skills and has experience in working with cross functional and cross geography teams.

Hours of Work

  • Full time, permanent
  • Hybrid working schedule 2-3 days/week on-site
  • Must live within a commutable distance to our Philadelphia, PA office

Clarivate is an Equal Opportunity Employer Vets/Minorities/Women/Disabled



  • Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...


  • Philadelphia, United States Clarivate Full time

    We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...


  • Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer - Python / AWS / ETL / Big Data at JPMorgan Chase within the Consumer and Community Bank, Connected Commerce Technology, you are an integral part of an agile team that works to enhance, build,...

  • Lead Data Engineer

    2 weeks ago


    Philadelphia, United States RIT Solutions, Inc. Full time

    Job description Tech Lead- Leadership capabilities and highly technical expertise On Redshift and moving to serverless Big data experience - volume of data is something they need to consistently solution for so it does not impact performance - ability to solution, coach, and mentor team to handle large data sets - work with testing and product Data lake -...

  • Data Engineer

    2 weeks ago


    Philadelphia, United States ClifyX Full time

    Open Position-GCP Data Engineer Rate-$65 Location-Philadelphia Skill Set • Python, Big Data, SQL, ETL • Tableau • GCP experience in Data Engg/Analytics - GCP Data Flow (Hands on experience in E2E pipeline creation is MUST) JD Experience working with Linux, DataBricks, and Azkaban or similar tools. Strong knowledge of SQL, nodejs,javascript,Python...

  • Sr Data Engineer

    7 days ago


    Philadelphia, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with...

  • Sr Data Engineer

    1 week ago


    Philadelphia, Pennsylvania, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with emerging...


  • Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Strategy: Define and implement the overarching data architecture and strategy for the organization. Design scalable, reliable, and efficient data pipelines, data warehouses, and data lakes to support business needs and objectives.Data Engineering Leadership: Provide...


  • Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Design: Design and implement scalable and efficient data architectures, including data warehouses, data lakes, and data marts. Define data models, schemas, and standards to ensure consistency and reliability across the organization.Data Pipeline Development: Develop and...


  • Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Technical Leadership: Lead machine learning projects from conception to completion, providing technical guidance, direction, and mentorship to a team of machine learning engineers. Set technical direction, define project objectives, and ensure alignment with organizational goals and...


  • Philadelphia, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data...


  • Philadelphia, Pennsylvania, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data analysis...


  • Philadelphia, United States TWO95 International Full time

    Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT...

  • Data Engineer

    1 month ago


    Philadelphia, United States codesbright Full time

    Responsibilities Establish a culture of collaboration and excellence within the team – and across the organization. Explore and recommend innovative solutions to complex problems. Ensure our data assets meet our data quality standards. Have fun in a fast-paced energetic environment.Qualifications 2+ years of relevant employment experience or a...

  • Data Engineer

    1 month ago


    Philadelphia, Pennsylvania, United States codesbright Full time

    Responsibilities Establish a culture of collaboration and excellence within the team – and across the organization. Explore and recommend innovative solutions to complex problems. Ensure our data assets meet our data quality standards. Have fun in a fast-paced energetic environment.Qualifications 2+ years of relevant employment experience or a master's...

  • Sr Data Engineer

    1 week ago


    Philadelphia, United States HealthVerity Full time

    Position: Data Engineer Reporting to: Director, Data Engineering Location: Philadelphia, PA How you will help As a data engineer on the data platform team, you will be supporting and enhancing the platform that supports HealthVerity's Petabyte-scale core data asset. You will work closely with other engineers, data scientists, and business leaders to...


  • Philadelphia, United States Data Cloud Merge Full time

    Company Description Data Cloud Merge is a communications Company that was established in the year 2002 and located in Jersey City, New Jersey. It has gained a lot of experience in providing innovations in IT that were formerly found in large companies alone. The Company provides dedicated IT innovations at friendly prices unlike other companies that operate...