Lead Data Engineer

3 weeks ago

Philadelphia, United States Clarivate Analytics US LLC Full time

Our technology powers the world's top companies to bring innovation to life and manage their IP portfolio. As a leader in our industry, we are embarking on a transformative journey to leverage big data, data lakes, and lakehouse technologies to streamline our data services and support our product lines with scalable, efficient, and high-quality data solutions. We are looking for a Lead Data Engineer for our IP Maintenance products and services to spearhead the design and implementation of a simplified data service over a highly distributed data system.


This position will report to the Director of IP Technology and with a focus on digital transformation strategy, this role would work closely with product leaders, business operations, engineering teams, and other stakeholders to align on strategic goals and ensure delivery of innovative digital products and highly automated experiences using AI/ML technologies. This role is critical in harnessing the power of Big Data, Lakehouse, Data Virtualization, Transformation and Integration technologies to enhance our product offerings and drive business growth. The ideal candidate must be hands-on and will have a strong background in data engineering, with proven experience in developing and deploying large-scale data solutions in a cloud environment, must be metrics-focused and obsessed with Cloud native and DevOps technologies.

In this role, you will have the opportunity to make a lasting impact on the digital transformation journey, drive customer-centric innovation, and the ideal candidate will have a background of running transformation projects in similar disruptive industries such as Digital Payments or Fintech.


About You - Experience, Education, Skills, and Accomplishments

  • Bachelor's in Computer Science or an equivalent experience in software development, with a minimum of 7 years experience in developing and delivering business transformation projects or products using data engineering and AI/ML technologies.
  • Minimum of 5 years in leading engineering teams, with demonstrated experience in building high-performing, best in class engineering teams for a high-growth software product environment.
  • Minimum of 5 years' experience in data lake / lakehouse, distributed systems and data, data virtualization, microservices, and machine learning.
  • Minimum of 5 years' experience working with data structures, data streaming and pipelines, search, training and inference algorithms, event driven patterns and middleware technologies.
  • Minimum of 5 years of hands-on skills in Python, Apache Spark, Hive, Cassandra, Snowflake, Elastic, Lucene, DataBricks, Hadoop, Redshift, Scala, Java, or other relevant technologies in data engineering.
  • Minimum of 5 years' experience building containerized applications and deploying them to public or private clouds, such as Amazon Web Services (AWS), Microsoft Azure, or similar providers, end-to-end SaaS applications, and highly scalable software products.
  • Minimum of 5 years' experience with automated delivery pipelines, agile delivery, and test-driven development and real-time data processing (e.g., Kafka, Spark Streaming).


It would be great if you also had...

  • Masters degree in Computer Science
  • Experience in functional decomposition of legacy products and migrating to modern microservices architecture.
  • Experience delivering products against plan in a fast-paced, multi-disciplined, distributed-responsibility and often ambiguous environment
  • Experience in automated delivery pipelines, agile delivery, and test-driven development.
  • Analytical and quantitative skills; experience using hard data and metrics to back up assumptions and develop business cases


What will you be doing in this role?

  • Lead the design and development of a scalable and simplified data service using big data, data lakes, data virtualization, and /or data lakehouse technologies.
  • Partnering closely with the Product, Technology and Business Operations teams to evolve and accelerate the execution of the product roadmap to maximize the current suite of digital solutions and innovate next generation solutions that will drive transformations.
  • Leading and managing a set of engineering-driven initiatives from ideation through delivery to production of high impact digital transformation and platform modernization initiatives utilizing data engineering and AI/ML technologies, while optimizing Agile practices and methodologies to enhance speed, flexibility, and delivery efficiency
  • Implement robust data ingestion, processing, and distribution pipelines to ensure timely and accurate data availability across the organization.
  • Drive the adoption of best practices in data governance, quality, and lifecycle management, ensuring data integrity and compliance with regulatory standards.
  • Establishing and executing a talent management strategy inclusive of hiring new talent and associated hiring practices, as well as upskilling existing talent to achieve the overall vision for data as a service.
  • Act as a technical authority in software design, systems integration, and data services, guiding technical solutions and ensuring adherence to the highest security and privacy standards.
  • Leading and mentoring a team, fostering a culture of collaboration, innovation, and excellence.
  • Actively collaborating with the leadership team to propose technology investments for continued innovation and value creation in alignment with the overall vision and strategy.
  • Remain current on emerging technologies and industry trends, proactively identifying opportunities for new product development.


About the Team

We are a cutting-edge Software Engineering team, part of the larger Technology organization focused on evolving our customer and user experience through innovation and transformation initiatives that leverages AI/ML to create new capabilities and products. Our mission includes building digital products and services that alters the traditional approach to Intellectual Property processes and practices within the industry.


Hours of Work

  • Full time, permanent
  • Hybrid working schedule of 2-3 days/week on site
  • Must live within a commutable distance to our Alexandria, VA or Philadelphia, PA office locations
  • Flexible working hours to align with globally distributed teams and stakeholders.

Clarivate is an Equal Opportunity Employer Vets/Minorities/Women/Disabled

  • Lead Data Engineer

    1 week ago

    Philadelphia, United States RIT Solutions, Inc. Full time

    Job description Tech Lead- Leadership capabilities and highly technical expertise On Redshift and moving to serverless Big data experience - volume of data is something they need to consistently solution for so it does not impact performance - ability to solution, coach, and mentor team to handle large data sets - work with testing and product Data lake -...

  • Machine Learning Engineer

    4 weeks ago

    Philadelphia, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data...

  • Lead Big Data Engineer

    1 week ago

    Philadelphia, United States Clarivate Analytics US LLC Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You -...

  • Lead Big Data Engineer

    1 week ago

    Philadelphia, United States Clarivate Analytics Full time

    We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you! About You –...

  • Machine Learning Engineer

    4 weeks ago

    Philadelphia, Pennsylvania, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data analysis...

  • Lead Security Engineer

    1 week ago

    Philadelphia, United States JPMorgan Chase Full time

    Job Description Cybersecurity is one of the highest growth areas within JPMorgan and has a unique opportunity to develop and deploy Machine Learning solutions that support Cyber Operations. A successful candidate must be comfortable working independently, have an understanding of data analysis, statistics, data engineering and the ability to develop...

  • Sr Data Engineer

    4 days ago

    Philadelphia, United States HealthVerity Full time

    Position: Data Engineer Reporting to: Director, Data Engineering Location: Philadelphia, PA How you will help As a data engineer on the data platform team, you will be supporting and enhancing the platform that supports HealthVerity's Petabyte-scale core data asset. You will work closely with other engineers, data scientists, and business leaders to...

  • Lead Software Engineer

    1 week ago

    Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer - Python / AWS / ETL / Big Data at JPMorgan Chase within the Consumer and Community Bank, Connected Commerce Technology, you are an integral part of an agile team that works to enhance, build,...

  • Lead Machine Learning Engineer

    2 weeks ago

    Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Technical Leadership: Lead machine learning projects from conception to completion, providing technical guidance, direction, and mentorship to a team of machine learning engineers. Set technical direction, define project objectives, and ensure alignment with organizational goals and...

  • Data Engineer

    1 week ago

    Philadelphia, United States NBME Full time

    POSITION OVERVIEW NBME® is looking for a Data Engineer to join a highly skilled and growing team of data engineers and BI developers. In this role you will be using your data engineering skills and problem-solving skills to deliver meaningful insights to Internal and external customers. The Data Engineer will be responsible for modernizing, expanding, and...

  • Data Engineer

    3 weeks ago

    Philadelphia, United States NBME Full time

    Job DescriptionJob DescriptionPOSITION OVERVIEWNBME® is looking for a Data Engineer to join a highly skilled and growing team of data engineers and BI developers. In this role you will be using your data engineering skills and problem-solving skills to deliver meaningful insights to Internal and external customers. The Data Engineer will be responsible for...

  • Senior-Level Senior Data Engineer

    2 weeks ago

    Philadelphia, United States augmentjobs Full time

    Job DescriptionJob DescriptionJob Description:Responsibilities:Data Architecture and Strategy: Define and implement the overarching data architecture and strategy for the organization. Design scalable, reliable, and efficient data pipelines, data warehouses, and data lakes to support business needs and objectives.Data Engineering Leadership: Provide...

  • AWS Data engineer

    5 days ago

    Philadelphia, United States ScaleneWorks INC Full time

    The Opportunity:· This position requires to work hybrid with 3-4 days a week in office (Philadelphia, PA).· Design, implement, and maintain scalable, high-performance data pipelines on AWS· Collaborate with cross-functional teams including data scientists, software engineers, and business analysts to understand data requirements and develop appropriate...

  • AWS Data engineer

    5 days ago

    Philadelphia, United States ScaleneWorks INC Full time

    The Opportunity:· This position requires to work hybrid with 3-4 days a week in office (Philadelphia, PA).· Design, implement, and maintain scalable, high-performance data pipelines on AWS· Collaborate with cross-functional teams including data scientists, software engineers, and business analysts to understand data requirements and develop appropriate...

  • AWS Data engineer

    5 days ago

    Philadelphia, United States ScaleneWorks INC Full time

    The Opportunity:· This position requires to work hybrid with 3-4 days a week in office (Philadelphia, PA).· Design, implement, and maintain scalable, high-performance data pipelines on AWS· Collaborate with cross-functional teams including data scientists, software engineers, and business analysts to understand data requirements and develop appropriate...

  • Senior/Lead Azure Data Engineer

    4 days ago

    Philadelphia, United States Talent Inc. Full time

    We have partnered with a prominent player in the IT services sector, offering end-to-end digital solutions to clients spanning various industries. They focus on emerging technologies like cloud computing, automation, AI, ML and much moreThey are looking to hire an Azure Data Lead to help run an enterprise Azure Data Migration for a well-known healthcare...

  • Senior/Lead Azure Data Engineer

    6 days ago

    Philadelphia, United States Talent Full time

    We have partnered with a prominent player in the IT services sector, offering end-to-end digital solutions to clients spanning various industries. They focus on emerging technologies like cloud computing, automation, AI, ML and much moreThey are looking to hire an Azure Data Lead to help run an enterprise Azure Data Migration for a well-known healthcare...

  • Data Engineer

    1 week ago

    Philadelphia, United States ClifyX Full time

    Open Position-GCP Data Engineer Rate-$65 Location-Philadelphia Skill Set • Python, Big Data, SQL, ETL • Tableau • GCP experience in Data Engg/Analytics - GCP Data Flow (Hands on experience in E2E pipeline creation is MUST) JD Experience working with Linux, DataBricks, and Azkaban or similar tools. Strong knowledge of SQL, nodejs,javascript,Python...

  • Senior Lead Software Engineer

    2 weeks ago

    Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, AI/ML Data Platforms Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading and...

  • Software Engineer III, Data Engineering Data Science

    2 weeks ago

    Philadelphia, United States JPMorgan Chase Full time

    Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III, Data Science at JPMorgan Chase within the Corporate Enterprise Technology and Global Real Estate Technology team, you will serve as a seasoned member of an agile team to design and deliver trusted...