Lead Data Engineer

3 weeks ago

Alexandria VA United States Clarivate Full time
Our technology powers the world’s top companies to bring innovation to life and manage their IP portfolio. As a leader in our industry, we are embarking on a transformative journey to leverage big data, data lakes, and lakehouse technologies to streamline our data services and support our product lines with scalable, efficient, and high-quality data solutions. We are looking for a Lead Data Engineer for our IP Maintenance products and services to spearhead the design and implementation of a simplified data service over a highly distributed data system.

This position will report to the Director of IP Technology and with a focus on digital transformation strategy, this role would work closely with product leaders, business operations, engineering teams, and other stakeholders to align on strategic goals and ensure delivery of innovative digital products and highly automated experiences using AI/ML technologies. This role is critical in harnessing the power of Big Data, Lakehouse, Data Virtualization, Transformation and Integration technologies to enhance our product offerings and drive business growth. The ideal candidate must be hands-on and will have a strong background in data engineering, with proven experience in developing and deploying large-scale data solutions in a cloud environment, must be metrics-focused and obsessed with Cloud native and DevOps technologies.

In this role, you will have the opportunity to make a lasting impact on the digital transformation journey, drive customer-centric innovation, and the ideal candidate will have a background of running transformation projects in similar disruptive industries such as Digital Payments or Fintech.

About You – Experience, Education, Skills, and Accomplishments

Bachelor’s in Computer Science or an equivalent experience in software development, with a minimum of 7 years experience in developing and delivering business transformation projects or products using data engineering and AI/ML technologies.
Minimum of 5 years in leading engineering teams, with demonstrated experience in building high-performing, best in class engineering teams for a high-growth software product environment.
Minimum of 5 years’ experience in data lake / lakehouse, distributed systems and data, data virtualization, microservices, and machine learning.
Minimum of 5 years’ experience working with data structures, data streaming and pipelines, search, training and inference algorithms, event driven patterns and middleware technologies.
Minimum of 5 years of hands-on skills in Python, Apache Spark, Hive, Cassandra, Snowflake, Elastic, Lucene, DataBricks, Hadoop, Redshift, Scala, Java, or other relevant technologies in data engineering.
Minimum of 5 years’ experience building containerized applications and deploying them to public or private clouds, such as Amazon Web Services (AWS), Microsoft Azure, or similar providers, end-to-end SaaS applications, and highly scalable software products.
Minimum of 5 years’ experience with automated delivery pipelines, agile delivery, and test-driven development and real-time data processing (e.g., Kafka, Spark Streaming).

It would be great if you also had...

Masters degree in Computer Science
Experience in functional decomposition of legacy products and migrating to modern microservices architecture.
Experience delivering products against plan in a fast-paced, multi-disciplined, distributed-responsibility and often ambiguous environment
Experience in automated delivery pipelines, agile delivery, and test-driven development.
Analytical and quantitative skills; experience using hard data and metrics to back up assumptions and develop business cases

What will you be doing in this role?

Lead the design and development of a scalable and simplified data service using big data, data lakes, data virtualization, and /or data lakehouse technologies.
Partnering closely with the Product, Technology and Business Operations teams to evolve and accelerate the execution of the product roadmap to maximize the current suite of digital solutions and innovate next generation solutions that will drive transformations.
Leading and managing a set of engineering-driven initiatives from ideation through delivery to production of high impact digital transformation and platform modernization initiatives utilizing data engineering and AI/ML technologies, while optimizing Agile practices and methodologies to enhance speed, flexibility, and delivery efficiency
Implement robust data ingestion, processing, and distribution pipelines to ensure timely and accurate data availability across the organization.
Drive the adoption of best practices in data governance, quality, and lifecycle management, ensuring data integrity and compliance with regulatory standards.
Establishing and executing a talent management strategy inclusive of hiring new talent and associated hiring practices, as well as upskilling existing talent to achieve the overall vision for data as a service.
Act as a technical authority in software design, systems integration, and data services, guiding technical solutions and ensuring adherence to the highest security and privacy standards.
Leading and mentoring a team, fostering a culture of collaboration, innovation, and excellence.
Actively collaborating with the leadership team to propose technology investments for continued innovation and value creation in alignment with the overall vision and strategy.
Remain current on emerging technologies and industry trends, proactively identifying opportunities for new product development.

About the Team

We are a cutting-edge Software Engineering team, part of the larger Technology organization focused on evolving our customer and user experience through innovation and transformation initiatives that leverages AI/ML to create new capabilities and products. Our mission includes building digital products and services that alters the traditional approach to Intellectual Property processes and practices within the industry.

Hours of Work

Full time, permanent
Hybrid working schedule of 2-3 days/week on site
Must live within a commutable distance to our Alexandria, VA or Philadelphia, PA office locations
Flexible working hours to align with globally distributed teams and stakeholders.

Clarivate is an Equal Opportunity Employer Vets/Minorities/Women/Disabled

  • Lead Data and Integration Engineer

    1 week ago

    United States Magellan Health Full time

    Interested in a fully remote opportunity as a Lead Data and Integration Engineer while working an innovative healthcare company where you can have an impact on people's lives? Apply today and come join us at Magellan Health as we empower people to lead healthier, more vibrant lives.we're looking for people with the following skill set for this role:In-depth...

  • Data Engineer

    1 day ago

    Alexandria, United States LIGHTFEATHER IO LLC Full time

    Job DescriptionJob DescriptionLightFeather is currently seeking a skilled Data Engineer to play a crucial role in our data modeling and analytics initiatives. This position offers the opportunity to work closely with our Data Engineering Lead in enhancing our data infrastructure, maintaining high standards of data quality, and deploying cutting-edge models...

  • Lead Data

    1 week ago

    United States Magellan Health Full time

    This is a fully remote position for a Lead Tableau Developer/Admin, allowing you to work from anywhere in the US.Required skills:- Tableau- Tableau Bridge- SalesforceOptional skills:- SQL 2018- SSMS ver 18.2- SnapLogicPreparing data for use by Tableau.Establishing connections to Data Sources.Adding or Creating Dimensions, Measures and Calculations.Performing...

  • Lead Systems Engineer

    11 hours ago

    Alexandria, United States Warriors Recruiting Full time

    Lead Systems Engineer Location: Alexandria, VA Clearance: DoD Secret Our client delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly...

  • Data Engineer with Security Clearance

    1 month ago

    Alexandria, United States Gray Tier LLC Full time

    Gray Tier Technologies is looking for talented Data Engineers to support the Advana contract. Advana is a multi-domain technology platform which offers military and business decision makers, analysts, and users at all levels unprecedented access to authoritative enterprise data and structured analytics in a scalable, reliable, and secure environment. It...

  • Data Engineer

    3 weeks ago

    Alexandria, United States @Orchard Full time

    Job DescriptionJob DescriptionData EngineerRequired: Active Top-Secret Clearance with SCIAlexandria, VA@Orchard is working with a fast-growing Service-Disabled Veteran-owned Small Business (SDVOSB) focused on delivering solutions to the US Government in Data Analytics, Change Management, and Audit Readiness. Our client needs a Data Engineer with an active...

  • Data Engineer

    2 weeks ago

    Alexandria, United States BizFirst Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerCompany: Client of BizFirstLocation: Crystal City/Alexandria, VA (Onsite requirement: 3 days per week)Employment Type: Full-time W-2 EmployeeContract Length: 5 yearsSecurity Clearance: Secret clearance required; TS/SCI clearance preferredIntroductionBizFirst is assisting our client in recruiting a Data...

  • Regional Safety Engineer, Data Center Health Safety DCC Communities

    7 days ago

    Ashburn, VA, United States Amazon Data Services, Inc. Full time

    Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Join the world class safety culture at...

  • Data Scientist Lead

    1 day ago

    Alexandria, United States LIGHTFEATHER IO LLC Full time

    Job DescriptionJob DescriptionLightFeather is currently seeking a talented Data Scientist Lead to join our dynamic team. The successful candidate is someone who is passionate about harnessing the power of data to make informed decisions and lead our data science initiatives to new heights, as we are at the forefront of leveraging data science to drive...

  • Data Engineer

    3 weeks ago

    Alexandria, United States Burke & Herbert Bank & Trust Full time

    Job DescriptionJob DescriptionSummary/ObjectiveThe Data Engineer is responsible for developing, maintaining, and providing support for the Bank’s data warehousing assets with a primary goal of making all Bank data easily accessible and usable.Essential FunctionsReasonable accommodations may be made to enable individuals with disabilities to perform the...

  • Lead Data Scientist

    7 days ago

    Herndon, VA, United States Collabera Full time

    Client – Health Insurance Job Title – Data Scientist Location – Herndon, VA – 20191 Duration – 12 Months (Possible Conversion / Extension) About the Role: The role of a Machine Learning and Artificial Intelligence Lead involves leading the proliferation of machine learning and artificial intelligence solutions throughout the enterprise. The...

  • Lead Digital Engineer

    3 weeks ago

    Alexandria, United States Systems Planning and Analysis, Inc Full time

    Overview: Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and...

  • Data Science Manager, Lead

    1 day ago

    Alexandria, Virginia, United States Booz Allen Hamilton Full time

    Job Number: R0180042Data Science Manager, LeadThe Opportunity: As a data scientist, you're excited at the prospect of unlocking the secrets held by a data set, and you're fascinated by the possibilities presented by IoT, machine learning, and artificial intelligence. In an increasingly connected world, massive amounts of structured and unstructured data open...

  • Regional Safety Engineer, Data Center Health Safety DCC Communities

    7 days ago

    Ashburn, VA, United States Amazon Data Services, Inc. Full time

    Job Description About AWS Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Join the world...

  • Sr. Controls Engineer, AMER Controls

    1 month ago

    Chantilly, VA, United States Amazon Data Services, Inc. Full time

    At Amazon, we are working to be the most customer-centric company on earth. To get there, we need exceptionally talented, bright, and driven people. As part of the AWS Controls Team, you will work with highly motivated experts and innovators in the data center industry. You will be responsible for innovating, deploying, optimizing, and maintaining the...

  • Lead Data Software Engineer

    4 hours ago

    Norristown, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Cluster Project Design Mechanical Engineer, Fleet Remediation Engineering

    7 days ago

    Hamilton, VA, United States Amazon Data Services, Inc. Full time

    As an Amazon Fleet Remediation Project Design Mechanical Engineer, you will lead design projects in operational data centers, that remediate issues, upgrade our existing infrastructure or add new services. You will be the 'go to' engineering resource for these projects and will provide lifecycle support from design through implementation. You will use your...

  • Lead Data Scientist

    7 days ago

    Herndon, VA, United States Collabera Full time

    Client - Health Insurance Job Title - Data Scientist Location - Herndon, VA - 20191 Duration - 12 Months (Possible Conversion / Extension) About the Role: The role of a Machine Learning and Artificial Intelligence Lead involves leading the proliferation of machine learning and artificial intelligence solutions throughout the enterprise. The...

  • Lead Digital Engineer with Security Clearance

    1 month ago

    Alexandria, United States SPA Full time

    Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and...

  • Cluster Project Design Mechanical Engineer, Fleet Remediation Engineering

    7 days ago

    Hamilton, VA, United States Amazon Data Services, Inc. Full time

    Job Description As an Amazon Fleet Remediation Project Design Mechanical Engineer, you will lead design projects in operational data centers, that remediate issues, upgrade our existing infrastructure or add new services. You will be the 'go to' engineering resource for these projects and will provide lifecycle support from design through...