Lead Data Engineer

2 days ago

Cary, NC, United States RyanBPM Full-time

 

Role

Lead Data Engineer (Hands-On)

Location

Cary, NC (On-site / Hybrid)

Experience

14–18 Years

Employment

Full-Time 

Visa

Visa Independent candidates – No H1 transfer

 

ABOUT THE ENGAGEMENT

Altimetrik is building a centralized, AI-first enterprise Data Hub for a global insurance and financial services client on Azure Databricks. The platform ingests 150+ inbound data feeds, distributes to 35+ downstream systems, and is organized as a medallion architecture (Bronze / Silver / Gold). AI is embedded in ingestion, canonical mapping, data quality, reconciliation, and business user access from day one — not bolted on at the edges.

This is a senior hands-on leadership role. You will own the end-to-end technical design of the data and AI layers, build the reference implementations your engineers work from, and ship production-grade Python, Scala, and PySpark code every week. If you have not written or reviewed production code in the past year, this is not the right fit.

 

WHAT YOU WILL OWN

Data Platform Architecture & Engineering

Own the end-to-end lakehouse architecture: Bronze / Silver / Gold layer contracts, zone layout on ADLS Gen2, Delta Lake table design, partitioning, schema evolution, and retention strategy.

Design and build metadata-driven, parameterized ingestion frameworks that onboard new data sources without bespoke pipeline code for every feed.