Lead Data Consultant

2 days ago

Columbus, OH, United States Trility Consulting Full-time

Who We Are

At Trility Consulting®, we’ve built a strong, remote-work culture where people thrive, grow, and support each other – earning us Great Place to Work® Certification. Headquartered in Central Iowa, we embrace flexible schedules and collaboration across geographically distributed teams serving clients from all corners of the United States and globally.

We seek team members with the grit necessary to forge paths where none previously existed, to get back up when circumstances knock them down, to adapt to the changing needs of the client even when it is uncomfortable, and to deliver on our commitments. Candidates must respect and value people, recognize that over-communication is barely good enough, thrive on solving complex problems, have a passion for building teams, and know that delivering what a client actually values is more important than their own predispositions. They understand value proposition, love delivering value, and take pride in learning the expansive and ever-changing business of clients. Candidates are self-motivated and relentlessly working to become more today than they were yesterday.

What You Will Do & The Experience You Will Need

Trility Consulting is seeking an experienced Senior Data Consultant to support a client engagement focused on modernizing an existing Azure Synapse data platform and migrating prioritized workloads to Microsoft Fabric.

In this role, you'll partner with Trility consultants and client engineers to pressure-test and refine the Fabric architecture, build reusable, metadata-driven ingestion frameworks, and migrate data workloads into a modern lakehouse environment. You'll develop scalable data pipelines, implement validation processes to ensure migration accuracy, and establish automated CI/CD workflows that support reliable deployment from development through production.

This engagement follows Trility's collaborative Coach-and-Contribute delivery model. You'll work hands-on alongside client engineers, contribute to architectural decisions, and help establish repeatable patterns that enable the team to maintain and extend the platform independently. Experience using Claude Code as part of an AI-assisted development workflow is essential to this engagement.

This is a remote W2 position.

At this time, Trility is only able to hire W2 employees who reside in the following states: Alabama, Colorado, Delaware, Florida, Georgia, Iowa, Kansas, Kentucky, Louisiana, Minnesota, Missouri, Montana, Nebraska, Nevada, North Carolina, Ohio, South Carolina, Tennessee, Texas, Virginia, and Wisconsin.

\n Your Responsibilities
  • Evaluate and refine the existing Microsoft Fabric architecture, including metadata structures, table-level event triggering, and reusable ingestion patterns
  • Design and implement a metadata-driven ingestion framework that allows new tables and sources to be onboarded through configuration rather than custom development
  • Migrate prioritized data sources and workloads from Azure Synapse into Microsoft Fabric
  • Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL
  • Analyze existing Azure Synapse pipelines, including complex and nested workflows, to understand dependencies and translate existing processing logic into Fabric solutions
  • Build data validation and reconciliation processes to verify migration accuracy, including duplicate detection, key alignment, and record-level comparisons between Synapse and Fabric
  • Analyze source-specific loading requirements and recommend appropriate full-load, incremental, or change data capture (CDC) patterns
  • Implement Git-based CI/CD and automated environment promotion for Fabric artifacts, including pipelines and notebooks, using GitHub Actions, Azure DevOps, or similar tooling
  • Leverage Claude Code to define implementation specifications, accelerate development, and review AI-generated code for quality, correctness, and maintainability
  • Evaluate data dictionary, metadata, and lineage requirements, including potential catalog solutions such as Microsoft Purview
  • Collaborate with client engineers through paired development, code reviews, and knowledge-sharing sessions to establish sustainable engineering standards
  • Apply data engineering best practices related to performance, testing, monitoring, documentation, security, and operational support
What You Bring
  • 5+ years of experience wo