Principal Data Engineer

3 days ago


United States Worth AI Full time

Worth AI, a leader in the computer software industry, is looking for a talented and experienced Principal Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to make a meaningful impact in the tech landscape.. Our team values include extreme ownership, one team and creating reaving fans both for our employees and customers.

Worth is looking for a Principal Data Engineer to own the company-wide data architecture and platform. Design and scale reliable batch/streaming pipelines, institute data quality and governance, and enable analytics/ML with secure, cost-efficient systems. Partner with engineering, product, analytics, and security to turn business needs into durable data products.

Responsibilities

What you will do:

  • Architecture & Strategy
    • Define end-to-end data architecture (lake/lakehouse/warehouse, batch/streaming, CDC, metadata).
    • Set standards for schemas, contracts, orchestration, storage layers, and semantic/metrics models.
    • Publish roadmaps, ADRs/RFCs, and “north star” target states; guide build vs. buy decisions.
  • Platform & Pipelines
    • Design and build scalable, observable ELT/ETL and event pipelines.
    • Establish ingestion patterns (CDC, file, API, message bus) and schema-evolution policies.
    • Provide self-service tooling for analysts/scientists (dbt, notebooks, catalogs, feature stores).
    • Ensure workflow reliability (idempotency, retries, backfills, SLAs).
  • Data Quality & Governance
    • Define dataset SLAs/SLOs, freshness, lineage, and data certification tiers.
    • Enforce contracts and validation tests; deploy anomaly detection and incident runbooks.
    • Partner with governance on cataloging, PII handling, retention, and access policies.
  • Reliability, Performance & Cost
    • Lead capacity planning, partitioning/clustering, and query optimization.
    • Introduce SRE-style practices for data (error budgets, postmortems).
    • Drive FinOps for storage/compute; monitor and reduce cost per TB/query/job.
  • Security & Compliance
    • Implement encryption, tokenization, and row/column-level security; manage secrets and audits.
    • Align with SOC 2 and privacy regulations (e.g., GDPR/CCPA; HIPAA if applicable).
  • ML & Analytics Enablement
    • Deliver versioned, documented datasets/features for BI and ML.
    • Operationalize training/serving data flows, drift signals, and feature-store governance.
    • Build and maintain the semantic layer and metrics consistency for experimentation/BI.
  • Leadership & Collaboration
    • Provide technical leadership across squads; mentor senior/staff engineers.
    • Run design reviews and drive consensus on complex trade-offs.
    • Translate business goals into data products with product/analytics leaders.

Requirements

    • 10+ years in data engineering (including 3+ years as staff/principal or equivalent scope).
    • Proven leadership of company-wide data architecture and platform initiatives.
    • Deep experience with at least one cloud (AWS) and a modern warehouse or lakehouse (e.g., Snowflake, Redshift, Databricks).
    • Strong SQL and one programming language (Python or Scala/Java).
    • Orchestration (Airflow/Dagster/Prefect), transformations (dbt or equivalent), and streaming (Kafka/Kinesis/PubSub).
    • Data modeling (3NF, star, data vault) and semantic/metrics layers.
    • Data quality testing, lineage, and observability in production environments.
    • Security best practices: RBAC/ABAC, encryption, key management, auditability.

** All Remote Hires - will be required to travel to Orlando, Florida at least twice per year for Town Halls and team collaboration in addition to orientation in Orlando, Florida.

Nice to Have

    • Feature stores and ML data ops; experimentation frameworks.
    • Cost optimization at scale; multi-tenant architectures.
    • Governance tools (DataHub/Collibra/Alation), OpenLineage, and testing frameworks (Great Expectations/Deequ).
    • Compliance exposure (SOC 2, GDPR/CCPA; HIPAA/PCI where relevant).
    • Model features sourced from complex 3rd-party data (KYB/KYC, credit bureaus, fraud detection APIs)

Benefits

    • Health Care Plan (Medical, Dental & Vision)
    • Retirement Plan (401k, IRA)
    • Life Insurance
    • Unlimited Paid Time Off
    • 9 paid Holidays
    • Family Leave
    • Work From Home
    • Free Food & Snacks (Access to Industrious Co-working Membership)
    • Wellness Resources


  • united states QuEST Global Services Pte. Ltd Full time

    Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.We are looking...


  • , , United States Worth AI Full time

    Worth AI, a leader in the computer software industry, is looking for a talented and experienced Principal Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to make a meaningful impact...


  • United States Surescripts Full time $162,100 - $198,100

    Surescripts serves the nation through simpler, trusted health intelligence sharing, in order to increase patient safety, lower costs and ensure quality care. We deliver insights at critical points of care for better decisions — from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between...


  • United States Credit Acceptance Full time

    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share a drive to succeed as professionals and together as a company. A great product, amazing people and our stable financial history have made us one of the largest...


  • United States Credit Acceptance Full time

    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share a drive to succeed as professionals and together as a company. A great product, amazing people and our stable financial history have made us one of the largest...


  • remote, virginia, united states of america NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • United States Microsoft Full time

    Principal Software Engineer - Azure Data Lake StorageMultiple Locations, United StatesDate postedOct 20, 2025Job number1897247Work site0 days / week in-office - remoteTravel0-25%Role typeIndividual ContributorProfessionSoftware EngineeringDisciplineSoftware EngineeringEmployment typeFull-TimeOverviewThe Azure Data Lake Storage team is on a mission to build...


  • United States People Data Labs Full time $160,000 - $200,000 per year

    Note for all engineering roles: with the rise of fake applicants and AI-enabled candidate fraud, we have built in additional measures throughout the process to identify such candidates and remove them.About UsPeople Data Labs (PDL) is the provider of people and company data. We do the heavy lifting of data collection and standardization so our customers can...


  • United States Microsoft Full time $139,900 - $274,800 per year

    In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day and we need you as a Principal Forensic Engineer. The Forensic Engineering Team plays a critical role in ensuring the uptime, reliability, and availability of Microsoft's cloud infrastructure. We...


  • United States Microsoft Full time $139,900 - $274,800 per year

    The Azure Blob Storage team is focused on building the data foundation that supports artificial intelligence (AI) innovation. We are seeking a Principal Software Engineer to design and develop the next generation of intelligent storage systems built for demanding AI and machine learning (ML) workloads.Computing is evolving rapidly. Large-scale foundation...