Databricks Engineer

4 days ago

Washington, Washington, D.C., United States KamisPro Full time $120,000 - $180,000 per year

Seeking a Databricks Engineer to design, build, and operate a scalable Data & AI platform using Medallion Architecture (Bronze/Silver/Gold). The role focuses on orchestrating ELT pipelines, integrating enterprise systems (PeopleSoft, D2L, Salesforce), and delivering governed, AI-ready data for analytics, ML, and decision-making.

Key Responsibilities

  • Engineer end-to-end ELT pipelines on Databricks using Spark, Delta Lake, and Workflows; implement schema evolution and automation.
  • Ingest and integrate structured/unstructured data via APIs/JDBC with error handling and alerting.
  • Enforce data quality, validation, anomaly detection, and governance using Unity Catalog for lineage and access control.
  • Implement security (encryption, row-level access, masking) and ensure compliance (GDPR, FERPA).
  • Deliver ML-ready datasets; support MLOps with MLflow for model tracking and deployment.
  • Architect data lakes (ADLS/S3), optimize storage/performance, and build data marts.
  • Maintain documentation, runbooks, and conduct training/code reviews.
  • Provide weekly progress reports and track milestones.

Required Qualifications

  • Expert in Databricks, Delta Lake, Spark; ELT orchestration and Medallion Architecture.
  • Proficient in SQL, Python/Scala; experienced integrating enterprise systems.
  • Strong in data governance, lineage, and cloud-native monitoring.

Preferred Qualifications

  • Unity Catalog; MLflow/MLOps; Azure/AWS (storage/security); data warehouse modeling.

  • Databricks Architect

    4 days ago

    Washington, Washington, D.C., United States SAIC Full time $200,000 - $240,000 per year

    Job ID LocationREMOTE WORK, DC, USDate Posted CategoryEngineering and SciencesSubcategorySolutions ArchtScheduleFull-timeShiftDay JobTravelNoMinimum Clearance Required NoneClearance Level Must Be Able to ObtainPublic TrustPotential for Remote WorkYesDescriptionWe are seeking an experienced and versatileDatabricks Architectto lead the architectural design and...

  • cloud Data Engineer

    9 hours ago

    Washington, Washington, D.C., United States Inherent Technologies Full time $120,000 - $170,000 per year

    Cloud Data Engineer| Minneapolis, MN(Remote)Job DetailsCloud Data Engineer with over 5 years of experience in managing structured and unstructured data, performing deep data analysis, and building scalable data pipelines. The ideal candidate will have hands-on expertise in Azure Data Factory (ADF), Snowflake, Databricks, and Python/PySpark, with a strong...

  • Senior Data Engineer

    2 days ago

    Washington, Washington, D.C., United States TOMORROW HIRE Full time $140,000 - $160,000

    Location: Washington, DC (Hybrid, once a week)Clearance Required: Active SecretPosition Type: Full-TimeSalary: $140,000-$160,000We are seeking a highly skilled Senior Data Engineer to support the U.S. Coast Guard Office of Data & Analytics (ODA). The ideal candidate will bring expertise in Python, SQL, ETL pipelines, and cloud-based data frameworks to enable...

  • Senior Data Engineer

    2 days ago

    Washington, Washington, D.C., United States Sound Physicians Full time $120,000 - $180,000 per year

    POSITION SUMMARYThe Senior Data Engineer is a key contributor to Sound Physician's data practice, responsible for designing, developing, and maintaining reliable, scalable data pipelines across our Azure-based platform. This role focuses on integrating and transforming data from multiple systems — including clinical, operational, and revenue cycle sources...

  • Forward Deployed Engineer, Gov

    2 days ago

    Washington, Washington, D.C., United States Sayari Full time $165,000 - $180,000 per year

    About Sayari:Sayari is a risk intelligence provider that provides the public and private sectors with immediate visibility into complex commercial relationships by delivering the largest commercially available collection of corporate and trade data from over 250 jurisdictions worldwide. Sayari's solutions enable risk resilience, mission-critical...

  • Data Engineer

    4 days ago

    Washington, Washington, D.C., United States Booz Allen Hamilton Full time $62,000 - $141,000

    Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you...

  • Sales Engineer

    2 days ago

    Washington, Washington, D.C., United States RiskSpan Full time $120,000 - $180,000 per year

    About UsThe RiskSpan Edge Platform is a suite of SaaS products that integrate data, predictive modeling, scenario analytics and BI for data visualization. The platform supports a range of products including residential mortgage loans and MSRs, MBS, public and private asset backed finance (or "ABF"), and derivatives. Our scalable, cloud-native platform...

  • Senior Backend Engineer

    7 hours ago

    Washington, Washington, D.C., United States Scribd Full time $146,500 - $228,000 per year

    About The Company:At Scribd (pronounced "scribbed"), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our four products: Everand, Scribd, Slideshare, and Fable.We support a culture where our employees can be real...

  • Principal Software Engineer

    4 days ago

    Washington, Washington, D.C., United States Sayari Full time $200,000 - $250,000 per year

    About Sayari:Sayari is a risk intelligence provider that provides the public and private sectors with immediate visibility into complex commercial relationships by delivering the largest commercially available collection of corporate and trade data from over 250 jurisdictions worldwide. Sayari's solutions enable risk resilience, mission-critical...

  • Senior Manager Software Engineering, Washington DC

    2 days ago

    Washington, Washington, D.C., United States Optum Full time $233,230 per year

    EMPLOYER: Optum Services Inc.JOB TITLE: Senior Manager Software EngineeringLOCATION: 655 New York Avenue NW, Washington, DC, 20001DUTIES: Design, develop, test, deploy, maintain, and continuously improve software. Review and provide team with defined Software strategy, standards, procedures, tools, and processes. Work with the business partners to ensure...