Azure Data Engineer

4 days ago

Washington, Washington, D.C., United States Intellect Solutions LLC Full time $100,000 - $150,000 per year

Please apply only if you hold an Active Secret (or higher) clearance

Requirements Gathering

  • Collaborate with business analysts, data architects, and stakeholders to gather requirements and ensure data integrity throughout the migration lifecycle.
  • Ability to create Data mapping documents (Source to Target) by understanding business rules.

Data Understanding/Profiling

  • Perform data profiling, cleansing, and quality checks to ensure accuracy and completeness of migrated data.
  • Analyze and map source Oracle database schemas to target Dataverse tables/entities, defining transformation and cleansing logic as required.

Technical Requirements for Development

  • Write and optimize SQL queries, stored procedures, and scripts for Oracle databases to support data migration and validation.
  • Implement data transformation processes to ensure data compatibility with Dataverse data types, relationships, and constraints.
  • Experience with
    Dataverse
    data types and CRUD operations
  • Experience configuring data pipelines in ADF (to extract, transform, load).
  • Experience using .csv files as sources of data for the ADF pipelines
  • Experience using
    Oracle CDCs
    as sources of data for the ADF pipelines.
  • Experience logging errors (audit framework) from an ADF pipeline to a Dataverse table
  • Experience pushing data to Dataverse table(s) including necessary transformations to match target field types (i.e. Dataverse lookups, choices, date/time, etc.)
  • Experience configuring setting for pipelines to improve concurrency/performance (i.e., ADF cores, memory, etc.)
  • Experience with additional Azure services (e.g., Logic Apps, Data Lake, Azure Functions, Azure SQL).
  • Experience/exposure in python/shell scripting is a plus

Data Validation Post migration

  • Ability to generate a reconcile report of the migrated data using SQL or scripts

Code Migration

  • Must be familiar with Git or source code repository & CI/CD process.

  • Azure Cloud Engineer

    6 days ago

    Washington, Washington, D.C., United States Qode Full time $120,000 - $160,000 per year

    Client: Wealth ManagementPosition: Azure Cloud Engineer (FinOps)Compensation: $120K - $140KLocations: - On Site - Plano, TX or Camas, WA or Tampa, FL - NO OTHER LOCATIONS OR RELOCATIONS WILL BE CONSIDEREDWork Authorization: USC or GC ONLYEducation: Bachelor's degree in MIS, computer science, or a related fieldExperience:5+ years of experience deploying and...

  • Azure Infrastructure Engineer

    4 days ago

    Washington, Washington, D.C., United States Koniag Government Services, LLC Full time $120,000 - $180,000 per year

    Kadiak, LLC, a Koniag Government Services company, is seeking an Azure Infrastructure Engineer with a TS/SCI security clearance to support Kadiak and our government customer in Washington, DC.  We offer competitive compensation and an extraordinary benefits package including health, dental and vision insurance, 401K with company matching, flexible spending...

  • Data Automation Engineer

    4 days ago

    Washington, Washington, D.C., United States ALTA IT Services, LLC Full time $80,000 - $120,000 per year

    Data Automation EngineerREMOTE- Quarterly travel to Washington, DCType: ContractPay Rate:$ $53.00 hourlySecurity Clearance: Per government contract, must be US citizen and able to obtain a Public Trust clearance. We are seeking a customer experience focused Data Automation Engineer to work with a team of subject matter experts and developers to design and...

  • Data Engineer

    6 days ago

    Washington, Washington, D.C., United States DPR Construction Full time $103,236 - $176,976 per year

    Job DescriptionWe are a leading construction company committed to delivering high-quality, innovative projects. Our team integrates cutting-edge technologies into the construction process to streamline operations, enhance decision-making, and drive efficiency across all levels. We are looking for a talented Data Engineer to join our team and contribute to...

  • cloud Data Engineer

    2 days ago

    Washington, Washington, D.C., United States Inherent Technologies Full time $120,000 - $170,000 per year

    Cloud Data Engineer| Minneapolis, MN(Remote)Job DetailsCloud Data Engineer with over 5 years of experience in managing structured and unstructured data, performing deep data analysis, and building scalable data pipelines. The ideal candidate will have hands-on expertise in Azure Data Factory (ADF), Snowflake, Databricks, and Python/PySpark, with a strong...

  • Senior Data Engineer

    4 days ago

    Washington, Washington, D.C., United States Sound Physicians Full time $120,000 - $180,000 per year

    POSITION SUMMARYThe Senior Data Engineer is a key contributor to Sound Physician's data practice, responsible for designing, developing, and maintaining reliable, scalable data pipelines across our Azure-based platform. This role focuses on integrating and transforming data from multiple systems — including clinical, operational, and revenue cycle sources...

  • Azure DevOps, Kubernetes

    4 days ago

    Washington, Washington, D.C., United States Raas Infotek Full time $100,000 - $120,000 per year

    Hi,I hope you are doing well.We have an urgent below position .If you are interested, please share your updated resume with the rate expectationRole: Kubernetes Technical Lead with Azure DevOpsLocation: Washington, DCContract/ W2Role: Azure devops - Need to have experice in Azure cloud,Python, Kubernetes ad Databricks,ADF, datalake, kafka, python,pyspark...

  • Data Engineer

    6 days ago

    Washington, Washington, D.C., United States Booz Allen Hamilton Full time $62,000 - $141,000

    Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you...

  • Azure Protection Analyst

    7 hours ago

    Washington, Washington, D.C., United States SAIC Full time

    Job ID: Location: WASHINGTON, DC, USDate Posted: Category: Information TechnologySubcategory: Cloud Comp EngrSchedule: Full-timeShift: Day JobTravel: NoMinimum Clearance Required: NoneClearance Level Must Be Able to Obtain: Public TrustPotential for Remote Work: YesDescriptionWe are seeking an experienced Azure Protection Analyst Analyst to design,...

  • Data Engineer

    4 days ago

    Washington, Washington, D.C., United States SoTalent Full time $150,000 - $200,000 per year

    Job Title : Data EngineerLocation : District of ColumbiaJob Type : Full TimeOur client is seeking a Data Engineer to join their innovative technology team. This role offers the opportunity to work on cutting-edge, cloud-based solutions that empower millions of users to make informed financial decisions. The ideal candidate is passionate about scalable...