Senior Data Engineer

1 week ago

Washington, DC, United States AHU Technologies, Inc. Full time
Short Description:

Client is look for a resource to provide high-level data engineering administration expertise to support Dynamics 365/Azure data services, including Dataverse management, Azure Data Factory management, Synapse Analytics/SQL management, Power BI workspace.

Complete Description:

Client is seeking a Senior Data Engineering for managing and optimizing data services across Azure/Dynamics 365 and legacy Oracle Database environments. This role oversees Microsoft Dataverse, Azure Data Factory, Synapse Analytics, Power BI workspaces, and Oracle databases to ensure secure, compliant, and high-performance data operations. This position requires deep expertise in advanced SQL, database management, and database replication, including Health and human services data model experience. The candidate is responsible for design, build, and maintenance of scalable data pipelines, enforces privacy standards, and supports analytics teams with reliable, integrated data sets. The position involves cross-functional collaboration, architectural knowledge, and supporting program staff through data requests.

Responsibilities:

  • Provide Dataverse data management support to include schema integrity, TDS Endpoint configuration, Data extraction, query development, and data backup/restore operations
  • Design, monitor, and troubleshoot scalable data pipelines in Azure Data Factory, with focus on secure ingestion, transformation, and orchestration, including monitoring and troubleshooting pipeline health and performance
  • Manage Synapse workspaces (including Dataverse Link) and dedicated SQL pools/Managed SQL /Serverless SQLs, implementing advanced query optimization to support high-volume analytics and reporting workloads
  • Setup and maintain Power BI workspaces, datasets, and gateways, enforcing data security permissions including row-level security
  • Develop Power BI Dashboards leveraging database datasets, including log files, to determine system usage
  • Develop and refine complex SQL queries to support operational and performance reporting, including audit system log analysis
  • Build and maintain reusable Python scripts for parsing datasets, data cleansing, enrichment, and automation, involving structured and un-structured data
  • Develop and maintain data security for datasets across Azure data services platform
  • Provide data model and schema/table relationship diagram to support integrations and data exchange
  • Develop and maintain data replication tools to sync Dynamics data to Synapse Analytics, including managed SQL/Dedicated SQL pool, Serverless pool destination, and API-enabled data endpoints
  • Manage Legacy Oracle database, including data integrity, backup, and availability management
  • Collaborate with business stakeholders to understand data requirements, mapping, and transformation needs, ensuring alignment with the client information system's objectives.
  • Lead and coordinate Data Analysts and Reports Engineering Team activities, working closely with the system to ensure timely and accurate execution of data-dependent tasks, including Daily, Monthly, Weekly, Fiscal Year and Compliance reporting
  • Perform data profiling and analysis to identify data quality issues, data gaps, and potential risks for mitigation
  • Define and enforce data migration standards, best practices, and governance policies to maintain data integrity and consistency.
  • Create and maintain technical artifacts for data services implementation, including replication plans, data, data architecture, rules, and error reports.
  • Conduct training sessions and provide guidance to business staff and Functional Quality Assurance staff on data services and provide data extraction support
  • Stay current with industry trends and advancements in data management methodologies and tools, recommending improvements to enhance the overall data governance.

Skills:

• Bachelor's degree in computer science, IT or related field or equivalent experience.

• Oracle Database management and administration experiences.

• Advanced SQL Query Development.

• Database security administration, including row-level security.

• Database Replication expertise, including replication schedule, rules for automatic detection of schema and table changes and validation rep results.

• Health and Human Services Data model experience.

• Project management skills with the ability to prioritize tasks and meet deadlines, including documentation of technical artifacts.

• Produce Data Model and Schema/Table link Diagram.

• Azure Data services management including Data factory, Synapse Analytics.

• Power BI Workspace Administration and Dashboard Development.

• Microsoft Azure Data Fundamentals certification.

• Microsoft Certified Azure Administrator certification.

• Python scripting knowledge.

Flexible work from home options available.

Compensation: $60.00 - $67.00 per hour

About Us

AHU Technologies INCis an IT consulting and permanent staffing firm that meets and exceeds the evolving IT service needs of leading corporations within the United States. We have been providing IT solutions to customers from different industry sectors, helping them control costs and release internal resources to focus on strategic issues.

AHU Technologies INC was co-founded by visionary young techno-commercial entrepreneurs who remain as our principal consultants. Maintaining working relationships with a cadre of other highly skilled independent consultants, we have a growing number of resources available for development projects. We are currently working on Various projects such as media entertainment, ERP Solutions, data warehousing, Web Applications, Telecommunications and medical to our clients all over the world.

  • Senior Data Engineer

    2 weeks ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    5 days ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    3 days ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    1 day ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States Circa - IPG DXTRA Full time

    About the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States Children's National Hospital Full time

    The Senior Data Engineer is responsible for designing, developing, and operationalizing advanced cloud data pipelines to facilitate seamless data consumption for reports, advanced analytics, and AI initiatives. This role involves overseeing the entire data lifecycle, including data ingestion, transformation, validation, and quality assurance. The Senior Data...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States Children's National Hospital Full time

    The Senior Data Engineer is responsible for designing, developing, and operationalizing advanced cloud data pipelines to facilitate seamless data consumption for reports, advanced analytics, and AI initiatives. This role involves overseeing the entire data lifecycle, including data ingestion, transformation, validation, and quality assurance. The Senior Data...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States InstantServe LLC Full time

    Job Description: Responsibilities: The Data Engineer is responsible for carrying out engineering tasks to deliver an advanced visual analytic application. The Data Engineer shall develop data analytics for desktop and web-developed visual analytic software; facilitating the bulk analysis of relational information utilizing advanced graphics, visualization,...

  • Senior Data Engineer

    1 week ago

    Washington, DC, United States InstantServe LLC Full time

    Job Description: Responsibilities: The Data Engineer is responsible for carrying out engineering tasks to deliver an advanced visual analytic application. The Data Engineer shall develop data analytics for desktop and web-developed visual analytic software; facilitating the bulk analysis of relational information utilizing advanced graphics, visualization,...