Data Engineer

4 weeks ago

Washington, United States AHU Technologies Inc Full time
Job DescriptionJob DescriptionShort Description:  The Enterprise Data team at Client requires an ETL data engineer to support data operations for its Cloud Data Exchange.  The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.

Complete Description: 

The ETL data engineer will support the Client Enterprise Data team for data curation, processing, and transformation tasks.  Specifically, the ETL data engineer will be responsible for the following tasks:

Responsibilities: 1. Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects. 2. Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems. 3. Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development. 4. Establishing the cloud and on-premises connectivity in different systems like ADLS, ADF, Synapse, Databricks 5. Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc. 6. Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables. 7. Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow) 8. Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, QuickBase), text formats (CSV, XML) and Binary (Parquet, AVRO) 9. Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices. 10. Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability. 11. Automates, monitors, alerts, and manages data pipelines and workflows. 12. Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures. 13. Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes. 14. Develops complex programs and reports in database query language. 15. Familiarity/experience with data visualization tools. 16.   Familiarity/experience handling and securing sensitive data based on the level of the sensitivity
 CONTRACT JOB DESCRIPTION

Responsibilities:

1. Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.

2. Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.

3. May require coordination of programming activities being conducted by the application development team

4. Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.

5. Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.

6. Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.

7. May coordinate activities of application developers.11-

8. Able to identify best practices and standards for the use of the product.

9. Proven track record of hands-on technical design and code work within large complex systems.

10. Proven hands-on technical work with a variety of technologies.

11. Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.

12. Delivers support and design for industry specific applications that require integration with statewide systems or applications.

13. Interacts with executive level business users or technical experts.

14. Advanced experience in the required technical subject matter.

15. May function as a niche technical SME (Subject Matter Expert).

16. Has proven experience across large and complex implementations and systems.

  • Data Engineer

    4 weeks ago

    Washington, United States Atechstar Full time

    Key Responsibilities Design implement and support applications that provide structured and timely access to actionable business information addressing stakeholder needs. Interface directly with stakeholders gathering requirements and owning automated end-to-end reporting solutions. Partner with analysts data engineers business intelligence engineers ...

  • Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Non-Departmental Agency Full time

    Summary Data Engineers work with data consumers to create and populate optimal data architectures, structures, and systems to meet CIA's business needs. Duties As a Data Engineer for CIA, you will focus on the design, implementation, and operation of data management systems to meet the CIA's business needs. This includes designing how the data will be...

  • Data Engineer

    4 weeks ago

    Washington, United States Non-Departmental Agency Full time

    Summary Data Engineers work with data consumers to create and populate optimal data architectures, structures, and systems to meet CIA's business needs. ...

  • Data Engineer

    4 days ago

    Washington, Washington, D.C., United States Atechstar Full time

    Key Responsibilities Design implement and support applications that provide structured and timely access to actionable business information addressing stakeholder needs. Interface directly with stakeholders gathering requirements and owning automated end-to-end reporting solutions. Partner with analysts data engineers business intelligence engineers and...

  • Data Engineer

    2 weeks ago

    Washington, United States Amida Technology Solutions Full time

    Amida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision support. We specialize in taking...

  • Data Engineer

    3 weeks ago

    Washington, United States Square Peg Technologies Full time

    Job DescriptionJob DescriptionFull Job Description Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. The Mission: At Square Peg, we rely on powerfully insightful data to inform our systems and solutions—and we’re seeking an experienced pipeline-centric data engineer to put it to use. The Data Engineer will be responsible for designing,...

  • Data Engineer

    3 weeks ago

    Washington, United States ITR Full time

    Job DescriptionJob DescriptionSenior Data Engineer – Top Secret Clearance RequiredWill implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms. • Leverage automation, cognitive and science-based techniques to manage data,...

  • Big Data Engineer

    4 weeks ago

    Washington, United States Dash techology Full time

    We’re looking for a Big Data Engineer who can find creative solutions to tough problems. As a Big Data Engineer you’ll create and manage our data infrastructure and tools including collecting storing processing and analyzing our data and data systems. You know how to work quickly and accurately using the best solutions to analyze mass data sets and...

  • Big Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Dash techology Full time

    We're looking for a Big Data Engineer who can find creative solutions to tough problems. As a Big Data Engineer you'll create and manage our data infrastructure and tools including collecting storing processing and analyzing our data and data systems. You know how to work quickly and accurately using the best solutions to analyze mass data sets and you know...

  • Data Engineer

    4 weeks ago

    Washington, United States Atechstar Full time

    Responsibilities Design build and own all the components of a high-volume data warehouse end to end. Build efficient data models using industry best practices and metadata for ad-hoc and pre-built reporting Provide wing-to-wing data engineering support for project lifecycle execution (design execution and risk assessment) Interface with business customers...

  • Data Engineer

    3 weeks ago

    Washington, Washington, D.C., United States Atechstar Full time

    Responsibilities Design build and own all the components of a high-volume data warehouse end to end. Build efficient data models using industry best practices and metadata for ad-hoc and pre-built reporting Provide wing-to-wing data engineering support for project lifecycle execution (design execution and risk assessment) Interface with business customers...

  • Data Engineer

    15 hours ago

    Washington, United States Gunnison Consulting Group Inc Full time

    Job DescriptionJob Description*This job listing is to express interest in a future job opening. Our team will review applications and reach out to qualified candidates when the need arises. Thank you for your interest!We are seeking a motivated and customer-oriented Data Engineer to support our US Courts client.The customer is looking to consolidate and...

  • Databricks Data Engineer

    3 weeks ago

    Washington, United States Square Peg Technologies Full time

    Job DescriptionJob DescriptionClearance Required:Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. Location:Northern VirginiaThe Mission:Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of...

  • Azure Data Engineer

    2 weeks ago

    Washington, United States Ampcus Full time

    The Azure Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data models, and data storage solutions using Azure services. The candidate will work closely with cross-functional teams to ensure successful delivery of projects and support business objectives. The ideal candidate should have a strong technical...

  • Data Quality Engineer

    3 weeks ago

    Washington, United States Inclusion Cloud Full time

    About the job Data Quality Engineer WHAT YOUD BE DOINGAs a Data Quality Engineer, you will be responsible for building automated, repeatable, efficient processes to perform data quality checks across various data assets. It is your duty to ensure high quality data is available to internal stakeholders and customers.To do this you will be designing,...

  • Data Analyst/Data Engineer

    4 weeks ago

    Ft. Washington, Maryland, United States ENSCO Inc. Full time

    ENSCO Mission Systems Group (MSG) is recruiting senior engineering and support staff supporting the Office of the Undersecretary of Defense - Intelligence & Security Branch (OUSD/I&S). We are currently seeking a Data Analyst/Data Engineer who will interface with functional and technical experts. Successful candidates will support the modernization,...

  • Azure Data Engineer

    1 week ago

    Washington, United States AKT Corp Full time

    Job DescriptionJob DescriptionTitle: Azure Data EngineerLocation: Washington DCResponsibilities:Design, develop, and deploy data pipelines and ETL processes on Azure using services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.Implement data storage solutions on Azure, including Azure SQL Database, Azure Cosmos DB, and Azure Blob...

  • Sr Data Engineer

    4 weeks ago

    Washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    2 weeks ago

    Washington, United States Serigor Inc Full time

    Title: Sr Data Engineer Location: 100% Remote – EST Time zone Duration: 12+ Months Key Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, Redshift Job Description: Looking for a Sr level person – Min 10+ Years Look for a Sr Data Engineer with Adobe Analytics or...

  • Sr Data Engineer

    4 weeks ago

    Washington, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionTitle: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with...