ETL Data Engineer

2 months ago

Washington, United States Serigor Inc Full time
Job Title: ETL Data Engineer (ONSITE)
Location: Washington, DC
Duration:12 Months+

Job Description:
The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.

The ETL data engineer will support the client Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:

Responsibilities:
  • Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
  • Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems.
  • Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
  • Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
  • Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
  • Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
  • Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
  • Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
  • Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
  • Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
  • Automates, monitors, alerts, and manages data pipelines and workflows.
  • Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
  • Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
  • Develops complex programs and reports in database query language.
  • Familiarity/experience with data visualization tools.
  • Familiarity/experience handling and securing sensitive data based on the level of the sensitivity
Responsibilities:
  • Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.
  • Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.
  • May require coordination of programming activities being conducted by the application development team
  • Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
  • Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.
  • Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.
  • May coordinate activities of application developers.11-
  • Able to identify best practices and standards for the use of the product.
  • Proven track record of hands-on technical design and code work within large complex systems.
  • Proven hands-on technical work with a variety of technologies.
  • Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.
  • Delivers support and design for industry specific applications that require integration with statewide systems or applications.
  • Interacts with executive level business users or technical experts.
  • Advanced experience in the required technical subject matter.
  • May function as a niche technical SME (Subject Matter Expert).
  • Has proven experience across large and complex implementations and systems.
Minimum Education/Certification Requirements:
  • Bachelor’s degree in Information Technology or related field or equivalent experience
Skills:
SkillsRequired / DesiredAmountof ExperienceStrong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sourcesRequired15YearsAbility to gather and document requirements for data extraction, transformation and load processesRequired15YearsUnderstanding of data warehousing, data lake, business intelligence and information management concepts and standards.Required15YearsAbility to advise internal and external customers on appropriate tools and systems for complex data processing challenges.Required15YearsKnowledge and use of SQL for relational databasesRequired11YearsExperience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO)Required11YearsContribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliabilityRequired7YearsStrong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob StorageRequired5YearsExperience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FMERequired5YearsExperience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGISHighly desired3YearsStrong communication skills, both oral and writtenRequired3YearsAbility to provide excellent customer service to external partnersRequired3YearsAbility to work independently or as part of a larger teamRequired3YearsExperience performing data functions with DatabricksHighly desired3Years

  • ETL Data Engineer

    1 month ago

    washington, United States Serigor Inc Full time

    Job Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • ETL Data Engineer

    3 weeks ago

    Washington, DC, United States Serigor Inc Full time

    Job Title:ETL Data Engineer (ONSITE)Location:Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • Senior ETL Data Architect

    4 weeks ago

    Washington, Washington, D.C., United States Educology Solutions Full time

    Educology Solutions is seeking a highly skilled ETL Senior Professional Application Designer to join our team. This role will be responsible for designing and developing processes that translate data from various sources to destinations and present findings to appropriate team members, clients, and vendors.Key Responsibilities:Design and develop ETL...

  • Databricks ETL Developer

    4 weeks ago

    Washington, Washington, D.C., United States Expedite Technology Solutions LLC Full time

    Job Summary:Expedite Technology Solutions LLC is seeking a highly skilled Databricks ETL Developer to join our team. As a key player in our cloud migration project, you will be responsible for developing automated data pipelines from heterogeneous sources, including file and data validation, exception handling, and reporting. You will work closely with...

  • Data Engineer

    2 weeks ago

    Washington, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionWe are seeking a talented and experienced Data Engineer to join our team and help stand up a robust Snowflake environment in Azure for a high-priority project in the energy grid sector. This position requires expertise in data engineering, cloud infrastructure, and data pipelines, with a specific focus on leveraging Azure Data...

  • ETL Developer Data Vault Specialist

    4 weeks ago

    Washington, Washington, D.C., United States Sylger Corporation Full time

    About the Role:Sylger Corporation is seeking a highly skilled ETL Developer with expertise in Data Vault 2.0 methodology to join our team. As an ETL Developer, you will be responsible for designing and implementing ETL processes to extract, transform, and load data into our data warehouse.Key Responsibilities:Design and implement ETL processes using Data...

  • Senior Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Mindlance Full time

    Job SummaryThe Senior Data Engineer will be responsible for implementing business intelligence solutions across all divisions of the organization. This individual will guide the team in designing and implementing each solution, improving technical standards, development processes, governance, and technologies.Key Responsibilities Serve as a technical lead in...

  • ETL Developer Data Vault

    2 months ago

    Washington, United States Sylger Corporation Full time

    Job DescriptionJob DescriptionSylger Corporation is an administrative and technical support contractor to the federal government. We have immediate openings to provide BI and ETL support to a federal agency located in downtown DC.The candidate must be able to pass federal security background review. We are looking for a T-SQL, specialist and data management...

  • Sr Data Engineer

    1 month ago

    washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    2 months ago

    washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    2 months ago

    Washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Senior ETL Developer

    2 weeks ago

    Washington, United States 9th Way Insignia Full time

    Job DescriptionJob Description9th Way Insignia is a service-disabled, veteran-owned small business bringing transformative technology to our government customers so they can achieve their missions. Our specialties include cybersecurity, cloud modernization, software development, data analytics, enterprise architecture, enterprise IT, analytics, process...

  • Senior Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Mindlance Full time

    Job Summary:The Senior Data Engineer will be responsible for implementing business intelligence solutions across all divisions of the organization. This individual will guide the team in the design and implementation of each solution and will implement improvements of technical standards, development processes, governance, and technologies.Key...

  • Data Engineer

    3 weeks ago

    Washington, DC, United States Addison Group Full time

    We are focused on leveraging technology to drive data insights and innovation. We are seeking a skilled Data Engineer with experience in Google Cloud Platform (GCP), SQL, and ETL processes to join our growing data team. This role offers the opportunity to work on cutting-edge cloud-based solutions, build scalable data pipelines, and contribute to impactful...

  • Senior Informatica Data Engineer

    2 weeks ago

    Washington, United States TriOptus LLC Full time

    Randstad is seeking a Senior Informatica Data Engineer for a client in Washington, DC. This role focuses on designing, implementing, and optimizing data pipelines using Informatica, IDMC, and cloud technologies to manage and transform both structured and unstructured data. The engineer will collaborate with teams to create data solutions aligned with...

  • Data Steward with ETL Healthcare Expertise

    4 weeks ago

    Washington, Washington, D.C., United States AHU Technologies Inc Full time

    Job Title: Data Steward with ETL Healthcare ExpertiseJob Summary:A Data Steward with ETL healthcare expertise is sought by AHU Technologies Inc to support the work of the DCAS Program Administration, Executive Steering Committee, and DCAS Stakeholders. The successful candidate will play a critical role in defining and implementing policies and procedures for...

  • Data Scientist

    51 minutes ago

    Washington, United States Data Society Full time

    We Are:At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, equip, and empower their workforces with the skills they need to achieve their goals and expand their impact. We are empowering the workforces of the...

  • Senior Data Engineer

    5 days ago

    Washington, United States Allwyn Corporation Full time

    Role: Sr. Data EngineerLocation: Remote. Need to attend PI planning meetings quarterly once at Washington, DCSUMMARY OF DUTIES· Design, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.· Utilize advanced analytics tools and methodologies to supplement and enhance...

  • Data Engineer, Staff

    1 month ago

    Washington, Washington, D.C., United States BigBear Inc Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at BigBear.ai. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems.Key ResponsibilitiesDesign, develop, and implement end-to-end data pipelines using ETL processes and technologies such as Databricks,...

  • Senior ETL Developer

    4 weeks ago

    Washington, Washington, D.C., United States SynOpt LLC Full time

    Job Title: Senior ETL DeveloperJob Summary:We are seeking a highly skilled Senior ETL Developer to join our team at SynOpt LLC. As a Senior ETL Developer, you will be responsible for designing, implementing, and maintaining Extract Transform Load (ETL) solutions using SAP Data Services.Key Responsibilities:Design, document, and implement SAP Data Service...