Data Engineer

3 weeks ago

McLean, United States Metric5 Full time
Job DescriptionJob Description

Data Engineer

Description

Metric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data Warehouse. You have an eye for spotting data correlations and a desire to dig into large datasets to find technical solutions and deliver business value.

Program Details

The program you will be supporting has a mission to provide development, security, and operations (DevSecOps) support to U.S. Citizenship and Immigration Services (USCIS) with a focus on development, operations, and modernization of the Agency’s Enterprise Data Warehouse/Data Lake. The team utilizes open-source, AWS Cloud, and Big Data technologies, agile project management practices, and modern DevSecOps delivery to provide the business intelligence support systems to meet the reporting, data analytics, and machine learning/artificial intelligence needs critical to USCIS leadership, data/business analysts, data scientists, and other decision-makers.

Requirements:

  • Interact with designated product owners, system owners, and source system business owners to understand transactional system data models and elicit requirements and logic for ETLs
  • Develop ETL workflows/data pipelines to ingest data using AWS Data Migration Service (DMS), Scala, Kafka, Restful APIs, and other technologies as determined by the client from multiple transactional systems to the target (including ODS, data marts, and data lake) according to documented logic and source-to-target mappings
  • Troubleshoot data discrepancy and missing data issues resulting from daily ETL loads
  • Work with operations team to deploy ETL jobs in integration and production environment and debug / troubleshoot critical production issues.
  • Actively participate in Agile release development activities and ceremonies, including sprint planning, sprint grooming, artifact creation, sprint testing, demonstrations and retrospectives and solution releases.
  • Document ETL logic, mappings, etc. in a concise and traceable manner to be used as a reference for future development and maintenance
  • Execute other activities related to development work, such as participate in meetings, provide briefings, presentations and other support materials that will promote the program, assist in achieving user buy-in, and explain technical concepts to non-technical audiences.

Required Skills:

  • 5+ years of experience with ETL development ingesting data from diverse and huge data sources
  • 5+ years of experience with programming languages such as Java, Scala, Python, R, JSON Schema
  • 2+ years of experience producing and consuming Rest APIs.
  • 5+ years of experience with relational databases used to support BI analytics
  • Experience with Databricks/Apache Spark structured streaming, and/or Kafka experience
  • Demonstrated experience in a Data Warehouse/Data Lake and Business Intelligence environment
  • Ability to write complex SQL queries and scripts
  • Strong teamwork, co-ordination, planning and influencing skills
  • Self-driven with the ability to adapt quickly, work in a challenging and fast paced environment within cross-functional teams, and to promote creative problem solving within their team
  • Experience with Agile development practices, including Scrum and Kanban, and management tools (e.g., Jira, Confluence)
  • Experience with GIT and branching strategies
  • Experience with engineering/DevOps tools (i.e., Jenkins)
  • Excellent analytical, communication and organizational skills
  • Experience working in AWS Cloud environment
  • Experience with Microsoft Office Suite including Excel, PowerPoint, and Visio

Desired Skills:

  • Experience with AWS Database Migration Service (DMS)
  • Experience with Postgres and Oracle
  • Experience with Scaled Agile Framework SAFe

Education: Bachelor’s degree in a technical discipline preferred – Computer Science, Mathematics, or equivalent technical degree, or the equivalent combination of education, professional training, and work experience.

Location: Reston, VA – Currently fully remote due to COVID-19.

Clearance: Must be a US Citizen and be able to obtain a government agency Suitability Clearance. USCIS Entry on Duty (EOD) preferred.

  • Data Engineer

    3 weeks ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    5 days ago

    McLean, United States AE Strategies Full time

    About Us AE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    2 months ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    2 months ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    3 weeks ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    2 weeks ago

    McLean, United States Booz Allen Hamilton Full time

    Ever-expanding te chn ology like IoT, machine learning, and artifi cia l intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need a data professional like you to help our...

  • Data Engineer

    1 week ago

    McLean, United States QinetiQ Full time

    Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial...

  • Data Engineer

    2 weeks ago

    McLean, United States Booz Allen Hamilton Full time

    Job Number: R0198743 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need a...

  • Data Engineer

    1 week ago

    McLean, United States Booz Allen Hamilton Full time

    Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like...

  • Data Engineer

    2 weeks ago

    McLean, United States LMI Consulting, LLC Full time

    Data Engineer Job Locations US-Remote | US-Remote | US-VA-Tysons | US-NY-New York Job ID 2023-9995 # of Openings 1 Category Data/Analytics Overview LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions,...

  • Data Scientist/Data Engineer

    2 months ago

    McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Scientist/Data Engineer

    3 weeks ago

    McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Engineer

    2 months ago

    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Scientist/Data Engineer

    2 months ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Data Scientist/Data Engineer

    3 weeks ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Senior Data Engineer

    4 days ago

    McLean, United States The Swift Group Full time

    Job DescriptionJob DescriptionThe Swift Group is looking for a Senior Data Engineer who will manipulate data and data flows for both existing and new systems. A successful data engineer will provide support in the areas of data extraction, transformation, and load (ETL), data mapping, data extraction, analytical support, operational support, database...

  • Director, Data Engineer

    2 weeks ago

    McLean, United States Somatus Full time

    Somatus Director, Data Engineer McLean , Virginia Apply Now The Director, Data Engineer will be responsible for developing, executing, and implementing data strategy, including delivering solutions involving data integration, data governance and performance optimization. This position will report to the SVP of Technology. This position requires you to be on...

  • Data Engineer

    2 weeks ago

    McLean, United States GeoYeti Full time

    Overview GeoYeti focuses on advanced analytics, data science, development of the applications that support such work. We seek a mid-level Data Engineer to support a client in McLean, VA. We support a broad range of IC and DoD clients, though a common theme across our portfolio is that our team members, regardless of their role, interact with the end users...

  • Lead Data Engineer

    3 days ago

    McLean, United States MITRE Full time

    Why choose between doing meaningful work and having a fulfilling life? At MITRE, you can have both. That's because MITRE people are committed to tackling our nation's toughest challenges—and we're committed to the long-term well-being of our employees. MITRE is different from most technology companies. We are a not-for-profit corporation chartered to work...

  • Sr Data Engineer

    2 weeks ago

    McLean, United States Saxon Global Full time

    Sr Data Engineer | VA, TX, CA, NY, IL, GA | Freddie Mac is building a culture based on modern software delivery practices to support the secondary mortgage market through rapid technology and best practice innovation. DATA ENGINEER •Must have 4-5 years of experience. •Candidates must be local or willing to relocate at their own expense. •Option...