Data Engineer

3 weeks ago


Reston, United States Metric5 Full time
Data Engineer

Description

Metric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data Warehouse. You have an eye for spotting data correlations and a desire to dig into large datasets to find technical solutions and deliver business value.

Program Details

The program you will be supporting has a mission to provide development, security, and operations (DevSecOps) support to U.S. Citizenship and Immigration Services (USCIS) with a focus on development, operations, and modernization of the Agency's Enterprise Data Warehouse/Data Lake. The team utilizes open-source, AWS Cloud, and Big Data technologies, agile project management practices, and modern DevSecOps delivery to provide the business intelligence support systems to meet the reporting, data analytics, and machine learning/artificial intelligence needs critical to USCIS leadership, data/business analysts, data scientists, and other decision-makers.

Requirements:
  • Interact with designated product owners, system owners, and source system business owners to understand transactional system data models and elicit requirements and logic for ETLs
  • Develop ETL workflows/data pipelines to ingest data using AWS Data Migration Service (DMS), Scala, Kafka, Restful APIs, and other technologies as determined by the client from multiple transactional systems to the target (including ODS, data marts, and data lake) according to documented logic and source-to-target mappings
  • Troubleshoot data discrepancy and missing data issues resulting from daily ETL loads
  • Work with operations team to deploy ETL jobs in integration and production environment and debug / troubleshoot critical production issues.
  • Actively participate in Agile release development activities and ceremonies, including sprint planning, sprint grooming, artifact creation, sprint testing, demonstrations and retrospectives and solution releases.
  • Document ETL logic, mappings, etc. in a concise and traceable manner to be used as a reference for future development and maintenance
  • Execute other activities related to development work, such as participate in meetings, provide briefings, presentations and other support materials that will promote the program, assist in achieving user buy-in, and explain technical concepts to non-technical audiences.
Required Skills:
  • 5+ years of experience with ETL development ingesting data from diverse and huge data sources
  • 5+ years of experience with programming languages such as Java, Scala, Python, R, JSON Schema
  • 2+ years of experience producing and consuming Rest APIs.
  • 5+ years of experience with relational databases used to support BI analytics
  • Experience with Databricks/Apache Spark structured streaming, and/or Kafka experience
  • Demonstrated experience in a Data Warehouse/Data Lake and Business Intelligence environment
  • Ability to write complex SQL queries and scripts
  • Strong teamwork, co-ordination, planning and influencing skills
  • Self-driven with the ability to adapt quickly, work in a challenging and fast paced environment within cross-functional teams, and to promote creative problem solving within their team
  • Experience with Agile development practices, including Scrum and Kanban, and management tools (e.g., Jira, Confluence)
  • Experience with GIT and branching strategies
  • Experience with engineering/DevOps tools (i.e., Jenkins)
  • Excellent analytical, communication and organizational skills
  • Experience working in AWS Cloud environment
  • Experience with Microsoft Office Suite including Excel, PowerPoint, and Visio
Desired Skills:
  • Experience with AWS Database Migration Service (DMS)
  • Experience with Postgres and Oracle
  • Experience with Scaled Agile Framework SAFe


Education: Bachelor's degree in a technical discipline preferred - Computer Science, Mathematics, or equivalent technical degree, or the equivalent combination of education, professional training, and work experience.

Location: Reston, VA - Currently fully remote due to COVID-19.

Clearance: Must be a US Citizen and be able to obtain a government agency Suitability Clearance. USCIS Entry on Duty (EOD) preferred.
  • Simulation Engineer

    1 month ago


    Reston, United States Data Machines Full time

    Simulation Engineer - 1026-PS Location: Reston, VA Clearance Requirement: Secret Job Description and Responsibilities: DMC seeks an energetic Simulation Engineer with the desire to work with our team supporting the development and production of cutting-edge defense and intelligence simulation capabilities. The ideal candidate will use operations research and...

  • Data Engineer

    1 day ago


    Reston, United States iWorks Corporation Full time

    Job DescriptionJob DescriptionTitle: Data EngineerLocation: RemoteAbout iWorks:iWorks Corporation, founded in 2005, is a leading provider of information technology and professional services to the federal government. We are a recognized leader in personnel security and vetting solutions, Agile, DevOps, DevSecOps, data analytics, and cloud solutions. Our...

  • Cloud Data Engineer

    8 hours ago


    Reston, United States Warriors Recruiting Full time

    Our great client is actively seeking a highly motivated Cloud Data Engineer to join our team! Working with a team you will provide services and support to the mission, to include design, planning, and execution of data exploitation workflows into the Intelligence Community's (IC) Commercial Cloud Services (C2S). Clearance Required: TS/SCI w/ CI...

  • Senior Data Engineer

    1 month ago


    Reston, United States AVM Consulting Inc Full time

    Sr. Data EngineerIn this role, you'll help shape the future of forecasting for one of the largest mortgage industry companies in the world. This is an exciting opportunity to join a team working with cutting-edge technology at an unparalleled scale. We are looking for a strong Senior Data Engineer who can help design and implement a sophisticated Data...

  • Senior Data Engineer

    1 month ago


    Reston, United States AVM Consulting Inc Full time

    Sr. Data EngineerIn this role, you'll help shape the future of forecasting for one of the largest mortgage industry companies in the world. This is an exciting opportunity to join a team working with cutting-edge technology at an unparalleled scale. We are looking for a strong Senior Data Engineer who can help design and implement a sophisticated Data...

  • Senior Data Engineer

    15 hours ago


    Reston, United States The Ash Group Full time

    Sr Data EngineerDuration: 6-month contract- likely to convertLocation: Reston, VAOnsite Requirements: 3 Days a WeekWe are a diverse team of collaborators, doers, and problem-solvers who are relentlessly committed to a culture of safety. This position will directly impact the history of space exploration and will require your commitment and detailed attention...

  • Data Engineer

    1 week ago


    Reston, United States NS2 Mission Full time

    Job DescriptionJob DescriptionAre you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities by helping clients drive alignment with their business, advising through critical and complex issues, while allowing you to develop personally and professionally? Then consider a career at NS2...

  • Senior Data Engineer

    1 month ago


    Reston, United States TekStream Solutions Full time

    Data EngineerUS Citizenship required; preference will be given to those with an EOD (Entry on Duty/Suitability) Clearance.DescriptionWe are currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge...

  • Senior Data Engineer

    1 month ago


    Reston, United States TekStream Solutions Full time

    Data EngineerUS Citizenship required; preference will be given to those with an EOD (Entry on Duty/Suitability) Clearance.DescriptionWe are currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge...

  • AWS Data Engineer

    1 month ago


    Reston, United States Atechstar Full time

    Required Qualifications Candidate can be located anywhere in US for this position. This position may require travel in the US and Canada. Bachelors degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 4 years of experience with...

  • Data QA Engineer

    7 hours ago


    Reston, United States Omni Inclusive Full time

    We're in search of a Data QA Engineer with a meticulous eye for detail and a penchant for analytical thinking to join our team. In this role, you'll play a pivotal part in ensuring the delivery of high-quality software solutions. As a Data QA Engineer, you'll focus on validating data pipelines and guaranteeing the accuracy of our datasets. Collaboration with...

  • AWS Data Engineer

    1 month ago


    Reston, Virginia, United States Atechstar Full time

    Required Qualifications Candidate can be located anywhere in US for this position. This position may require travel in the US and Canada. Bachelors degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 4 years of experience with...

  • Enterprise Data

    13 hours ago


    Reston, United States Fannie Mae Full time

    Company Description At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to impact the future of the housing industry while being part of an inclusive team thriving in an energizing, flexible environment. Here, you will grow your career and...


  • Reston, Virginia, United States ManTech Full time

    Secure our Nation, Ignite your FutureJob DescriptionBecome an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International, you'll help protect our national security while working on innovative projects that offer opportunities for advancement.Currently, ManTech is seeking a...


  • Reston, United States Data Machines Full time

    Cyber Engineer/ Hunting Specialist- Hybrid - 0222-C Location: Reston, VA Clearance Requirement: Secret Job Description: Data Machines seeks an energetic member of a team with a deep understanding of network protocols, threat tactics, techniques and procedures. This will be a hybrid position based out of Reston, VA. Education and Certifications: * Bachelor's...


  • Reston, United States Warriors Recruiting Full time

    Job DescriptionJob DescriptionOur great client is actively seeking a highly motivated Cloud Data Engineer to join our team! Working with a team you will provide services and support to the mission, to include design, planning, and execution of data exploitation workflows into the Intelligence Community's (IC) Commercial Cloud Services (C2S).Clearance...


  • Reston, United States Cornerstone Defense Full time

    Title: Data Engineer Location: Reston, VA *Clearance: *Active TS/SCI w/ Polygraph needed to apply * Company Overview: Cornerstone Defense, in partnership with our military, intelligence, and civil government customers, supports U.S. operations worldwide through the use of many different types of intelligence, satellite, and cyber technologies. Cornerstone's...

  • Data Engineer

    6 days ago


    Reston, United States Motion Recruitment Full time

    A Federal consulting company in Northern Virginia is looking for Data Scientist to join their organization. This company works with various Federal agencies and will need this person to work on-site 3 or more days a week. Candidates should hold at least an active TS/SCI. ESSENTIAL JOB FUNCTIONS Provide hands-on technical leadership Architect and build...

  • Big Data Engineer

    1 month ago


    Reston, Virginia, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Systems Engineer

    7 hours ago


    Reston, United States Dracoitservices Full time

    Work Description: The Data Engineer will support the Sponsor's organization with leveraging best practices to Implement means to efficiently create, organize, process, store, and utilize data collected from multiple sources. Responsibilities include, but are not limited to: Provide technical expertise in the use of various data applications, tools, and...