Senior Data Engineer

4 weeks ago

Reston, United States TekStream Solutions Full time

Data Engineer


US Citizenship required; preference will be given to those with an EOD (Entry on Duty/Suitability) Clearance.



Description

We are currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data Warehouse. You have an eye for spotting data correlations and a desire to dig into large datasets to find technical solutions and deliver business value.


Program Details

The program you will be supporting has a mission to provide development, security, and operations (DevSecOps) support to U.S. Citizenship and Immigration Services (USCIS) with a focus on development, operations, and modernization of the Agency’s Enterprise Data Warehouse/Data Lake. The team utilizes open-source, AWS Cloud, and Big Data technologies, agile project management practices, and modern DevSecOps delivery to provide the business intelligence support systems to meet the reporting, data analytics, and machine learning/artificial intelligence needs critical to USCIS leadership, data/business analysts, data scientists, and other decision-makers.


Requirements:

  • Interact with designated product owners, system owners, and source system business owners to understand transactional system data models and elicit requirements and logic for ETLs
  • Develop ETL workflows/data pipelines to ingest data using AWS Data Migration Service (DMS), Scala, Kafka, Restful APIs, and other technologies as determined by the client from multiple transactional systems to the target (including ODS, data marts, and data lake) according to documented logic and source-to-target mappings
  • Troubleshoot data discrepancy and missing data issues resulting from daily ETL loads
  • Work with operations team to deploy ETL jobs in integration and production environment and debug / troubleshoot critical production issues.
  • Actively participate in Agile release development activities and ceremonies, including sprint planning, sprint grooming, artifact creation, sprint testing, demonstrations and retrospectives and solution releases.
  • Document ETL logic, mappings, etc. in a concise and traceable manner to be used as a reference for future development and maintenance
  • Execute other activities related to development work, such as participate in meetings, provide briefings, presentations and other support materials that will promote the program, assist in achieving user buy-in, and explain technical concepts to non-technical audiences.


Required Skills:

  • 5+ years of experience with ETL development ingesting data from diverse and huge data sources
  • 5+ years of experience with programming languages such as Java, Scala, Python, R, JSON Schema
  • 2+ years of experience producing and consuming Rest APIs.
  • 5+ years of experience with relational databases used to support BI analytics
  • Experience with Databricks/Apache Spark structured streaming, and/or Kafka experience
  • Demonstrated experience in a Data Warehouse/Data Lake and Business Intelligence environment
  • Ability to write complex SQL queries and scripts
  • Strong teamwork, co-ordination, planning and influencing skills
  • Self-driven with the ability to adapt quickly, work in a challenging and fast paced environment within cross-functional teams, and to promote creative problem solving within their team
  • Experience with Agile development practices, including Scrum and Kanban, and management tools (e.g., Jira, Confluence)
  • Experience with GIT and branching strategies
  • Experience with engineering/DevOps tools (i.e., Jenkins)
  • Excellent analytical, communication and organizational skills
  • Experience working in AWS Cloud environment
  • Experience with Microsoft Office Suite including Excel, PowerPoint, and Visio


Desired Skills:

  • Experience with AWS Database Migration Service (DMS)
  • Experience with Postgres and Oracle
  • Experience with Scaled Agile Framework SAFe


Education: Bachelor’s degree in a technical discipline preferred – Computer Science, Mathematics, or equivalent technical degree, or the equivalent combination of education, professional training, and work experience.


Location: Reston, VA – Currently fully remote due to COVID-19.


Clearance: Must be a US Citizen and be able to obtain a government agency Suitability Clearance. USCIS Entry on Duty (EOD) preferred.

  • Senior Data Engineer

    4 weeks ago

    Reston, United States AVM Consulting Inc Full time

    Sr. Data EngineerIn this role, you'll help shape the future of forecasting for one of the largest mortgage industry companies in the world. This is an exciting opportunity to join a team working with cutting-edge technology at an unparalleled scale. We are looking for a strong Senior Data Engineer who can help design and implement a sophisticated Data...

  • Senior Data Engineer

    4 weeks ago

    Reston, United States AVM Consulting Inc Full time

    Sr. Data EngineerIn this role, you'll help shape the future of forecasting for one of the largest mortgage industry companies in the world. This is an exciting opportunity to join a team working with cutting-edge technology at an unparalleled scale. We are looking for a strong Senior Data Engineer who can help design and implement a sophisticated Data...

  • Enterprise Data

    1 week ago

    Reston, United States Fannie Mae Full time

    Company Description At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to impact the future of the housing industry while being part of an inclusive team thriving in an energizing, flexible environment. Here, you will grow your career and...

  • Data Analyst/Data Engineer

    3 weeks ago

    Reston, Virginia, United States ENSCO Inc. Full time

    ENSCO Mission Systems Group (MSG) is recruiting senior engineering and support staff to support the Office of the Undersecretary of Defense - Intelligence & Security Branch (OUSD/I&S). We are currently seeking a Data Analyst/Data Engineer who will interface with functional and technical experts. Successful candidates will support the modernization,...

  • Senior Data Engineer

    2 weeks ago

    Reston, United States Fannie Mae Full time

    Job DescriptionJob DescriptionCompany DescriptionAt Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to use tech to tackle housing’s biggest challenges and impact the future of the industry. You’ll be a part of an expert team thriving...

  • Operations - Data Engineering - Senior Associate (Hybrid)

    1 day ago

    Reston, Virginia, United States Fannie Mae Full time

    Job Description As a valued colleague on our team, you will contribute to developing data infrastructure and pipelines to capture, integrate, organize, and centralize data while testing and ensuring the data is readily accessible and in a usable state, including quality assurance.  THE IMPACT YOU WILL MAKE The Operations - Data Engineering - Senior...

  • Senior Data Engineer

    1 week ago

    Reston, United States Fannie Mae Full time

    Company Description At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to use tech to tackle housing's biggest challenges and impact the future of the industry. You'll be a part of an expert team thriving in an energizing, flexible...

  • Sr Data Engineer

    1 day ago

    Reston, United States Three Point Solutions Full time

    Job DescriptionJob DescriptionPosition: Sr Data EngineerClient: Health Care IndustryLocation: Reston, Virginia (They are required to come into the office at least once a week)Duration: 12 monthsGeneral InformationJob Description: The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on premise infrastructure...

  • Sr Data Engineer

    1 week ago

    Reston, United States Ageatia Global Solutions Full time

    PURPOSE: The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping...

  • Senior Data Analyst

    4 weeks ago

    Reston, United States Actfore Full time

    Job DescriptionJob DescriptionSalary: DOE - ExemptLocated just a few miles outside of D.C., Actfore is a data mining and forensics company that operates globally. With over 1,000 engagements delivered and with tools that are language agnostic, Actfore can meet your data mining needs across the globe with speed and accuracy.We are an off-shoot of ActiveNav, a...

  • Senior Systems Engineer

    23 hours ago

    Reston, United States IVYSYS TECHNOLOGIES LLC Full time

    Job DescriptionJob DescriptionAs a Senior Systems Engineer, you will make critical contributions as part of a multi-disciplinary development team working on novel methods for solving critical national security problems. We are seeking someone capable of providing engineering analysis, design, and architecture expertise for a growing data-driven microservice...

  • Senior Database Engineer

    1 week ago

    Reston, United States Gridiron IT Full time

    Gridiron IT is seeking a Senior Database Engineer to support a Federal Program located in Reston, VA. Work requires 2x a week onsite. Job Description: Gridiron IT is seeking a results-oriented Senior Database Engineer to join the Department of Homeland Security Team, providing support to the Transportation Security Administration's. The right candidate will...

  • Sr Data Engineer

    1 day ago

    Reston, United States Three Point Solutions Full time

    Job DescriptionJob DescriptionPosition: Sr Data EngineerClient: Health Care IndustryLocation: Reston, Virginia (They are required to come into the office at least once a week)Duration: 12 monthsGeneral InformationJob Description: The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on premise infrastructure...

  • Data Engineer

    1 week ago

    Reston, United States Ageatia Global Solutions Full time

    PURPOSE: This is a Big Data Administrator Lead position and not a developer position. The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data...

  • Data Engineer

    1 week ago

    Reston, United States Metric5 Full time

    Data EngineerDescription Metric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data...

  • Big Data Engineer

    4 weeks ago

    Reston, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Data Engineer

    1 week ago

    Reston, United States Applied Information Sciences Full time

    As a Data Engineer, you will use cutting-edge cloud and data technologies to help global brands and federal agencies solve challenging problems through innovative technology solutions. Work on exciting projects, future-proof your skills and grow into your dream job alongside some of the industry's most talented, knowledgeable, and dedicated technologists....

  • Data Engineer

    1 week ago

    Reston, United States Applied Information Sciences Full time

    As a Data Engineer , you will u se cutting-edge cloud and data technologies to help global brands and federal agencies solve challenging problems through innovative technology solutions. Work on exciting projects, future-proof your skills and grow into your dream job alongside some of the industry's most talented, knowledgeable, and dedicated...

  • Senior Data Analyst

    4 weeks ago

    Reston, United States Atechstar Full time

    Responsibilities Prepare reports and present the story of the data to the Research team in an easily accessible manner. Build automatic reporting systems/dashboards for the Binance Research team. Supporting ad-hoc data requirements of research analysts on data initiatives. Lead the gathering analysis and interpretation of data using statistical techniques...

  • Senior Data Analyst

    3 weeks ago

    Reston, Virginia, United States Atechstar Full time

    Responsibilities Prepare reports and present the story of the data to the Research team in an easily accessible manner. Build automatic reporting systems/dashboards for the Binance Research team. Supporting ad-hoc data requirements of research analysts on data initiatives. Lead the gathering analysis and interpretation of data using statistical techniques to...