Senior Data Engineer

1 week ago


Chantilly, Virginia, United States Peraton Full time

Peraton is seeking a highly skilled Senior Data Engineer with a proven track record in ETL (Extract, Transform, Load) to contribute to our critical national security mission.

We are revolutionizing the way law enforcement agencies access and utilize data to combat crime and terrorism. As a key member of our team, you will play a vital role in designing, developing, and maintaining robust ETL processes that ensure the accuracy, integrity, and accessibility of critical information.

Responsibilities:

  • Design, develop, and maintain sophisticated ETL workflows for master data management (MDM) systems, leveraging industry-leading tools like Apache Spark or AWS Glue.
  • Construct and optimize data pipelines to extract data from diverse sources, transform it into the required format, and seamlessly load it into target destinations using Databricks and AWS services.
  • Collaborate closely with stakeholders across various departments to gather comprehensive data requirements, understand intricate data sources, and ensure data quality and integrity throughout the entire ETL process.
  • Implement advanced data validation, cleansing, and enrichment techniques to significantly enhance the accuracy and completeness of our datasets.
  • Proactively monitor and troubleshoot ETL processes to identify and resolve any issues promptly, ensuring seamless data flow and operational efficiency.
  • Contribute to a collaborative team environment dedicated to designing, developing, and supporting a cutting-edge software system undergoing modernization.
  • Participate actively in the development of new functionalities and the migration of applications into the cloud, embracing innovative technologies and expanding our tech stack.
  • Engage in Agile Scrum SDLC activities, contributing to the development of comprehensive documentation for each phase of the software development lifecycle.
  • Conduct thorough unit and integration testing of software/systems prior to release, ensuring high-quality deliverables that meet user acceptance criteria.

Qualifications:

  • Minimum of 8 years of experience with a Bachelor's degree; or 6 years with a Master's degree; or 3 years with a PhD. Additional years of relevant experience may be considered in lieu of a degree.
  • Strong proficiency in programming languages such as Scala or Java is essential for success in this role.
  • Demonstrated expertise in designing and developing ETL workflows using tools like Apache Spark or AWS Glue is highly desired.
  • In-depth knowledge of ETL best practices, data integration techniques, and data quality management principles is crucial.
  • Familiarity with various data storage technologies and databases, such as Amazon S3 or Amazon Redshift, is a significant advantage.
  • Understanding of Data Lakehouse architecture and OpenSearch concepts is highly beneficial.
  • A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph are mandatory requirements for this position.

Desired Qualifications:

  • Knowledge of Tika
  • Experience with AWS cloud services
  • Expertise in data acquisition and ingestion of structured and unstructured data sources, ensuring quality and data integrity
  • Experience with open-source technologies like Docker, Elasticsearch, and Kibana


  • Chantilly, Virginia, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our team at Amazon Data Services, Inc. as a Senior Electrical Design Engineer - Data Center Infrastructure. This is a critical role that will involve designing and developing electrical systems for our data centers, ensuring they meet the highest standards of quality, reliability,...


  • Chantilly, Virginia, United States Peraton Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Peraton. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.ResponsibilitiesData Conditioning: Support the development of data conditioning processes to ensure high-quality data is...

  • Data Architect

    2 months ago


    Chantilly, Virginia, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Architect to join our team in Chantilly, Virginia (US-VA), United States (US).Position...

  • Data Engineer

    4 weeks ago


    Chantilly, Virginia, United States Next Tier Concepts Full time

    If cutting edge data engineering projects resonate with you, and you care deeply about joining a mission-driven company with a strong growth direction and diverse culture, we'd love to learn more about you. Check out the details below, and lets connect. Our delivery teams are driven to explore new ideas and technology, and care deeply about collaboration,...


  • Chantilly, Virginia, United States SAIC Full time

    Job DescriptionJob SummarySAIC is seeking a highly skilled Data Standards Engineer to join our team in Chantilly, VA. As a critical member of our LANDMARK AOS program, you will provide technical and acquisition support to deliver solutions to our organization.Key ResponsibilitiesEstablish Relationships: Develop and maintain relationships with internal and...


  • Chantilly, Virginia, United States ManTech Full time

    Secure Our Nation, Ignite Your FutureBecome a pivotal member of the elite Information Technology and Analytics professionals dedicated to enhancing our national security. Within a cutting-edge, self-sufficient Big Data environment, the ManTech team undertakes a comprehensive range of responsibilities from infrastructure management to application development,...


  • Chantilly, Virginia, United States Reinventing Geospatial, Inc. (RGi) Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Reinventing Geospatial, Inc. (RGi), a leading geospatial expert working with Defense, Intelligence, and Federal clients. As a Data Engineer, you will play a critical role in deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing...


  • Chantilly, Virginia, United States Reinventing Geospatial, Inc. (RGi) Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Reinventing Geospatial, Inc. (RGi), a leading geospatial expert working with Defense, Intelligence, and Federal clients. As a Data Engineer, you will play a critical role in deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing...


  • Chantilly, Virginia, United States ManTech Full time

    Empower National Security through Innovative Data SolutionsBecome a vital part of a dedicated team of Information Technology and Analytics experts committed to enhancing our national security. In a dynamic, self-sufficient Big Data environment, the ManTech team manages a wide range of responsibilities, from infrastructure and application development to data...


  • Chantilly, Virginia, United States ManTech Full time

    Enhance National Security through Data ArchitectureBecome a vital part of a team of elite Information Technology and Analytics professionals dedicated to safeguarding our nation. In a cutting-edge, self-sufficient Big Data environment, the ManTech team manages everything from foundational infrastructure to application development, data science, and advanced...


  • Chantilly, Virginia, United States ManTech Full time

    Enhance National Security through Innovative Data SolutionsBecome a pivotal part of a leading team of Information Technology and Analytics experts dedicated to making significant contributions to national security. In a dynamic, self-sufficient Big Data setting, the ManTech group oversees a wide array of responsibilities, from foundational infrastructure to...


  • Chantilly, Virginia, United States ManTech Full time

    Enhance National Security through Data InnovationBecome a pivotal member of a leading team of Information Technology and Analytics experts dedicated to making significant contributions to our nation's safety. In a cutting-edge, self-sufficient Big Data environment, the ManTech team manages everything from infrastructure to application development, data...


  • Chantilly, Virginia, United States RSEKURE Full time

    Job SummaryWe are seeking a highly skilled Senior Software Developer/Enterprise Data Engineer to join our team at RSEKURE. As a key member of our technical team, you will be responsible for designing and developing enterprise applications in a web environment.Key ResponsibilitiesDevelop and implement software solutions for data extraction, transaction, and...


  • Chantilly, Virginia, United States ManTech Full time

    Enhance National Security, Empower Your CareerBecome a pivotal member of a premier team of Information Technology and Analytics experts dedicated to safeguarding our nation. Within a cutting-edge, self-sufficient Big Data framework, the ManTech group oversees a wide spectrum of responsibilities, including infrastructure management, application development,...

  • Data Engineer

    3 months ago


    Chantilly, Virginia, United States Esvee Technologies Full time

    Position Data Engineer Position Type W2 Location Chantilly VA Experience - 8 YearsResponsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery...


  • Chantilly, Virginia, United States Peraton Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Mission Specialist to join our team at Peraton. As a key member of our data engineering team, you will be responsible for designing, constructing, and maintaining large-scale data processing pipelines that are robust, flexible, and cost-efficient.Key ResponsibilitiesDesign and Development:...


  • Chantilly, Virginia, United States Jacobs Full time

    Your Contribution:We are seeking a highly skilled Web Application Developer (Senior) to become an integral part of our innovative team. In this role, you will be engaged in an organization dedicated to enhancing operations through data and advanced analytical insights. The team operates within a framework that emphasizes SAFe agile methodologies, aiming to...


  • Chantilly, Virginia, United States SAIC Full time

    Job DescriptionJob SummarySAIC is seeking a highly skilled Data Standards Engineer to join our team in Chantilly, VA. As a Data Standards Engineer, you will play a critical role in supporting the LANDMARK AOS program, providing technical and acquisition support to deliver solutions to the organization.Key ResponsibilitiesEstablish relationships with internal...


  • Chantilly, Virginia, United States Peraton Full time

    Job DescriptionPeraton is seeking a highly skilled Expert Data Engineer to join our team. As a key member of our organization, you will be responsible for designing, developing, and maintaining complex data systems and architectures.ResponsibilitiesData Conditioning and Validation: Ensure that data is properly conditioned and validated to meet the...


  • Chantilly, Virginia, United States Jacobs Full time

    Your Contribution:We are seeking a highly skilled and Top Secret cleared Web Application Developer (Senior) to become an integral part of our organization. You will be engaged in a mission-driven environment focused on enhancing operations through innovative data solutions and analytical insights. Our team employs SAFe agile methodologies to deliver...