Data Engineer

4 weeks ago


Arlington Virginia, United States Intelligent Waves LLC Full time
Overview:
Since 2006, Intelligent Waves has delivered mission-focused multi-domain operational expertise and innovation to the Government through high-impact technology solutions in cybersecurity, data science, enterprise network engineering, software development, and platform mission support. Anytime. Anywhere. Any domain.

 

Advana is a multi-domain technology platform which offers military and business decision makers, analysts, and users at all levels unprecedented access to authoritative enterprise data and structured analytics in a scalable, reliable, and secure environment. It offers platform-, data analytics-, and data science-as-a-service tools to complete analysis and data exploration and data visualization capabilities. Using one central data platform with right-time data, data tools, and other self-service products, the goal of Advana is to simplify solutions and put the power of analytics in the pocket of every analyst and decision-making authority within the DOD.

Location & Travel: The Data Engineer position will be a Hybrid role based in Crystal City, VA with the ability to be in the office 2-3/days p/week and attend onsite meetings as needed. 

Security Clearance: The Data Engineer must be a United States Citizen and hold a current DoD Secret security clearance.

 

Mission - ADVANA

Employees are required to follow all company and customer site COVID-19 protocols.

 

As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure and systems within an organization. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the efficient flow, storage, and accessibility of data for analytical and reporting purposes.

Responsibilities:
Data Pipeline Development: Designing and implementing scalable and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. This involves understanding data requirements, identifying relevant data sources, and building automated workflows to ensure data quality and integrity.

Data Modeling and Integration: Developing and maintaining data models, schemas, and integrations to facilitate data ingestion, transformation, and aggregation. This includes designing database schemas, defining data structures, and establishing efficient data integration processes between different systems.

Data Quality Assurance: Implementing and maintaining data quality checks and validation procedures to ensure accuracy, completeness, and consistency of data. This involves developing data profiling techniques, anomaly detection mechanisms, and data cleansing routines to identify and resolve data quality issues.

Performance Optimization: Monitoring and optimizing the performance of data pipelines, databases, and data processing systems. This includes identifying and resolving bottlenecks, improving query performance, and implementing caching strategies to enhance overall data processing efficiency.

Data Security and Governance: Collaborating with the data governance and security teams to establish data access controls, data encryption mechanisms, and data privacy measures. Ensuring compliance with data protection regulations and best practices in data management and security.

Collaboration and Documentation: Working closely with cross-functional teams to understand their data requirements and provide technical guidance on data-related matters. Documenting data pipelines, data flows, and data infrastructure architectures to facilitate knowledge sharing and maintain system documentation.

Emerging Technologies: Keeping up-to-date with the latest trends and advancements in data engineering, big data technologies, cloud platforms, and distributed computing frameworks. Evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and infrastructure.

Qualifications:
Bachelor’s degree in computer science, Information Systems, or 3-5 years of relevant job experience.

Proven experience as a Data Engineer or a similar role, preferably in a large-scale data-driven environment.

Strong programming skills in languages, specifically Databricks and Pyspark, and others such as Python, Java, or Scala.

Experience with data integration tools, ETL frameworks, and workflow management systems (e.g., Apache Airflow).

Proficiency in working with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Familiarity with distributed computing frameworks (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure, GCP).

Knowledge of data modeling concepts, data warehousing, and dimensional modeling.

Understanding of data governance, data security, and data privacy principles.

Strong analytical and problem-solving skills, with attention to detail.

Excellent communication and collaboration abilities, with the capacity to work effectively in cross-functional teams.

Intelligent Waves LLC is an equal opportunity employer. We are committed to providing equal opportunity to all applicants and employees in full compliance with all applicable state and federal laws prohibiting discrimination on the basis of race, color, age, gender, religion, national origin, disability, sexual orientation and gender identity protected veteran status and individuals with disabilities, or any other class protected by applicable state or federal law.

 

As an Affirmative Action and Equal Opportunity Employer, IW is committed to the full inclusion of all qualified candidates and current employees. As part of this commitment, IW will ensure that those in need are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact .

 

A Veteran Friendly Organization

#IW

 



  • Arlington, Virginia, United States AECOM Full time

    Job Description AECOM is seeking an Electrical Engineer Lead specializing in Hyper-scale Data Centers to act as Data Center Electrical Engineer Lead. The job incumbent will be responsible for designing, implementing, and maintaining electrical systems in large-scale data centers. This position is a remote opportunity and can be based out of any of...


  • Arlington, Virginia, United States AECOM Full time

    Job Description AECOM is seeking a Senior Mechanical Engineer with experience on Hyperscale Data Center projects to act as Data Center Mechanical Engineer Lead. The job incumbent will be responsible for designing and overseeing the construction of mechanical systems for hyperscale data centers, including HVAC, piping and fire suppression systems.  This...


  • Herndon, Virginia, USA, United States Amazon Data Services, Inc. Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • DevOps Engineer

    1 week ago


    Arlington, Virginia, United States Systems Engineering Solutions Corporation Full time

     DevOps Engineer (Data Mart) Years of Experience: 5 years   Education Requirements:A Bachelor’s Degree in computer science, electronics engineering or other engineering or technical discipline is required.    Program Description:  Create an end-to-end management perspective to ensure proper compliance and oversight of GI Bill programs, and the...

  • Data Engineer

    1 week ago


    Arlington, United States Gray Tier Technologies LLC Full time

    Data Engineer – Role Description & Requirements Data is absolutely the lifeblood of ADVANA and our data engineers are the doctors administering it! Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores. They work on a team made up of analyst(s), developer(s), data scientist(s), and a...

  • Data Engineer

    6 days ago


    Arlington, United States Intelligent Waves Full time

    Overview Since 2006, Intelligent Waves has delivered mission-focused multi-domain operational expertise and innovation to the Government through high-impact technology solutions in cybersecurity, data science, enterprise network engineering, software development, and platform mission support. Anytime. Anywhere. Any domain. Advana is a multi-domain technology...


  • Arlington, United States Amazon Data Services, Inc. Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Data Engineer

    3 weeks ago


    Arlington, United States @Orchard Full time

    Job DescriptionJob DescriptionData Engineer (Advana System)Must hold an active Secret Clearance (Top Secret preferred)Arlington, VA – Hybrid Work@Orchard is working with a fast-growing Service-Disabled Veteran-owned Small Business (SDVOSB) focused on delivering a range of solutions to the US Government in Data Analytics, Change Management, and Audit...


  • Arlington, United States Amazon Data Services, Inc. Full time

    What we do:The Infrastructure Data Services (IDS) team builds services and tools that collect, store, transform, and vend date relating to all infrastructure in Amazon. As an infrastructure services provider, we own the services and tools that Amazon uses to turn hardware into capacity that service teams across Amazon run their business on. What we do...


  • Arlington, Virginia, United States Publicis Sapient Full time

    Job Description Publicis Sapient is looking for a Senior Associate, Data Engineering (Azure) to be part of our team of top-notch technologists. You will lead and deliver technical solutions for large-scale digital transformation projects. Working with the latest data technologies in the industry, you will be instrumental in helping our clients evolve for a...


  • Arlington, United States Amazon Data Services, Inc. Full time

    Do you like to use network and Unix systems engineering to deliver simple, sustainable, and repeatable solutions? Would you like to play a key role in driving the stability and sustainability of next-generation IP networks?AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re...

  • Data Engineer

    4 weeks ago


    Arlington, United States iO Associates - US Full time

    A DMV based technology start-up is looking for an experienced Data engineer with 5+ experience to come in and work on their latest project. The firm has recently received Series B funding and are looking to grow out their team.The main responsibilities of the position will be to build ETL pipelines and create the basis of their Data platform using the...

  • Data Engineer

    4 days ago


    Arlington, United States International Consulting Associates, Inc. Full time

    Data Engineer: Req' Mstr or eqvlnt in CS/ IT/rltd. Must have coursewrk in advancd sys anlysis & dsgn, artfcial intllgnce, advancd DB dsgn, & advancd prgm'g. Job Loc'n: Arlington, VA & other unanticipated loc'ns in US. Re-loc'n possible. Resume: "HR, International Consulting Associates, Inc. at 2000 14th Street N, Suite 350, Arlington, VA 22201 or email at:...

  • Data Engineer

    1 week ago


    Arlington Heights, United States Verinon Technology Solutions Full time

    Verinon Technology Solutions Ltd. has openings for the following positions in Arlington Heights, IL and various unanticipated locations throughout the US: Data Engineer (Job Code DE) - support big data projects throughout the lifecycle; define, design, develop & test applications using Hadoop & ETL technologies. Data Warehouse Engineer (Job Code DWE) -...


  • Arlington, Virginia, United States Systems Engineering Solutions Corporation Full time

    Migrated Data Test Lead Years of Experience: 5 years Education Requirements:A Bachelor’s Degree in computer science, electronics engineering or other engineering or technical discipline is required.  Program Description:  Create an end-to-end management perspective to ensure proper compliance and oversight of GI Bill programs, and the...


  • Arlington, United States Lovelytics Full time

    We are seeking an accomplished Principal Consultant with specialized expertise in delivering strategic Databricks and data engineering solutions for our clients at Lovelytics. As a pivotal member of our team, you will serve as a data and analytics solution architect, leading technical engagement and architecture initiatives encompassing data warehousing, ETL...


  • Arlington, United States Lovelytics Full time

    Job DescriptionJob DescriptionWe are seeking an accomplished Principal Consultant with specialized expertise in delivering strategic Databricks and data engineering solutions for our clients at Lovelytics. As a pivotal member of our team, you will serve as a data and analytics solution architect, leading technical engagement and architecture initiatives...


  • Arlington, Virginia, United States SMS Data Products Group, Inc. Full time

    Overview: SMS is seeking an Identity and Access Management Systems Engineer to be responsible for the upkeep, configuration, and reliable operation of computer systems in support of DISA's Compartmented Enterprise Services Office (CESO) NOC. The IdAM Systems Engineer will to contribute to the deployment and maintenance of an IdAM solution to serve as a...


  • Virginia, United States Rcubeitllc Full time

    Minimum Required Experiences At least 5 years of relevant Data Engineering and insight experience 5+ years of Python with very strong AWS experience in delivering Python based solutions Skilled in SQL and experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data 5+ years of recent experience with...


  • Arlington, United States Latitude, Inc. Full time

    Job DescriptionJob DescriptionWe are seeking a skilled AWS Data Engineer to join our team and contribute to the design, development, and implementation of robust data solutions on the AWS platform. As a Data Engineer, you will work closely with cross-functional teams to understand data requirements, architect data pipelines, and ensure efficient data...