Cloud Data Engineer with Security Clearance

4 weeks ago


Washington, United States Equiliem Full time

Our client is seeking a seeking a customer experience focused Microsoft Azure Cloud Data Engineer to join their team. This is a Remote opportunity but quarterly travel to Washington, DC will be required. *Candidates must be US Citizens and able to obtain a Public Trust Clearance* In this role, you will: * Support the development, lifecycle management, and deployment of data pipeline services and solutions. * Work with client personnel and team members to understand data requirements and implement appropriate data solutions. * Design and implement data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, NoSQL data stores. * Manage and optimize data storage using Azure ADLS Gen2, Azure Synapse SQL Pools, Azure Cosmos DB. * Develop batch/incremental/streaming data pipelines using Python, SQL, Spark, Scala and Microsoft Azure services including ADLS Gen2/Blob Storage, Data Factory, Synapse Pipelines, Azure Analysis Services, Logic Apps, Azure Functions, Azure Files, Visual Studio, SQL Server Change Data Capture, SQL Server stored procedures. * Redevelop or migrate existing SSIS extract, transform, load scripts to Azure Data Factory. * Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML. * Implement data migration, data integrity, data quality, metadata management, and data security functions, and apply advanced techniques such as machine learning to optimize data pipelines. * Monitor and troubleshoot data related issues to maintain high availability and performance. * Implement governance, build, deployment and monitoring standards to automate platform administration. * Apply DevOps and CI/CD principles to development, test, deployment, and release of code. For this position, you must possess: * BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience * 4+ years of professional experience implementing Azure cloud based data engineering solutions * 4+ years of experience designing and building solutions utilizing various cloud services such as Azure Blob, Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime, Azure EventHubs, Azure Functions, Azure Logic Apps, Azure Analysis Services * 4+ years of experience in the design and build of ETL/ELT processes by writing custom data pipelines, initial, incremental and change data capture experiences * 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, Scala, PySpark * Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes) * Knowledge and experience with shell scripting, MDX, DAX queries * Admin, system level experiences with data management, DB creation, user management/access control, ETL package deployment, data modeling, scheduling, debug, monitor, security controls, and O&M aspect for both on-premise and cloud based data assets. * Experience with data engineering solutions for data warehouse, data mart, multi-dimensional models, semantic data models (e.g. Azure Analysis Services) * Knowledge and understanding of AWS cloud services including data management and data movement services. * Demonstrated experience in supporting a production, testing, integration, and development environments * Open mindset, ability to quickly adapt new technologies to solve customer problems * Experience with Agile process methodology, and CI/CD automation, and cloud based development (Azure, AWS). * Ability to successfully obtain a government-issued Public Trust clearance. Not required, but additional education, certifications, and/or experience are a plus: * Experience with ETL/ELT processes for Master Data Management. * Working within Scaled Agile Framework (SAFe) process. * Experience working with Azure DevOps. * Knowledge and understanding in data governance, data discovery tools such as Alation, MS Purview * Knowledge and experience of configuring ETL pipelines in cloud, VPC/VNet config, Integration Runtime, Gateway, EC2/Bastion access settings * Microsoft certified in Azure fundamentals, data engineer, AI or AWS certified data engineer. #CJ



  • Washington, United States Gridiron IT Solutions Full time

    GridIron IT is seeking a Data Engineer local to Washington, DC. Active TS (SCI Eligible) Clearance Required!! Data Science professional services practice focused on strategy, technology, and solving business challenges with Artificial Intelligence (AI). The team has a proven track record serving large, market-leading organizations in the private and public...


  • Washington, United States DIGITALSPEC LLC Full time

    Position: Cloud Engineer/Architect Become an integral part of a diverse team. Currently DIGITALSPEC is seeking an experienced, motivated, career and customer-oriented Cloud Engineer to join our team. Position: Cloud Engineer/ArchitectLocation: Washington, DCEducation: BS degree in Computer Science. Engineering, or related field, or equivalent...


  • Washington, United States BigBear.ai Full time

    Overview BigBear.ai is seeking a Data Engineer to join our team and help us build and maintain scalable and reliable data pipelines for our clients. You will be responsible for developing and designing data pipelines to support an end-to-end solution, integrating data pipelines with AWS cloud services to extract meaningful insights, and providing Tier 3...

  • Data Scientist

    2 months ago


    Washington, United States Data Machines Full time

    Data Scientist -Hybrid - 0205-R Location: Washington, DC, Metro Area Job Description: Come join the future of data-driven decision making! At Data Machines we leverage data analytics, DevSecOps, machine intelligence, and data science to engineer solutions for our Federal government, defense, and commercial sponsors to solve real-world, critical mission...


  • Washington, United States Gridiron IT Solutions Full time

    As a Data Engineer, you will be required to interpret business needs and select appropriate technologies and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and...


  • Washington, United States SAIC Full time

    Description SAIC has an opening for a Cloud Engineer with experience designing and testing Azure Hyperconverged Infrastructure (HCI) to include integration with the Enterprise Azure Cloud Services (EACS). The Vanguard 2.2.1 program provides transparent, interconnected systems and security support for the Department of State (DOS) Bureau of Information...

  • Cloud Data Engineer

    3 weeks ago


    Washington, United States Equiliem Full time

    Our client is seeking a seeking a customer experience focused Microsoft Azure Cloud Data Engineer to join their team. This is a Remote opportunity but quarterly travel to Washington, DC will be required. *Candidates must be US Citizens and able to obtain a Public Trust Clearance* In this role, you will : Support the development, lifecycle management, and...


  • Washington, United States Buchanan and Edwards Full time

    Description As a Data Engineer, you will be responsible for the design, structure, and maintenance of data. You will ensure the accuracy and accessibility of data relevant to the project. The management and organization of data requires proficiency in database design (Concept Maps, ER Diagrams, etc). Responsible for assisting in the establishment of an IT...

  • Cloud Data Engineer

    2 weeks ago


    Washington, United States Amida Technology Solutions Full time

    Amida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision support. We specialize in taking...


  • Washington, United States Acuity, Inc Full time

    Acuity is seeking a Cloud Agnostic Engineer to support the Application Vulnerability Assessment Program in Diplomatic Technology. This individual will work in a team environment to set up and maintain environments used for web and static code analysis and development vulnerability scanning across multiple cloud environments. This hybrid position works onsite...


  • Washington, United States Constellation West Full time

    Constellation West is seeking a highly motivated Cloud Engineer to join our team in pursuing a contract with the USDA. This presents a distinctive chance for an experienced Federal Government contractor to contribute to the writing and speak on a panel for this proposal. If you are an enthusiastic cloud engineer who would relish the opportunity to...


  • Washington, United States Constellation West Full time

    Constellation West is seeking a highly motivated Cloud Engineer to join our team in pursuing a contract with the USDA. This presents a distinctive chance for an experienced Federal Government contractor to contribute to the writing and speak on a panel for this proposal. If you are an enthusiastic cloud engineer who would relish the opportunity to...

  • Cloud Data Engineer

    1 week ago


    Washington, United States Amida Technology Solutions Full time

    Job DescriptionJob DescriptionAmida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision...

  • Data Engineer

    3 weeks ago


    Washington, United States Motion Recruitment Full time

    Our client is an innovative federal consulting agency dedicated to harnessing the power of artificial intelligence (AI) to enhance the capabilities of the defense and intelligence communities. Their mission is to provide innovative, secure, and scalable AI solutions that support national security and defense operations. They are seeking a talented and...

  • Data Engineer

    1 week ago


    Washington, United States Motion Recruitment Full time

    Our client is an innovative federal consulting agency dedicated to harnessing the power of artificial intelligence (AI) to enhance the capabilities of the defense and intelligence communities. Their mission is to provide innovative, secure, and scalable AI solutions that support national security and defense operations. They are seeking a talented and...

  • Data Engineer

    2 months ago


    Washington, United States Blu Omega LLC Full time

    Clearance: Active Top Secret / SCI Co-location: Candidates be located in the Washington DC Metro Area. Candidate required to support at client site location (DC). *3 Days onsite, 2 days remote* Experience level:Masters & 4 Bachelor’s & 6 Associates & 8 As a Data Engineer, you will be required to interpret business needs and select appropriate technologies...


  • Washington, United States MAGNUS Management Group Full time

    Company Description MAGNUS Management Group LLC is a Woman Owned Small Business consulting firm located in Washington DC. We are ISO 9001, ISO 27001, ISO 20000, ISO 56002 & CMMI L3 SVC + SSD certified, and we provide expert consulting services in areas such as Information Technology, Management Consulting, Cyber Security and Data Science. We leverage...


  • Washington, United States Dorkin Inc. Full time

    Our employees are a reflection of our company and our goal is to make this your “end all be all” through restoring job security and longevity in the American workplace. Our corp-culture is very friendly, upbeat, and fast-paced. We encourage feedback from our staff and welcome the opportunity to hire energetic polished individuals with a mind frame of...


  • Washington, United States Base One Technologies Full time

    Our DC metro based client is looking for security Engineer. Must Have One of the Following J3 Certifications:CISSP, GCWN, GISF, GSSP, GICSP, CCSP, CSSLP, SSCP, CCSNP, CCIE-Security, ECSP, MCSE-Security Expert, or RHCSA/RHCE Certification. Job Description: The Security Engineer will need to be a self-starter with excellent analytical and problem-solving...

  • Cloud Engineer

    2 months ago


    Washington, United States Peraton Full time

    About Peraton Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our...