Cloud Data Engineer

3 weeks ago

Washington, United States Equiliem Full time

Our client is seeking a seeking a customer experience focused

Microsoft

Azure

Cloud

Data Engineer

to join their team.

This is a Remote opportunity but quarterly travel to Washington, DC will be required.

*Candidates must be US Citizens and able to obtain a Public Trust Clearance*

In this role, you will :

Support the development, lifecycle management, and deployment of data pipeline services and solutions.

Work with client personnel and team members to understand data requirements and implement appropriate data solutions.

Design and implement data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, NoSQL data stores.

Manage and optimize data storage using Azure ADLS Gen2, Azure Synapse SQL Pools, Azure Cosmos DB.

Develop batch/incremental/streaming data pipelines using Python, SQL, Spark, Scala and Microsoft Azure services including ADLS Gen2/Blob Storage, Data Factory, Synapse Pipelines, Azure Analysis Services, Logic Apps, Azure Functions, Azure Files, Visual Studio, SQL Server Change Data Capture, SQL Server stored procedures.

Redevelop or migrate existing SSIS extract, transform, load scripts to Azure Data Factory.

Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.

Implement data migration, data integrity, data quality, metadata management, and data security functions, and apply advanced techniques such as machine learning to optimize data pipelines.

Monitor and troubleshoot data related issues to maintain high availability and performance.

Implement governance, build, deployment and monitoring standards to automate platform administration.

Apply DevOps and CI/CD principles to development, test, deployment, and release of code.

For this position, you must possess:

BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience

4+ years of professional experience implementing Azure cloud based data engineering solutions

4+ years of experience designing and building solutions utilizing various cloud services such as Azure Blob, Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime, Azure EventHubs, Azure Functions, Azure Logic Apps, Azure Analysis Services

4+ years of experience in the design and build of ETL/ELT processes by writing custom data pipelines, initial, incremental and change data capture experiences

4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, Scala, PySpark

Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes)

Knowledge and experience with shell scripting, MDX, DAX queries

Admin, system level experiences with data management, DB creation, user management/access control, ETL package deployment, data modeling, scheduling, debug, monitor, security controls, and O&M aspect for both on-premise and cloud based data assets.

Experience with data engineering solutions for data warehouse, data mart, multi-dimensional models, semantic data models (e.g. Azure Analysis Services)

Knowledge and understanding of AWS cloud services including data management and data movement services.

Demonstrated experience in supporting a production, testing, integration, and development environments

Open mindset, ability to quickly adapt new technologies to solve customer problems

Experience with Agile process methodology, and CI/CD automation, and cloud based development (Azure, AWS).

Ability to successfully obtain a government-issued Public Trust clearance.

Not required, but additional education, certifications, and/or experience are a plus:

Experience with ETL/ELT processes for Master Data Management.

Working within Scaled Agile Framework (SAFe) process.

Experience working with Azure DevOps.

Knowledge and understanding in data governance, data discovery tools such as Alation, MS Purview

Knowledge and experience of configuring ETL pipelines in cloud, VPC/VNet config, Integration Runtime, Gateway, EC2/Bastion access settings

Microsoft certified in Azure fundamentals, data engineer, AI or AWS certified data engineer.

#CJ #J-18808-Ljbffr

  • Cloud Data Engineer

    2 weeks ago

    Washington, United States Amida Technology Solutions Full time

    Amida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision support. We specialize in taking...

  • Cloud Data Engineer

    2 weeks ago

    Washington, United States Amida Technology Solutions Full time

    Job DescriptionJob DescriptionAmida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision...

  • Data Engineer III

    16 hours ago

    Washington, United States Cloud BC Labs Full time

    Job DescriptionJob DescriptionPOSITIONData Engineer IIILOCATIONDMV Area: D.C., Maryland, Virginia- RemoteDURATION 6 monthsINTERVIEW TYPEVideoVISA RESTRICTIONS GG, EAD, USCREQUIRED SKILLS Minimum of 7-10 years of experience in data engineering or a related fieldCMS or similar healthcare agenciesPython, SQL, or ScalaHadoop, Spark, KafkaAWS, Azure, or GCPCloud...

  • Cloud Data Engineer with Security Clearance

    4 weeks ago

    Washington, United States Equiliem Full time

    Our client is seeking a seeking a customer experience focused Microsoft Azure Cloud Data Engineer to join their team. This is a Remote opportunity but quarterly travel to Washington, DC will be required. *Candidates must be US Citizens and able to obtain a Public Trust Clearance* In this role, you will: * Support the development, lifecycle management, and...

  • Cloud Engineer

    1 month ago

    Washington, United States Amida Technology Solutions Full time

    Job DescriptionJob DescriptionAmida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intelligence, predictive analytics, and decision...

  • Cloud Engineer

    4 weeks ago

    Washington, United States C3EL Full time

    C3EL is seeking a versatile and driven Cloud Engineer to join our expanding team. The ideal candidate will possess a unique blend of technical expertise, problem-solving skills, and a passion for innovation. Working with C3EL, you will have the opportunity to collaborate with leading experts in the field, engage in challenging projects, and contribute to...

  • Cloud Engineer

    4 weeks ago

    Washington, United States Rayeit Full time

    Raye IT is looking for an innovative and experienced Cloud Engineer to support a federal client within the Washington, D.C. area. Responsibilities Design, testing, administration, configuration, implementation, and maintenance of Local Area Networks and Wide Area Networks to include vessels, aircraft, and shore networks. Automate the provisioning and...

  • Cloud Engineer

    4 weeks ago

    Washington, United States C3EL Full time

    C3EL is seeking a versatile and driven Cloud Engineer to join our expanding team. The ideal candidate will possess a unique blend of technical expertise, problem-solving skills, and a passion for innovation. Working with C3EL, you will have the opportunity to collaborate with leading experts in the field, engage in challenging projects, and contribute to...

  • Cloud Engineer

    2 months ago

    Washington, United States C3EL Full time

    Job DescriptionJob DescriptionC3EL is seeking a versatile and driven Cloud Engineer to join our expanding team.The ideal candidate will possess a unique blend of technical expertise, problem-solving skills, and a passion for innovation. Working with C3EL, you will have the opportunity to collaborate with leading experts in the field, engage in challenging...

  • Cloud Engineer

    2 weeks ago

    Washington, United States C3EL Full time

    Job DescriptionJob DescriptionC3EL is seeking a versatile and driven Cloud Engineer to join our expanding team.The ideal candidate will possess a unique blend of technical expertise, problem-solving skills, and a passion for innovation. Working with C3EL, you will have the opportunity to collaborate with leading experts in the field, engage in challenging...

  • Cloud Engineer

    1 month ago

    Washington, United States Akira Technologies Inc. Full time

    Job DescriptionJob DescriptionAkira Technologies is seeking a highly skilled Cloud Engineer Expert (Business Continuity and Cloud Engineering) to join our team for a critical project supporting the United States Army. As a key member of our team, you will be responsible for designing, implementing, and managing cloud infrastructure solutions that support the...

  • Cloud Engineer

    2 weeks ago

    Washington, United States Raye IT Consulting Full time

    Job DescriptionJob DescriptionRaye IT Consulting, LLC is a 8a certified minority woman-owned IT consulting and technology firm. Raye IT brings over 20 years experience in delivering mission-critical programs and support for the Federal Government and large agencies. We specialize in program and project management, capital planning and IT investment portfolio...

  • Cloud Engineer

    2 weeks ago

    Washington, United States Raye IT Consulting Full time

    Job DescriptionJob DescriptionRaye IT Consulting, LLC is a 8a certified minority woman-owned IT consulting and technology firm. Raye IT brings over 20 years experience in delivering mission-critical programs and support for the Federal Government and large agencies. We specialize in program and project management, capital planning and IT investment portfolio...

  • Cloud Engineer

    3 weeks ago

    Washington, United States Raye IT Consulting Full time

    Job DescriptionJob DescriptionRaye IT Consulting, LLC is a 8a certified minority woman-owned IT consulting and technology firm. Raye IT brings over 20 years experience in delivering mission-critical programs and support for the Federal Government and large agencies. We specialize in program and project management, capital planning and IT investment portfolio...

  • Senior Manager, Cybersecurity Cloud

    5 days ago

    Washington, United States Pierce Technology Corp Full time

    Direct the definition and articulation of security principles and standards for the design and build of the cloud security architecture, ensuring security integration into the development of cloud solutions; Formulate a cloud security framework and governance model that enforces secure, efficient data transfer and operations of Firm and client data across...

  • Senior Manager, Cybersecurity Cloud

    1 month ago

    Washington, United States Pierce Technology Corp Full time

    Job DescriptionJob DescriptionDirect the definition and articulation of security principles and standards for the design and build of the cloud security architecture, ensuring security integration into the development of cloud solutions;Formulate a cloud security framework and governance model that enforces secure, efficient data transfer and operations of...

  • Senior Manager, Cybersecurity Cloud

    2 months ago

    Washington, United States Pierce Full time

    Direct the definition and articulation of security principles and standards for the design and build of the cloud security architecture, ensuring security integration into the development of cloud solutions;Formulate a cloud security framework and governance model that enforces secure, efficient data transfer and operations of Firm and client data across...

  • Senior Manager, Cybersecurity Cloud

    2 months ago

    Washington, United States Pierce Full time

    Direct the definition and articulation of security principles and standards for the design and build of the cloud security architecture, ensuring security integration into the development of cloud solutions;Formulate a cloud security framework and governance model that enforces secure, efficient data transfer and operations of Firm and client data across...

  • Senior Solutions Engineer

    2 weeks ago

    Washington, Washington, D.C., United States Yellowbrick Data Full time

    Yellowbrick Data is a modern cloud Data Warehouse start-up headquartered in Silicon Valley. We are a flexible multi-cloud solution, winning customers with our incredible speed and controllable costs. Our technology is used by the world's largest insurers, credit card companies, telcos and healthcare firms, all of whom depend on our products to make critical...

  • Senior Solutions Engineer

    3 weeks ago

    Washington, Washington, D.C., United States Yellowbrick Data Full time

    Yellowbrick Data is a modern cloud Data Warehouse start-up headquartered in Silicon Valley. We are a flexible multi-cloud solution, winning customers with our incredible speed and controllable costs. Our technology is used by the world's largest insurers, credit card companies, telcos and healthcare firms, all of whom depend on our products to make critical...