Cloud Data Engineer

5 days ago

Washington, Washington, D.C., United States IT Concepts, Inc Full time
Job Title: Sr. Cloud Data Engineer

We are seeking a highly skilled Sr. Cloud Data Engineer to join our team at IT Concepts, Inc. The ideal candidate will have a strong background in cloud-based data engineering, with experience in designing, developing, and maintaining large-scale data and analytics platforms.

Responsibilities:
  • Collaborate with cross-functional teams to design and implement cloud-based data solutions.
  • Develop and maintain large-scale data pipelines and architectures using AWS services.
  • Ensure data quality, integrity, and security in cloud-based environments.
  • Work with data architects to design and implement data models and APIs.
  • Provide technical guidance and support to junior engineers and data scientists.
  • Stay up-to-date with the latest cloud-based data engineering trends and technologies.
Requirements:
  • 8+ years of experience in data engineering, with a focus on cloud-based solutions.
  • Strong understanding of AWS services, including S3, EC2, DMS, DataSync, SageMaker, Glue, RDS, Lambda, and Elasticsearch.
  • Experience with data integration patterns and technologies, including ETL processes and datapipelines.
  • Proficiency in Python, PySpark, and SQL, with experience in data manipulation, scripting, and automation.
  • Strong problem-solving and troubleshooting skills, with experience in managing code in GitHub or similar tools.
  • Minimum of 2 years of experience in hands-on experience with Databricks, including data ingestion, transformation, analysis, and optimization.
  • Experience designing, deploying, securing, sustaining, and maintaining applications and services in a cloud environment using infrastructure as code.
Preferred Experience:
  • Bachelor's Degree in a related field.
  • Previous experience with large-scale data migrations and cloud-based data platform implementations.
  • Prior experience with Databricks Unity Metastore/Catalog.
  • Familiarity with advanced SQL techniques for performance optimization and data analysis.
  • Knowledge of data streaming and real-time data processing frameworks, such as Spark Structured Streaming.
  • Experience with data lakes and big data technologies, including Apache Spark and Citus.
  • Familiarity with serverless computing and event-driven architectures in AWS.
  • Certifications in AWS, Databricks, or related technologies.
  • Experience working in Agile or DevSecOps environments and using related tools for collaboration and version control.
Clearance Requirements:
  • Must be able to obtain and maintain a Public Trust clearance.
  • Must be a US Citizen.

  • Data Quality Engineer

    5 days ago

    Washington, Washington, D.C., United States Inclusion Cloud Full time

    About the JobAt Inclusion Cloud, we're seeking a highly skilled Data Quality Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing automated data quality checks to ensure high-quality data is available to our internal stakeholders and customers.Key ResponsibilitiesDesign...

  • Cloud Data Engineer

    3 weeks ago

    Washington, Washington, D.C., United States IT Concepts Full time

    Job Title: Cloud Data EngineerIT Concepts is seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data and analytics platforms, system integrations, data pipelines, data models, and API integrations.Responsibilities:Collaborate with...

  • Data Quality Engineer

    4 days ago

    Washington, Washington, D.C., United States Inclusion Cloud Full time

    About the role: Data Quality EngineerKey ResponsibilitiesDesign, develop, and document automated data quality checksEnsure high-quality data is available to internal stakeholders and customersCollaborate with Data Engineering and other teams for requirements gatheringCommunicate technical concepts to developers, product managers, and business partnersProvide...

  • Cloud Data Engineer

    3 weeks ago

    Washington, Washington, D.C., United States IT Concepts, Inc Full time

    Job Title: Sr. Cloud Data EngineerIT Concepts, Inc is seeking a highly skilled Sr. Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data and analytics platforms, system integrations, data pipelines, data models, and API...

  • Data Engineer

    2 weeks ago

    Washington, Washington, D.C., United States Square Peg Technologies Full time

    Job Title: Data Engineer - Cloud Data PipelinesAt Square Peg Technologies, we're seeking a skilled Data Engineer to join our team and help us design, implement, and maintain data pipelines for our customers. As a Data Engineer, you'll be responsible for developing automated pipelines for various data types and datasets using Databricks, a leading cloud-based...

  • Cloud Data Engineer

    12 hours ago

    Washington, Washington, D.C., United States TalentRemedy Full time

    About the RoleThe Cloud Data Engineer will play a crucial part in designing, building, and maintaining data infrastructure and ETL pipelines using Databricks and cloud-based technologies. This role will enable data-driven decision-making and ensure data accuracy and accessibility for regulatory purposes.Key ResponsibilitiesCollaborate with cross-functional...

  • Cloud Data Engineer Lead

    4 weeks ago

    Washington, Washington, D.C., United States IT Concepts Full time

    Job Title: Lead Cloud Data EngineerWe are seeking an experienced Lead Cloud Data Engineer to join our team at IT Concepts. As a key member of our data engineering team, you will be responsible for designing, building, and implementing large-scale data and analytics platforms, system integrations, data pipelines, data models, and API...

  • Cloud Platform and Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Via Logic Full time

    Job Title: Cloud Platform and Data EngineerWe are seeking a highly skilled Cloud Platform and Data Engineer to join our team at Via Logic. As a key member of our team, you will be responsible for designing, implementing, and managing secure, scalable, and automated cloud solutions.Key Responsibilities:Design and implement CI/CD pipelines for cloud-based and...

  • Cloud Engineer

    4 days ago

    Washington, Washington, D.C., United States Knowledge Management, Inc. Full time

    Job SummaryKnowledge Management, Inc. is seeking a skilled Cloud Engineer - Data Center to support both our physical data center infrastructure and cloud services. This role requires a versatile skill set that bridges on-premises data center management with cloud technologies, particularly Azure.Key ResponsibilitiesOversee and maintain physical data center...

  • Data Engineer

    2 days ago

    Washington, Washington, D.C., United States OnDek Solutions Full time

    Job Title: Data Engineer - Cloud SolutionsAbout the Role:As a Data Engineer at OnDek Solutions, you will play a key role in designing and developing scalable data stores that supply big data for business analysis. You will work closely with our team to develop innovative solutions to complex problems, applying advanced consulting skills and extensive...

  • Data Engineer

    2 days ago

    Washington, Washington, D.C., United States BigBear Inc Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at BigBear Inc. As a Data Engineer, you will be responsible for designing and implementing data pipelines to support our clients' software products.Key Responsibilities:Define and communicate a clear product vision for our clients' software products, aligning with user needs and...

  • Big Data Architect/Cloud Data Engineer

    1 month ago

    Washington, Washington, D.C., United States AHU Technologies Inc Full time

    Job Title: Big Data Architect/Cloud Data EngineerAt AHU Technologies Inc, we are seeking an experienced IT Consultant to support the design, development, implementation, and maintenance of an enterprise Big Data solution as part of our Data Modernization Effort.Job Summary:This role will provide expertise to support the development of a Big Data/Data Lake...

  • Cloud Data Engineer

    5 days ago

    Washington, Washington, D.C., United States Ford Motor Company Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Ford Motor Company. As a Cloud Data Engineer, you will be responsible for designing and deploying data-centric architecture on Google Cloud Platform (GCP) for our Materials Management platform.Key Responsibilities:Design and implement data-centric solutions...

  • Cloud Data Architect

    4 weeks ago

    Washington, Washington, D.C., United States Constellation West Full time

    Job Title: Cloud Data ArchitectConstellation West is seeking a highly skilled Cloud Data Architect to join our team. As a Cloud Data Architect, you will be responsible for designing and implementing cloud-based data architectures that meet the needs of our clients.Key Responsibilities:Design and implement cloud-based data architectures that meet the needs of...

  • Data Quality Specialist

    4 weeks ago

    Washington, Washington, D.C., United States Inclusion Cloud Full time

    About the JobData Quality EngineerKey ResponsibilitiesDesign, develop, and document automated data quality checks across various data assets.Ensure high-quality data is available to internal stakeholders and customers.Collaborate with Data Engineering and other teams for requirements gathering and effective communication.Provide ongoing support and...

  • Cloud Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Knowledge Management, Inc. Full time

    Job Title: Data Center Cloud EngineerWe are seeking a highly skilled Data Center Cloud Engineer to join our team at Knowledge Management, Inc. This is a unique opportunity to work on a multi-year contract with a leading provider of innovative technology solutions.Job Summary:The Data Center Cloud Engineer will be responsible for overseeing and maintaining...

  • Cloud Data Architect

    4 weeks ago

    Washington, Washington, D.C., United States Client Server Software Solutions Full time

    Job Title: Cloud Data ArchitectJob Summary:We are seeking a highly skilled Cloud Data Architect to join our team at Client Server Software Solutions. The successful candidate will be responsible for designing and implementing cloud-based data architectures that meet the needs of our clients.Key Responsibilities:Develop and implement cloud-based data...

  • Senior Data Engineer

    2 days ago

    Washington, Washington, D.C., United States US News Full time

    About the RoleU.S. News & World Report is seeking an experienced Senior Data Engineer to join our data warehouse team. As a key member of our team, you will specialize in data modeling and data transformation within BigQuery, helping us build our large-scale data platform for reporting and analysis.You will work with a variety of ingested data sources to...

  • Data Center Infrastructure Manager

    1 week ago

    Washington, Washington, D.C., United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Center Infrastructure Leader to join our team in the Washington D.C. metropolitan area. As a key member of our data center operations team, you will be responsible for leading and managing data center infrastructure operations for a large federal client, ensuring the efficient and resilient...

  • Azure Data Architect

    4 weeks ago

    Washington, Washington, D.C., United States Inclusion Cloud Full time

    About the JobWe are seeking an experienced Azure Data Architect to join our team at Inclusion Cloud. As a key member of our Artificial Intelligence and Analytics team, you will be responsible for designing and implementing Big Data and BI solutions using the Microsoft Azure platform.Key ResponsibilitiesDesign and develop data warehouses and data pipelines...