Cloud Data Lake Architect

2 months ago

Silver Spring, United States Executive Recruiting Full time
Job DescriptionJob Description

We are seeking a remote experienced and highly motivated Cloud Data Lake Architect with extensive experience in AWS and data lake technologies. In this role, the successful candidate will drive our efforts to support cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and National Environmental Satellite, Data, and Information Service (NESDIS) with a focus on architecting and provisioning enterprise-level Cloud services, including Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS).

The ideal candidate will have a robust background in big data analytics, data engineering, and cloud computing, with a particular focus on building and optimizing data lakes on AWS. This role is crucial for designing, implementing, and managing advanced data solutions using AWS and Data Lakehouse platforms. The position requires expertise in cloud computing, data engineering, and analytics, emphasizing data lake and data lakehouse architectures.

Responsibilities:

  • Design and Implementation:

    • Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services.
    • Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others, in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics.

  • Collaboration:

    • Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
    • Utilize Databricks for big data processing and streaming analytics.

  • Data Management:

    • Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility.
    • Optimize data storage and processing for performance and cost efficiency.

  • Automation and Quality:

    • Automate data workflows and ensure high data quality and reliability.
    • Monitor, troubleshoot, and resolve data pipeline issues.

  • Organization and Efficiency:

    • Organize and manage data within the environment, ensuring it is stored efficiently, securely, and supports easy access and analysis.
    • Monitor the performance of data processes and queries and optimize for efficiency and speed.

  • Governance and Trends:

    • Ensure high standards of data quality and implement data governance practices.
    • Stay current with emerging trends and technologies in cloud computing, big data, and data engineering.

  • Support and Documentation:

    • Provide ongoing support for the platform, troubleshoot any issues, and ensure high availability and reliability of data infrastructure.
    • Create documentation for the platform infrastructure and processes, and train other team members or users on the platform effectively.

Qualifications:

  • 5 years' experience in big data analytics, data engineering, or related roles.
  • Experience in designing, building, and maintaining data warehouses, with an understanding of data modeling, data warehousing, and data lake concepts.
  • Proficiency in programming languages such as Python, Java, Scala, and scripting languages like Bash or PowerShell.
  • Experience with big data technologies such as Apache Hadoop, Spark, Kafka, and others.
  • Hands-on experience with AWS services such as S3, Glue, Redshift, EMR, Athena, etc.
  • Proficiency in SQL and experience with relational databases.
  • Experience in building and optimizing big data pipelines, architectures, and data sets.
  • Familiarity with ETL tools, processes, and data integration techniques.
  • Excellent communication and team collaboration skills.
  • Must be able to obtain a security clearance.

Education and Experience:

  • BS in Computer Science, IT, Software or Computer Engineering, Data Science or Analytics, Mathematics, or a related field.

  • AWS Big Data Architect

    3 months ago

    Silver Spring, United States Executive Recruiting Full time

    Job DescriptionJob DescriptionAre you an experienced Cloud Big Data Expert looking to make a significant impact in a dynamic and mission-driven environment? Do you have a passion for AWS and data lake technologies? Join our remote team and play a pivotal role in supporting cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and...

  • AWS Big Data Architect

    3 months ago

    Silver Spring, United States Executive Recruiting Full time

    Job DescriptionJob DescriptionAre you an experienced Cloud Big Data Expert looking to make a significant impact in a dynamic and mission-driven environment? Do you have a passion for AWS and data lake technologies? Join our remote team and play a pivotal role in supporting cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and...

  • AWS Big Data Architect

    1 month ago

    Silver Spring, United States GAMA-1 Technologies Full time

    GAMA-1 Technologies, LLC is seeking a remote experienced and highly motivated Cloud Big Data Expert with experience in AWS and data lake technologies to join our team. . In this role, the successful candidate will be instrumental in driving GAMA-1's efforts to support cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and...

  • Lead Data Architect

    15 hours ago

    Spring, Texas, United States The Friedkin Group Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at The Friedkin Group. As a key member of our data engineering team, you will play a crucial role in designing, implementing, and managing robust, scalable data infrastructure.Key ResponsibilitiesDesign and Implement Data Pipelines: Develop and implement scalable and reliable...

  • Cloud Solutions Architect

    4 days ago

    Silver Spring, Maryland, United States NavitsPartners Full time

    Job OverviewCloud Solutions ArchitectKey Responsibilities:Design and implement sophisticated Office 365 and Azure Active Directory features, prioritizing security and governance.Guide architectural choices for cloud infrastructures, emphasizing scalability and disaster recovery strategies.Oversee and configure cloud services on AWS and Azure...

  • Lead Cloud Solutions Architect

    1 week ago

    Silver Spring, Maryland, United States GAMA-1 Technologies Full time

    We are looking for a skilled and knowledgeable remote Lead Cloud Solutions Architect to become a vital part of our organization. In this role, you will be instrumental in designing, executing, and overseeing cloud-based solutions tailored for the orchestration and operation of scientific algorithms. You will work closely with interdisciplinary teams to...

  • Snowflake Architect

    15 hours ago

    Silver Spring, Maryland, United States LTIMindtree Full time

    About the RoleLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies.We are seeking an experienced Snowflake Architect to join our team. As a Snowflake Architect, you will be responsible...

  • Cloud Network Architect

    1 week ago

    Silver Spring, United States Ang Signal LLC Full time

    Job DescriptionJob DescriptionJob descriptionAn immediate opening for a Cloud Network Architect position to support our federal government client. The successful candidate will support Azure and AWS network architectures and connectivity options, with an initial focus on managed network and security services.Alongside a team of cloud and network engineers,...

  • Cloud Solutions Architect

    1 week ago

    Spring, Texas, United States Jobot Full time

    About the Role Our esteemed client is in search of a Cloud Solutions Architect to join their innovative team. This position offers a hybrid work model, allowing for a blend of on-site and remote work. Key Responsibilities Design and implement cutting-edge cloud solutions that enhance operational efficiency. Oversee the seamless integration of IT...

  • Cloud Infrastructure Engineer

    3 days ago

    Silver Spring, Maryland, United States General Dynamics Full time

    Job Title: AWS Cloud Solutions ArchitectWe are seeking a highly skilled AWS Cloud Solutions Architect to join our team at General Dynamics. As a key member of our cloud engineering team, you will play a critical role in designing, architecting, deploying, maintaining, and improving cloud solutions and AWS infrastructure.Key Responsibilities:Cloud Solutions...

  • Cloud Data Architect

    6 days ago

    Spring, United States ExxonMobil Full time

    About us   At ExxonMobil, our vision is to lead in energy innovations that advance modern living and a net-zero future. As one of the world’s largest publicly traded energy and chemical companies, we are powered by a unique and diverse workforce fueled by the pride in what we do and what we stand for. The success of our Upstream, Product Solutions and...

  • Senior Data Engineer

    14 hours ago

    Spring, Texas, United States The Friedkin Group Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at The Friedkin Group. As a key member of our data engineering team, you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure.Key ResponsibilitiesDesign and Implement Data Pipelines: Design and implement scalable and reliable...

  • Cloud Architect

    3 weeks ago

    Silver Spring, United States Insight Global Full time

    Essential Functions· Supporting the government in the development of an enterprise-level architectural framework and establishing models to implement the delivery of enterprise-level information technology services and products utilizing a Shared Service approach· Leading the development of NWS enterprise architecture governance in order to establish...

  • Cloud Architect

    3 weeks ago

    Silver Spring, United States Insight Global Full time

    Essential Functions· Supporting the government in the development of an enterprise-level architectural framework and establishing models to implement the delivery of enterprise-level information technology services and products utilizing a Shared Service approach· Leading the development of NWS enterprise architecture governance in order to establish...

  • Cloud Infrastructure Engineer

    1 week ago

    Silver Spring, Maryland, United States GAMA-1 Technologies Full time

    Cloud Computing Solutions SpecialistGAMA-1 Technologies, LLC is in search of a highly skilled remote systems engineer to enhance and support infrastructure services tailored for high-performance computing applications operating within the OAR Cloud. This position demands a blend of cloud computing proficiency, web development capabilities, and a robust...

  • Cloud Solutions Engineer

    4 days ago

    Silver Spring, Maryland, United States Dansources Technical Services Full time

    Job OverviewWe are seeking a highly skilled Cloud Solutions Engineer with a robust background in managing cloud infrastructures. The ideal candidate will possess a minimum of 10 years of relevant experience, showcasing extensive expertise in selecting cloud service providers, implementing solutions, and migrating application data effectively to meet both...

  • Cloud Specialist

    1 week ago

    Silver Spring, United States Global Science & Technology Full time

    Global Science & Technology, Inc (GST) is seeking a Cloud Specialist to support our client in the National Oceanic & Atmospheric Administration (NOAA). The position is responsible for estimating, monitoring, and auditing cloud resources to improve the operational efficiency of cloud infrastructure and recommending cost optimization actions. This position is...

  • Chief Architect

    3 months ago

    Silver Spring, United States eSimplicity Full time

    Job DescriptionJob DescriptionDescription:About UseSimplicity is a modern digital services company that delivers innovative federal and commercial IT solutions designed to improve the health and lives of millions of Americans while defending our national interests. Our solutions and services improve healthcare for millions of Americans, protect our borders,...

  • Cloud Infrastructure Engineer

    1 week ago

    Silver Spring, Maryland, United States GAMA-1 Technologies Full time

    Cloud Computing Solutions SpecialistGAMA-1 Technologies, LLC is in search of a seasoned remote systems engineer to enhance and support infrastructure services tailored for high-performance computing applications operating within the OAR Cloud. This position demands a blend of cloud proficiency, web development capabilities, and a robust understanding of IT...

  • Principal Architect

    2 months ago

    Silver Spring, United States eSimplicity Full time

    Job DescriptionJob DescriptionDescription:About USeSimplicity is a modern digital services company that delivers innovative federal and commercial IT solutions designed to improve the health and lives of millions of Americans while defending our national interests. Our solutions and services improve healthcare for millions of Americans, protect our borders,...