Cloud Big Data Expert

2 months ago

Silver Spring, Maryland, United States GAMA-1 Technologies Full time

GAMA-1 Technologies, LLC is seeking a remote experienced and highly motivated Cloud Big Data Expert with experience in AWS and data lake technologies to join our team. . In this role, the successful candidate will be instrumental in driving GAMA-1's efforts to support cloud initiatives for the National Oceanic and Atmospheric Administration (NOAA) and National Environmental Satellite, Data, and Information Service (NESDIS) with a focus on architecting and provisioning enterprise-level Cloud services, including Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS)

The ideal candidate will have a strong background in big data analytics, data engineering, and cloud computing, with a focus on building and optimizing data lakes on AWS. The Cloud Big Data Expert plays a crucial role in designing, implementing, and managing advanced data solutions using both AWS and Data Lakehouse platforms. This position requires a blend of skills in cloud computing, data engineering, and analytics. Responsible for optimizing performance, ensuring security and compliance, and providing support and troubleshooting. Collaboration with data scientists and analysts is also key, ensuring the platform meets analytics needs while staying updated with the latest technologies and practices in the field.

Responsibilities:

  • Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services. Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics. Collaborate with cross-functional teams to understand business needs and translate them into technical solutions. Utilize Databricks for big data processing and streaming analytics.
  • Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility. Optimize data storage and processing for performance and cost efficiency. Automate data workflows and ensure high data quality and reliability. Monitor, troubleshoot, and resolve data pipeline issues.
  • Organizing and managing data within the environment, ensuring it is stored efficiently, securely, and in a manner that supports easy access and analysis. Monitor the performance of data processes and queries and optimize efficiency and speed.
  • Ensure high standards of data quality and implement data governance practices. Stay current with emerging trends and technologies in cloud computing, big data, and data engineering.
  • Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure.
  • Create documentation for the platform infrastructure and processes, and train other team members or users on the platform effectively.

Qualifications:

  • 5 years' experience in big data analytics, data engineering, or related roles
  • Experience in designing, building, and maintaining data warehouses. Understanding of data modeling, data warehousing, and data lake concepts.
  • Proficiency in programming languages such as Python, Java, Scala, and scripting languages like Bash or PowerShell.
  • Experience with big data technologies, such as Apache Hadoop, Spark, Kafka, and others.
  • Hands-on experience with AWS services such as S3, Glue, Redshift, EMR, Athena, etc.
  • Proficiency in SQL and experience with relational databases.
  • Experience in building and optimizing big data pipelines, architectures, and data sets.
  • Familiarity with ETL tools, processes, and data integration techniques.
  • Excellent communication and team collaboration skills.
  • Must be able to obtain a security clearance


Education and Experience:

  • BS in Computer Science, IT, Software or Computer Engineering, Data Science or Analytics, Mathematics or related field

  • Principal Data Scientist

    2 months ago

    Silver Spring, Maryland, United States HP Full time

    Principal Data ScientistDescription -Are you passionate about technology and looking to work in an agile start-up environment that is built on the brand recognition, solution capabilities, and global reach of a world-class technology pioneer? The HP Workforce Employee Experience (HP WEX) team operates in a highly dynamic landscape that delivers a...

  • Senior Data Engineer

    3 weeks ago

    Silver Spring, Maryland, United States Staffmax Staffing & Recruiting Full time

    Build scalable data pipelines using varieties of tools, including Qlik Replicate, Five Tran, Databricks, etc.Demonstrated experience Snowflake, PostgreSQL, Qlik Replicate, Five Tran, AirflowDemonstrated experience with Databricks, Microsoft AzureDemonstrated experience with Snowflake, Data warehousing, and PostgreSQLRequired ExperienceWorking knowledge of...

  • Linux Systems Administrator Mid, Senior and Subject Expert Levels

    3 months ago

    Silver Spring, Maryland, United States ASRC Federal Holding Company Full time

    ASRC Federal Data Solutions, a subsidiary of ASRC Federal, is seeking Linux Systems Administrators at the mid, senior and subject matter expert level to support our NOAA programs on site in Silver Spring, Maryland.These roles are 100% on site position.Key Role:Provide support for Linux systems running on Red Hat enterprise Linux. Troubleshoot, patch, back up...

  • Network Engineers mid, senior and SME level

    3 months ago

    Silver Spring, Maryland, United States ASRC Federal Holding Company Full time

    ASRC Federal Data Solutions, a subsidiary of ASRC Federal, is seeking Network Engineers at the mid, senior and subject matter expert level to support our NOAA programs on site in Silver Spring, Maryland.These roles are 100% on site position.Key Role: Provide enterprise support for client infrastructure. Must be well versed with various Data Center...

  • Executive Assistant

    4 weeks ago

    Silver Spring, Maryland, United States HPE Full time

    Executive Assistant - CIO This role has been designed as 'Hybrid' with an expectation that you will work on average 2-3 days per week from an HPE office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever...

  • Senior Security Software Developer

    2 months ago

    Silver Spring, Maryland, United States HP Full time

    Senior Security Software Developer (R&D)Description -Job Description -Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of...

  • IT Specialist

    4 weeks ago

    Silver Spring, Maryland, United States National Oceanic And Atmospheric Administration Full time

    As an IT Specialist (SystemAnalysis/AppSoftWare), you will perform the following duties:Develop and maintain Information Technology (IT) applications and data products. Contribute to IT projects and initiatives and configure and transition applications to cloud. Communicate complex technical requirements to non-technical personnel. Interact and with other IT...

  • Enterprise Architect

    4 weeks ago

    Silver Spring, Maryland, United States HPE Full time

    Enterprise Architect - Network and Security ArchitectureThis unique 'Hybrid' role at HPE involves working on average 2-3 days per week from an HPE office.About Us:Hewlett Packard Enterprise is a global edge-to-cloud company revolutionizing the way individuals live and work. Our focus is on connecting, protecting, analyzing, and acting on data and...

  • Sr. Cybersecurity Architect

    3 weeks ago

    Silver Spring, Maryland, United States tapwage Full time

    Sr. Cybersecurity ArchitectDescription -The Cybersecurity Senior Architect is responsible for designing, implementing, and overseeing the security architecture for HP's Cyber organization working with senior technical leaders across the organization. This role will ensure that security solutions are aligned with the business objectives (secure, productive,...

  • IT Specialist

    2 months ago

    Silver Spring, Maryland, United States National Oceanic And Atmospheric Administration Full time

    As an IT Specialist, you will perform the following duties:Serve as Technical Authority and project team lead in the day-to-day and long-term operations and maintenance of the assigned programs. Utilize the EMRS system to collect, store, and report maintenance data for the fielded systems within the National Weather Service (NWS). Provide oversight, overall...

  • Senior DevOps Engineer

    4 weeks ago

    Silver Spring, Maryland, United States GAMA-1 Technologies Full time

    GAMA-1 is seeking a remote Senior DevOps Engineer to join the Low-Earth Orbit (LEO) GroundSustainment Services (LGSS) program to add to our distinguished team to sustain and enhance the JointPolar Satellite System (JPSS) Common Ground System (CGS). The JPSS CGS is responsible forimplementing JPSS Program command, control, and communications and data...

  • Retail Sales Lead

    4 weeks ago

    Silver Spring, Maryland, United States Kellanova Full time

    As a Retail Sales Lead for our Spring, TX territory, you will drive to make us the best snack lead company by uncovering incremental selling opportunities.You will collaborate with retail partners and our account teams while growing your territory by selling our delicious brands.We are looking to you to take a fact-based data-driven approach to growing your...

  • Sales and Service Manager

    1 week ago

    Silver Spring, Maryland, United States 24 Hour Fitness Full time

    FULL-TIME Full-time LOCATION 1000 Lake Plaza Drive Spring TX 77389 JOB SUMMARY The Sales and Service Manager (SSM) ensures the club delivers an outstanding and well-rounded sales and service experience to all guests and members through a compelling approach of offering membership, fitness and retail products and services. The SSM is responsible for hiring...

  • Policy & Procedure Analyst (Supporting NOAA)

    20 hours ago

    Silver Spring, Maryland, United States ASRC Federal Holding Company Full time

    This is a hybrid position that requires some in-office presence at the client's site in Silver Spring, MD.Data Networks, Inc. (DNC), a subsidiary of ASRC Federal Holding Company, is seeking a Policy & Procedure Analyst. This posting is in anticipation of a favorable award of a Task Order to support the National Oceanic and Atmospheric Administration's...

  • System Support Specialist

    1 month ago

    Silver Spring, Maryland, United States Dow Jones Full time

    Job Description: About the RoleThe White Oak plant provides printing services for WSJ, Barron's and the NY Post. Our plant technicians maintain, and troubleshoot all production equipment across the three primary functioning areas of the plateroom, press/reel room, and mailroom. You will also perform desktop services work normally handled by IT in other Dow...

  • Aerospace Production Technician II

    1 month ago

    Silver Spring, Maryland, United States Rocket Lab Full time

    ABOUT ROCKET LABRocket Lab is a global leader in launch and space systems. The rockets and satellites we build and launch enable some of the most ambitious and vital space missions globally, supporting scientific exploration, Earth observation and missions to combat climate change, national security, and exciting new technology demonstrations. Our Electron...

  • Senior Quality Engineer

    4 weeks ago

    Silver Spring, Maryland, United States Rocket Lab Full time

    ABOUT ROCKET LABRocket Lab is a global leader in launch and space systems. The rockets and satellites we build and launch enable some of the most ambitious and vital space missions globally, supporting scientific exploration, Earth observation and missions to combat climate change, national security, and exciting new technology demonstrations. Our Electron...

  • Director Office of National Geodetic Survey

    2 weeks ago

    Silver Spring, Maryland, United States USAJobs Full time

    Duties NOAA/NGS Exclusive Information Session Join NOAA for an exclusive information session on August 20, 2024, from 1:00 p.m. to 2:30 p.m. EDT to learn about the Senior Executive Service (SES) Director position for the Office of National Geodetic Survey (NGS). Gain insights into the role, meet NOAA NGS leadership, and receive guidance on the SES...

  • Business Development Manager, Spacecraft Separation Systems

    1 month ago

    Silver Spring, Maryland, United States Rocket Lab Full time

    ABOUT ROCKET LABRocket Lab is a global leader in launch and space systems. The rockets and satellites we build and launch enable some of the most ambitious and vital space missions globally, supporting scientific exploration, Earth observation and missions to combat climate change, national security, and exciting new technology demonstrations. Our Electron...

  • Machinist

    1 month ago

    Silver Spring, Maryland, United States Dow Jones Full time

    Job Description:About Our Organization:Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 130 years and today has one of the world's largest...