Senior Cloudera Administrator SME with Cloudera Data Platform

4 weeks ago

Alexandria, United States Cubicle Logic LLC Full time
Job DescriptionJob Description

Senior Cloudera Administrator/Infrastructure SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud)

Role & Responsibilities:

 Will be responsible for the administration of Cloudera CDP on-prem and cloud infrastructure.

  • Leverage the CDP features to build the cloud-hybrid infrastructure for CDP (CDP Public Cloud).
  • Independently installs and maintains Big Data (Cloudera) clusters in high available, load balanced configuration across multiple (Production, QA and Development) environments in both on-prem and Cloud (AWS) environment.
  • Implement the Knox and Kerberos for Cluster security and integrate with enterprise and cloud IAM.
  • Develop scripts to automate and streamline operations and configuration
  • Manage and automate the installation process (use tools like Ansible) for CDP Manager, CDH, and the ecosystem projects. Activities include : Set up a local CDH repository; Perform OS-level configuration for Hadoop installation; Install Cloudera Manager server and agents; Install CDH using Cloudera Manager; Add a new node to an existing cluster; Add a service using Cloudera Manager
  • Schedule the jobs using Apache Nifi or Air flow
  • Analyze, recommend and implement improvements to support environment/infrastructure management initiatives. Configure - Perform basic and advanced configuration needed to effectively administer a Hadoop cluster on-prem and on-cloud. Activities include :  Configure a service using Cloudera Manager; Create an HDFS user's home directory; Configure NameNode HA; Configure ResourceManager HA; Configure proxy for Hiveserver2/Impala
  • Maintain and modify the cluster to support day-to-day operations in the enterprise. Activities include : Rebalance the cluster; Set up alerting for excessive disk fill; Define and install a rack topology script; Install new type of I/O compression library in cluster; Revise YARN resource assignment based on user feedback; Commission/decommission a node
  • Enable relevant services and configure the cluster to meet goals defined by security policies, Activities include: Configure HDFS ACLs; Install and configure Sentry; Configure Hue user authorization and authentication; Enable/configure log and query redaction; Create encrypted zones in HDFS
  • Benchmark the cluster operational metrics, test system configuration for operation and efficiency. Activities include: Efficiently copy data within a cluster/between clusters; Create/restore a snapshot of an HDFS directory; Get/set ACLs for a file or directory structure; Benchmark the cluster (I/O, CPU, network)
  • Under general supervision, manage Big Data Administration activities, technical documentation, system performance support, and internal customer support. May provide input into the development of Systems Architecture for mission critical corporate development projects.
  • Research performance issues, configuring the cluster with Cloudera best practices, optimizing specifications and parameters to fine-tune and proactively avoid performance issues

Skills:

  • Must be Cloudera Certified Hadoop and/or Spark Administrator
  • Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration.
  • Must have infrastructure implementation experience on on-prem and Cloud (AWS).
  • Must have knowledge on CDP Containers and integration of on-prem clusters with Cloud clusters.
  • Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc
  • Must have knowledge on Cloudera SDX, Cloudera Public Cloud and Private Cloud infrastructures.
  • Experience administrating distributed applications: Hadoop, Spark, Kafka, Map Reduce, Hive, Impala
  • Experience with large-scale high-performance distributed systems like Hadoop, NoSQL or Spark
  • Assist in preparing and scaling the cluster as required to execute mission critical data processing processes
  • Experience with setting up and configuring the YARN queues using the YARN queue manager

·      Deep understanding of IP, TCP, UDP, SSL/TLS protocols

  • Experience with Devops, scripting or other automation
  • Experience with Performance monitoring and tuning
  • Hadoop Cluster maintenance as well as creation and removal of nodes
  • Working knowledge of Networks, Linux OS and Unix Shell Scripting • Understanding working authorization mechanism for Ranger / Sentry
  • Systems implementation, operations, and its optimization as Hadoop Admin
  • Demonstrate ability to find the root cause of a problem in Spark/HDFS and CDP clusters, optimize inefficient execution, and resolve resource contention scenarios; Resolve errors/warnings in Cloudera Manager; Resolve performance problems/errors in cluster operation;Determine reason for application failure; Configure the Fair Scheduler to resolve application delays
  • Experience on Cloudera Data Science Workbench and Cloudera Data Flow products.
  • Experience working with Systems Operation Department in resolving variety of infrastructure issues

  • Peoplesoft ERP Systems SME

    7 days ago

    Alexandria, United States Cordia Resources by Cherry Bekaert Full time

    Cordia Resources by Cherry Bekaert has partnered with a public organization that is searching for a Peoplesoft ERP Systems SME for a long term contract in their corporate offices in Alexandria, Va. Responsible experience in systems analysis, setup and production support in PeopleSoft applications. Should have minimum 5 years' experience in PeopleSoft...

  • Peoplesoft ERP Systems SME

    5 days ago

    Alexandria, United States Cordia Resources by Cherry Bekaert Full time

    Cordia Resources by Cherry Bekaert has partnered with a public organization that is searching for a Peoplesoft ERP Systems SME for a long term contract in their corporate offices in Alexandria, Va. Responsible experience in systems analysis, setup and production support in PeopleSoft applications. Should have minimum 5 years' experience in PeopleSoft...

  • Peoplesoft ERP Systems SME

    5 days ago

    Alexandria, United States Cordia Resources by Cherry Bekaert Full time

    Cordia Resources by Cherry Bekaert has partnered with a public organization that is searching for a Peoplesoft ERP Systems SME for a long term contract in their corporate offices in Alexandria, Va.Responsible experience in systems analysis, setup and production support in PeopleSoft applications.Should have minimum 5 years’ experience in PeopleSoft Absence...

  • Peoplesoft ERP Systems SME

    6 days ago

    Alexandria, United States Cordia Resources by Cherry Bekaert Full time

    Cordia Resources by Cherry Bekaert has partnered with a public organization that is searching for a Peoplesoft ERP Systems SME for a long term contract in their corporate offices in Alexandria, Va.Responsible experience in systems analysis, setup and production support in PeopleSoft applications.Should have minimum 5 years’ experience in PeopleSoft Absence...

  • Peoplesoft ERP Systems SME

    7 days ago

    Alexandria, United States Cordia Resources by Cherry Bekaert Full time

    Cordia Resources by Cherry Bekaert has partnered with a public organization that is searching for a Peoplesoft ERP Systems SME for a long term contract in their corporate offices in Alexandria, Va.Responsible experience in systems analysis, setup and production support in PeopleSoft applications.Should have minimum 5 years’ experience in PeopleSoft Absence...

  • Database Administrator

    5 days ago

    Alexandria, United States Blackstone Talent Group Full time

    Seeking a Database Administrator - F 2 S - FBI to join our Client's team. Seeking a Senior Database Administrator to join our team of experts to assist with building state-of-the-art data platforms for the intelligence community. Responsibilities:Pri Database Administrator, Database, Administrator, Cloud, Operations, Staffing, Security

  • ICBM Maintenance and Sustainment SME

    2 weeks ago

    Alexandria, Virginia, United States Systems Planning and Analysis, Inc. Full time

    Overview: Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and...

  • Network Data Center

    2 days ago

    Alexandria, VA, United States Amazon Data Services, Inc. Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Senior Data Scientist

    2 weeks ago

    Alexandria, United States Gridiron IT Full time

    GridIron IT is seeking a Senior Data Scientist local to Alexandria, VA. Active Secret Clearance is required!! Provide skilled contractor employee(s) that has either prior government experience as an ORSA/1515 or Data Scientist/1560, has completed ORSA-MAC training, or holds a graduate degree in operations research. They will require statistical experience,...

  • ServiceNow Developer Senior

    1 month ago

    Alexandria, United States General Dynamics Information Technology Full time

    Seize your opportunity to make a personal impact as a ServiceNow Developer Senior supporting the GDIT Enterprise. GDIT is your place to make meaningful contributions to challenging projects and grow a rewarding career. At GDIT, people are our differentiator. As a ServiceNow Developer Senior, you will be an important part of our platform support and...

  • Microelectronics Industry SME

    1 week ago

    Alexandria, Virginia, United States Systems Planning and Analysis, Inc. Full time

    Overview: Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit...

  • Sme Web Administrator

    5 days ago

    Alexandria, United States Resolution Think LLC Full time

    The Cognito Team is seeking a Certified Web Administrator Subject Matter Expert with four to six years experience. - Position is contingent upon contract award

  • Sme Web Developer

    5 days ago

    Alexandria, United States Resolution Think LLC Full time

    Position is contingent upon contract award - Excellent communication skills (oral and written) - Ability to communicate on a technical level to various audiences - Required Knowledge, Skills, and Abilities - Capability to implement a web design approach - Develop a plan to redesign existing websites - Ensure work products are correct, adhere to the design...

  • Platform Engineer

    2 weeks ago

    Alexandria, United States Signal Vine Full time

    About Signal Vine Signal Vine, LLC is an exciting early-stage company with customers and revenue which is growing quickly and looking for our next technical hire. We are building an incredible company that helps solve social issues with technology. We recognize that the key to our growth and success is hiring great people. Our ideal candidate for this...

  • Senior Studies and Analysis SME

    2 weeks ago

    Alexandria, Virginia, United States Systems Planning and Analysis, Inc. Full time

    Overview: Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit...

  • Systems Administrator

    2 weeks ago

    Alexandria, United States Unavailable Full time

    Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and...

  • Identity and Access Management SME

    2 weeks ago

    Alexandria, United States Input Technology Solutions Full time

    Input Technology Solutions is seeking an Identity and Access Management Architect to join our team. This position is fully remote within the United States. What You Will Do: Serve as a subject matter expert (SME) on Identity and Access Management (IAM) projects Contribute to evolving the overall strategy and operating model for IAM governance and technology...

  • Identity and Access Management SME

    3 weeks ago

    Alexandria, United States Input Technology Solutions Full time

    Job DescriptionJob DescriptionInput Technology Solutions is seeking an Identity and Access Management Architect to join our team. This position is fully remote within the United States.What You Will Do:Serve as a subject matter expert (SME) on Identity and Access Management (IAM) projectsContribute to evolving the overall strategy and operating model for IAM...

  • Senior Contracts Administrator

    3 weeks ago

    Alexandria, United States JB MANAGEMENT, INC. Full time

    Job DescriptionJob DescriptionJob Title: Senior Pricing & Contracts AdministratorLocation: Alexandria, VA (Hybrid Work Schedule)All candidates must be a US citizen.POSITION OVERVIEW:We are seeking a Senior Contract Administrator with 8-15 years’ experience to perform a full range of contractual responsibilities from proposal development to contract...

  • Data Specialist

    2 weeks ago

    Alexandria, United States Alexandria City Public Schools Full time

    Job Description The Enrichment Program and Graduation Data Specialist provides support to the Director of School Counseling and the School Counseling Department's administrative team of Alexandria City High School. The primary responsibilities are focused in the areas of program management, data analysis, integrity and accuracy of student record data entry,...