Senior Cloudera Administrator SME with Cloudera Data Platform

4 weeks ago

Alexandria, United States Cubicle Logic LLC Full time
Job DescriptionJob Description

Senior Cloudera Administrator/Infrastructure SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud)

Role & Responsibilities:

 Will be responsible for the administration of Cloudera CDP on-prem and cloud infrastructure.

  • Leverage the CDP features to build the cloud-hybrid infrastructure for CDP (CDP Public Cloud).
  • Independently installs and maintains Big Data (Cloudera) clusters in high available, load balanced configuration across multiple (Production, QA and Development) environments in both on-prem and Cloud (AWS) environment.
  • Implement the Knox and Kerberos for Cluster security and integrate with enterprise and cloud IAM.
  • Develop scripts to automate and streamline operations and configuration
  • Manage and automate the installation process (use tools like Ansible) for CDP Manager, CDH, and the ecosystem projects. Activities include : Set up a local CDH repository; Perform OS-level configuration for Hadoop installation; Install Cloudera Manager server and agents; Install CDH using Cloudera Manager; Add a new node to an existing cluster; Add a service using Cloudera Manager
  • Schedule the jobs using Apache Nifi or Air flow
  • Analyze, recommend and implement improvements to support environment/infrastructure management initiatives. Configure - Perform basic and advanced configuration needed to effectively administer a Hadoop cluster on-prem and on-cloud. Activities include :  Configure a service using Cloudera Manager; Create an HDFS user's home directory; Configure NameNode HA; Configure ResourceManager HA; Configure proxy for Hiveserver2/Impala
  • Maintain and modify the cluster to support day-to-day operations in the enterprise. Activities include : Rebalance the cluster; Set up alerting for excessive disk fill; Define and install a rack topology script; Install new type of I/O compression library in cluster; Revise YARN resource assignment based on user feedback; Commission/decommission a node
  • Enable relevant services and configure the cluster to meet goals defined by security policies, Activities include: Configure HDFS ACLs; Install and configure Sentry; Configure Hue user authorization and authentication; Enable/configure log and query redaction; Create encrypted zones in HDFS
  • Benchmark the cluster operational metrics, test system configuration for operation and efficiency. Activities include: Efficiently copy data within a cluster/between clusters; Create/restore a snapshot of an HDFS directory; Get/set ACLs for a file or directory structure; Benchmark the cluster (I/O, CPU, network)
  • Under general supervision, manage Big Data Administration activities, technical documentation, system performance support, and internal customer support. May provide input into the development of Systems Architecture for mission critical corporate development projects.
  • Research performance issues, configuring the cluster with Cloudera best practices, optimizing specifications and parameters to fine-tune and proactively avoid performance issues

Skills:

  • Must be Cloudera Certified Hadoop and/or Spark Administrator
  • Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration.
  • Must have infrastructure implementation experience on on-prem and Cloud (AWS).
  • Must have knowledge on CDP Containers and integration of on-prem clusters with Cloud clusters.
  • Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc
  • Must have knowledge on Cloudera SDX, Cloudera Public Cloud and Private Cloud infrastructures.
  • Experience administrating distributed applications: Hadoop, Spark, Kafka, Map Reduce, Hive, Impala
  • Experience with large-scale high-performance distributed systems like Hadoop, NoSQL or Spark
  • Assist in preparing and scaling the cluster as required to execute mission critical data processing processes
  • Experience with setting up and configuring the YARN queues using the YARN queue manager

·      Deep understanding of IP, TCP, UDP, SSL/TLS protocols

  • Experience with Devops, scripting or other automation
  • Experience with Performance monitoring and tuning
  • Hadoop Cluster maintenance as well as creation and removal of nodes
  • Working knowledge of Networks, Linux OS and Unix Shell Scripting • Understanding working authorization mechanism for Ranger / Sentry
  • Systems implementation, operations, and its optimization as Hadoop Admin
  • Demonstrate ability to find the root cause of a problem in Spark/HDFS and CDP clusters, optimize inefficient execution, and resolve resource contention scenarios; Resolve errors/warnings in Cloudera Manager; Resolve performance problems/errors in cluster operation;Determine reason for application failure; Configure the Fair Scheduler to resolve application delays
  • Experience on Cloudera Data Science Workbench and Cloudera Data Flow products.
  • Experience working with Systems Operation Department in resolving variety of infrastructure issues

  • Army Data and Analytics Platform Effort

    4 months ago

    Alexandria, United States UIC Alaska Full time

    Overview ARMY DATA, ANALYTICS PLATFORM (ARDAP): Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter experts and IT professionals advising executive level personnel on financial,...

  • Data Modeling Expert

    4 weeks ago

    Alexandria, Virginia, United States LIGHTFEATHER IO LLC Full time

    Job DescriptionWe are seeking a highly skilled Data Modeling SME with expertise in Databricks, Tableau, GA4, Looker Reporting Tool, and PowerBI to support our data-driven initiatives. The ideal candidate will have a strong background in developing and documenting data models that support predictive models and AI solutions, utilizing advanced tools like Erwin...

  • Riverbed Aternity Subject Matter Expert SME Engineer

    4 weeks ago

    Alexandria, Virginia, United States Swish Full time

    Job Title: Aternity SME Engineer for IT Performance OptimizationWe are seeking a talented Riverbed Aternity Subject Matter Expert (SME) to join our Professional Services team at Swish Data. As the subject matter expert, you will design, implement, manage, configure, and optimize Riverbed Aternity and other Customer Experience solutions for a major DoD...

  • Data and Analytics Platform Manager

    1 month ago

    Alexandria, Virginia, United States UIC Technical Services Full time

    OverviewUIC Technical Services is seeking a highly skilled professional to manage the Army Data and Analytics Platform (ARDAP) effort in the Washington, DC/Northern Virginia region. This is a fast-paced role that involves managing subject matter experts and IT professionals advising executive-level personnel on financial, technical, and other high-level...

  • Senior Cybersecurity Systems Engineer SME

    3 months ago

    Alexandria, United States Modern Technology Solutions Inc Full time

    Overview Own Your Future. Modern Technology Solutions, Inc. (MTSI) is seeking a Senior Cybersecurity Systems Engineer SME to join our team. You will provide security engineering, assessment, and weapon systems security oversight activities that support complex weapon systems. Why is MTSI known as a Great Place to Work? Interesting Work: Our co-workers...

  • Senior Cybersecurity Systems Engineer SME

    4 weeks ago

    Alexandria, Virginia, United States Modern Technology Solutions Inc Full time

    Job Title: Senior Cybersecurity Systems Engineer SMEModern Technology Solutions, Inc. (MTSI) is seeking a highly skilled Senior Cybersecurity Systems Engineer SME to provide security engineering, assessment, and weapon systems security oversight activities that support complex weapon systems.This position will provide direct security engineering support to...

  • Cloud Data Architect

    4 weeks ago

    Alexandria, United States JobGet Staffing Full time

    Synectics is seeking a Cloud Data Architect to join our growing team. The qualified applicant will lead the implementation of Cloud solutions, emerging technologies, and innovation initiatives for Enterprise Data Analytics and Services at a federal agency. This is a Hybrid position, and must be able to work onsite in Alexandria, VA, as needed. Position...

  • Cloud Data Architect

    4 weeks ago

    Alexandria, United States JobGet Staffing Full time

    Synectics is seeking a Cloud Data Architect to join our growing team. The qualified applicant will lead the implementation of Cloud solutions, emerging technologies, and innovation initiatives for Enterprise Data Analytics and Services at a federal agency. This is a Hybrid position, and must be able to work onsite in Alexandria, VA, as needed. Position...

  • Army Data and Analytics Platform Effort

    6 months ago

    Alexandria, United States UIC Technical Services Full time

    Overview ARMY DATA, ANALYTICS PLATFORM (ARDAP): Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter experts and IT professionals advising executive level personnel on financial,...

  • Senior Contracts Administrator

    4 weeks ago

    Alexandria, Virginia, United States Human Resources Research Organization Full time

    Job Title: Senior Contracts AdministratorAt the Human Resources Research Organization, we are seeking an experienced Senior Contracts Administrator to join our team. As a key member of our contracting team, you will be responsible for administering assigned contracts and subcontracts, ensuring compliance with prime contract requirements, and providing...

  • ServiceNow Platform Specialist

    3 weeks ago

    Alexandria, Virginia, United States LIGHTFEATHER IO LLC Full time

    Job DescriptionLightFeather IO LLC is seeking a highly skilled ServiceNow Administrator and Developer to join their team. The successful candidate will be responsible for the administration, supervision, service, operational, and maintenance of the DHS ServiceNow environment, which integrates with other systems such as Active Directory, JIRA, and more.This...

  • Exchange Systems Administrator

    4 weeks ago

    Alexandria, Virginia, United States Leidos Full time

    Job Title: Exchange Systems AdministratorJob Summary:Leidos is seeking an experienced Exchange Systems Administrator to support a large enterprise IT contract for the DOD. As an Exchange SME, you will be responsible for administering Exchange and email retention systems within a physical and virtual server environment.Key Responsibilities:Examine incidents...

  • Senior Systems Administrator

    4 weeks ago

    Alexandria, Virginia, United States Optomi Full time

    Job SummaryOptomi, in partnership with a non-profit organization, is seeking a Senior Systems Administrator for their location. This role will be responsible for leading technical support of the Microsoft 365 SharePoint infrastructure, all 365 applications, and Azure environments. The ideal candidate will have extensive experience with SharePoint/Teams...

  • Senior Financial Analyst

    4 weeks ago

    Alexandria, Virginia, United States Koniag Data Solutions, LLC Full time

    Job Summary:Koniag Data Solutions, LLC is seeking a Senior Financial Analyst to support our government customer in Alexandria, VA. The ideal candidate will have at least nine years of experience in budgeting, financial management, and government accounting, with a strong understanding of the federal budget formulation and execution process.Key...

  • Cloud Data Architect

    4 weeks ago

    Alexandria, VA, United States JobGet Staffing Full time

    Synectics is seeking a Cloud Data Architect to join our growing team. The qualified applicant will lead the implementation of Cloud solutions, emerging technologies, and innovation initiatives for Enterprise Data Analytics and Services at a federal agency. This is a Hybrid position, and must be able to work onsite in Alexandria, VA, as needed. Position...

  • Senior Manager, Information Systems and Data Governance

    4 weeks ago

    Alexandria, Virginia, United States Pharmacy Quality Alliance Careers Full time

    Job Overview:The Senior Manager, Information Systems and Data Governance will oversee the organization's information systems, ensuring robust data governance practices, establishing/maintaining information security, and managing a diverse portfolio of IT projects. This role is pivotal in supporting the organization's strategic objectives through effective...

  • Senior Manager, Information Systems and Data Governance

    4 weeks ago

    Alexandria, United States Pharmacy Quality Alliance Careers Full time

    POSITION OVERVIEW: The Senior Manager, Information Systems and Data Governance is responsible for overseeing the organization's information systems, ensuring robust data governance practices, establishing/maintaining information security, and managing a diverse portfolio of IT projects. This role is pivotal in supporting the organization’s strategic...

  • Senior Manager, Information Systems and Data Governance

    4 weeks ago

    Alexandria, United States Pharmacy Quality Alliance Careers Full time

    POSITION OVERVIEW: The Senior Manager, Information Systems and Data Governance is responsible for overseeing the organization's information systems, ensuring robust data governance practices, establishing/maintaining information security, and managing a diverse portfolio of IT projects. This role is pivotal in supporting the organization’s strategic...

  • Senior Manager, Information Systems and Data Governance

    4 weeks ago

    Alexandria, United States Pharmacy Quality Alliance Full time

    POSITION OVERVIEW: The Senior Manager, Information Systems and Data Governance is responsible for overseeing the organization's information systems, ensuring robust data governance practices, establishing/maintaining information security, and managing a diverse portfolio of IT projects. This role is pivotal in supporting the organization’s strategic...

  • Senior Manager, Information Systems and Data Governance

    4 weeks ago

    Alexandria, United States Pharmacy Quality Alliance Careers Full time

    POSITION OVERVIEW: The Senior Manager, Information Systems and Data Governance is responsible for overseeing the organization's information systems, ensuring robust data governance practices, establishing/maintaining information security, and managing a diverse portfolio of IT projects. This role is pivotal in supporting the organization’s strategic...