Hadoop Administrator

We are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions. As a Hadoop Admin, you will be responsible for the implementation and ongoing administration of Hadoop infrastructure.

• Implement and maintain Hadoop clusters, ensuring high availability and performance.
• Monitor and troubleshoot Hadoop infrastructure, identifying and resolving issues in a timely manner.
• Provision and manage the life cycle of multiple clusters, including EMR and EKS.
• Implement infrastructure monitoring, logging, and alerting using Prometheus, Grafana, and Splunk.
• Perform performance tuning of Hadoop clusters and workloads, ensuring optimal capacity planning.
• Manage memory, queue allocation, and distribution experience in Hadoop and cloud environments.
• Scale clusters in production and maintain 18/5 or 24/5 production environments.
• Monitor Hadoop cluster connectivity and security, file system management, and monitoring.

• 8-12 years of total experience with at least 5 years of work experience in developing, maintaining, optimizing, and resolving Hadoop clusters.
• Strong knowledge of Linux/Unix OS services, administration, shell, and awk scripting.
• Experience in Hadoop (MapReduce, Hive, Pig, Spark, Kafka, HBase, HDFS, HCatalog, ZooKeeper, and Oozie/Airflow).
• Experience in Hadoop security (Kerberos, Knox, TLS).
• Hands-on experience in SQL and NoSQL databases (HBase) with performance optimization.
• Experience in tool integration, automation, configuration management in GIT and Jira platforms.

• Excellent oral and written communication and presentation skills.
• Analytical and problem-solving skills.