Hadoop Administrator

We are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions, LLC.

Key Responsibilities:

• Implement and administer Hadoop infrastructure
• Maintain and troubleshoot clusters, ensuring proper backup and recovery strategies
• Provision and manage the lifecycle of multiple clusters, including EMR and EKS
• Monitor infrastructure, logging, and alerting using Prometheus, Grafana, and Splunk
• Perform performance tuning and capacity planning for Hadoop clusters and workloads
• Manage memory, queue allocation, and distribution in Hadoop/Cloud environments
• Scale clusters in production and maintain 18/5 or 24/5 production environments
• Monitor cluster connectivity and security, file system management, and monitoring
• Investigate and analyze new technical possibilities to reduce complexity and increase business value

Requirements:

• 8-12 years of total experience with at least 5 years of work experience in developing, maintaining, optimizing, and resolving Hadoop clusters
• Strong knowledge of programming languages, including Python, Scala, Java, and debugging skills
• Experience in Hadoop (Map Reduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper, and Oozie/Airflow) and Hadoop security (Kerberos, Knox, TLS)
• Hands-on experience in SQL and NoSQL databases (HBASE) with performance optimization
• Experience in tool integration, automation, and configuration management in GIT and Jira platforms
• Excellent oral and written communication, presentation, analytical, and problem-solving skills