Hadoop Administrator

3 weeks ago


Austin, United States Diligent Tec, Inc Full time

Job Title: Hadoop Administrator

Location: Hybrid (Twice a week)- Austin, TX

Experience: 12+ Yrs.

Position Type: Contract (Long Term)


Job Summary:

We are seeking an experienced Hadoop Administrator to join our dynamic IT team. The ideal candidate will be responsible for managing and overseeing our Hadoop-based environments, ensuring optimal performance, reliability, and security.


Key Responsibilities:

  • Install, configure, and maintain Hadoop clusters, ensuring high availability and performance1.
  • Monitor system performance and health, making adjustments as necessary to ensure efficient operations.
  • Manage Hadoop ecosystem components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and HBase.
  • Perform data extraction, ingestion, and transformation using tools like Sqoop and Flume.
  • Implement security measures, including Kerberos integration, to protect data integrity and access.
  • Collaborate with development teams to assist with data-related technical issues and support their data infrastructure needs.
  • Conduct regular system backups and recovery operations to prevent data loss.
  • Stay current with industry best practices and implement them within the organization.


Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Hadoop Administrator or similar role.
  • Strong understanding of Hadoop ecosystem and its components.
  • Experience with Linux-based infrastructures and cloud services (AWS, Azure).
  • Knowledge of scripting languages such as Shell, Python, or Perl.
  • Excellent problem-solving and troubleshooting skills.
  • Effective communication and collaboration abilities.


Preferred Skills:

  • Certifications in Hadoop technologies (Cloudera, Hortonworks).
  • Experience with NoSQL databases and BI tools (Power BI, Tableau).
  • Familiarity with network administration and performance tuning.

  • Hadoop Admin

    2 weeks ago


    Austin, United States Diamond Pick Full time

    Sr. DeveloperJob summaryExperience : 6 to 10yrsRequired Skills - Apache HadoopNice to have skills - Shell scripting, Python, Hive,Apache Sentry,Impala,Hadoop Administration,Delivery Management,Risk Management,Project Stakeholder Management,Cloudera Data Platform,Hadoop\Big Data AdminWe are seeking a Sr. Developer (Sr. Associate - Projects) with 6-10 years of...


  • Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...


  • Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Snowflake Admin

    6 days ago


    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Data Analyst II

    1 month ago


    Austin, United States Gateway Recruiting, INC. Full time

    Job DescriptionJob DescriptionSummary:This role is looking for a highly motivated and dedicated Data Science and Visualization specialist to support the Video QC & Compliance and Metadata Operations teams’ data analytics and science needs. In this role, a primary focus is on the Company’s growing Video Operations through content- and user-centric data...