Hadoop Administrator

1 month ago

Austin, United States Diligent Tec, Inc Full time

Job Title: Hadoop Administrator

Location: Hybrid (Twice a week)- Austin, TX

Experience: 12+ Yrs.

Position Type: Contract (Long Term)


Job Summary:

We are seeking an experienced Hadoop Administrator to join our dynamic IT team. The ideal candidate will be responsible for managing and overseeing our Hadoop-based environments, ensuring optimal performance, reliability, and security.


Key Responsibilities:

  • Install, configure, and maintain Hadoop clusters, ensuring high availability and performance1.
  • Monitor system performance and health, making adjustments as necessary to ensure efficient operations.
  • Manage Hadoop ecosystem components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and HBase.
  • Perform data extraction, ingestion, and transformation using tools like Sqoop and Flume.
  • Implement security measures, including Kerberos integration, to protect data integrity and access.
  • Collaborate with development teams to assist with data-related technical issues and support their data infrastructure needs.
  • Conduct regular system backups and recovery operations to prevent data loss.
  • Stay current with industry best practices and implement them within the organization.


Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Hadoop Administrator or similar role.
  • Strong understanding of Hadoop ecosystem and its components.
  • Experience with Linux-based infrastructures and cloud services (AWS, Azure).
  • Knowledge of scripting languages such as Shell, Python, or Perl.
  • Excellent problem-solving and troubleshooting skills.
  • Effective communication and collaboration abilities.


Preferred Skills:

  • Certifications in Hadoop technologies (Cloudera, Hortonworks).
  • Experience with NoSQL databases and BI tools (Power BI, Tableau).
  • Familiarity with network administration and performance tuning.

  • Hadoop Admin

    4 weeks ago

    Austin, United States Diamond Pick Full time

    Sr. DeveloperJob summaryExperience : 6 to 10yrsRequired Skills - Apache HadoopNice to have skills - Shell scripting, Python, Hive,Apache Sentry,Impala,Hadoop Administration,Delivery Management,Risk Management,Project Stakeholder Management,Cloudera Data Platform,Hadoop\Big Data AdminWe are seeking a Sr. Developer (Sr. Associate - Projects) with 6-10 years of...

  • Staff Site Reliability Engineer Hadoop Administration

    3 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Big Data Platform Administration

    1 month ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Big Data Platform Administration

    2 weeks ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Big Data Platform Administration

    2 weeks ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Snowflake Admin

    3 weeks ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Snowflake Admin

    7 days ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Snowflake Admin

    6 days ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Staff Site Reliability Engineer

    2 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Staff Site Reliability Engineer

    2 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Solution Architect

    2 weeks ago

    Austin, United States Highering LLC Full time

    Solution Architect – cloud platforms ((PaaS and SaaS) Design, Architect, and Implement next-generation system architecture and automation solutions on cloud platforms. Design, Implement and improve Continuous Integration and Continuous Delivery Environments. Architect and improve our growing application deployment on the cloud platform (PaaS & SaaS). Act...

  • IT-Sr Architecture

    2 weeks ago

    Austin, United States Saxon Global Full time

    Team Info: The team comprises of 1 Product Lead and 2-3 developers. The role would involve interacting with Data Science and BI team plus other application teams during the course of development. Day to Day: The candidate will be supporting big data application development on Hadoop and Cloud platforms, DevOps and snowflake data warehousing supporting...

  • Data Analyst II

    2 months ago

    Austin, United States Gateway Recruiting, INC. Full time

    Job DescriptionJob DescriptionSummary:This role is looking for a highly motivated and dedicated Data Science and Visualization specialist to support the Video QC & Compliance and Metadata Operations teams’ data analytics and science needs. In this role, a primary focus is on the Company’s growing Video Operations through content- and user-centric data...

  • Sr. Manager, Sales Compensation Business Systems

    2 days ago

    Austin, United States Visa Full time

    Job DescriptionThe Sr. Manager, Global Sales Compensation Business Systems Lead role is a unique opportunity that calls for a skilled, hands-on, analytical leader who will lead all activities related to incentive system: vendor management, system development, operations, reporting, and support. This role is part entrepreneur, part product manager, and part...

  • Sr. Manager, Sales Compensation Business Systems

    2 weeks ago

    Austin, United States Visa Full time

    Job DescriptionJob DescriptionCompany DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative,...