See more Collapse

Hadoop Administrator

1 month ago

Austin, United States Diligent Tec, Inc Full time

Job Title: Hadoop Administrator

Location: Hybrid (Twice a week)- Austin, TX

Experience: 12+ Yrs.

Position Type: Contract (Long Term)


Job Summary:

We are seeking an experienced Hadoop Administrator to join our dynamic IT team. The ideal candidate will be responsible for managing and overseeing our Hadoop-based environments, ensuring optimal performance, reliability, and security.


Key Responsibilities:

  • Install, configure, and maintain Hadoop clusters, ensuring high availability and performance1.
  • Monitor system performance and health, making adjustments as necessary to ensure efficient operations.
  • Manage Hadoop ecosystem components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and HBase.
  • Perform data extraction, ingestion, and transformation using tools like Sqoop and Flume.
  • Implement security measures, including Kerberos integration, to protect data integrity and access.
  • Collaborate with development teams to assist with data-related technical issues and support their data infrastructure needs.
  • Conduct regular system backups and recovery operations to prevent data loss.
  • Stay current with industry best practices and implement them within the organization.


Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Hadoop Administrator or similar role.
  • Strong understanding of Hadoop ecosystem and its components.
  • Experience with Linux-based infrastructures and cloud services (AWS, Azure).
  • Knowledge of scripting languages such as Shell, Python, or Perl.
  • Excellent problem-solving and troubleshooting skills.
  • Effective communication and collaboration abilities.


Preferred Skills:

  • Certifications in Hadoop technologies (Cloudera, Hortonworks).
  • Experience with NoSQL databases and BI tools (Power BI, Tableau).
  • Familiarity with network administration and performance tuning.

We have other current jobs related to this field that you can find below

  • Hadoop Administrator

    4 days ago

    Austin, United States Kaygen Full time

    KAYGEN is an emerging leader in providing top talent for technology based staffing services. We specialize in providing high-volume contingent staffing, direct hire staffing and project based solutions to companies worldwide ranging from startups to Fortune and Managed Service Providers (MSP) across a wide variety of industries Role: Hadoop Administrator...

  • Hadoop/Bigdata Admin

    5 days ago

    Austin, United States Diverse Lynx Full time

    Job Title: Bigdata Admin Location: ustin TX - USA Duration: Full Time Required Skills: Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL - 9+ Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Staff Site Reliability Engineer Hadoop Administration

    4 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Big Data Platform Administration

    3 weeks ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Big Data Platform Administration

    1 month ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Big Data Platform Administration

    3 weeks ago

    Austin, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Big Data Platform Administration

    5 days ago

    Austin, Texas, United States Diverse Lynx Full time

    Role: Big Data Platform Administration Location: Austin, TX/ Dallas, TX (Onsite) Contract Skills - Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX Scripting CICD: Ansible, Platform Support, ITSM tools knowledge, ITIL 2 12 Years of IT experience in Big Data, Hadoop platform management & min 2 years experience in Big Data platform...

  • Snowflake Admin

    4 weeks ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Snowflake Admin

    2 weeks ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Snowflake Admin

    2 weeks ago

    Austin, United States Saxon Global Full time

    Must Have Experience: airflow Basic python knowledge, who can build airflow dags. Manage and monitor the jobs snowflake Manage and maintain - snowflake administration,config,managing roles and access controls terraforms Automation of infrastructure components using terraform SQL server Manage,administration of CDC and migration process Monitor...

  • Staff Site Reliability Engineer

    9 hours ago

    Austin, United States Currency Cloud Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Staff Site Reliability Engineer

    3 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Staff Site Reliability Engineer

    3 weeks ago

    Austin, United States Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Solution Architect

    3 weeks ago

    Austin, United States Highering LLC Full time

    Solution Architect – cloud platforms ((PaaS and SaaS) Design, Architect, and Implement next-generation system architecture and automation solutions on cloud platforms. Design, Implement and improve Continuous Integration and Continuous Delivery Environments. Architect and improve our growing application deployment on the cloud platform (PaaS & SaaS). Act...

  • Solution Architect

    5 days ago

    Austin, Texas, United States Highering LLC Full time

    Solution Architect – cloud platforms ((PaaS and SaaS) Design, Architect, and Implement next-generation system architecture and automation solutions on cloud platforms. Design, Implement and improve Continuous Integration and Continuous Delivery Environments. Architect and improve our growing application deployment on the cloud platform (PaaS & SaaS). Act...

  • Data Engineer

    24 hours ago

    Austin, United States eTeam Inc Full time

    Summary Client Media Products (AMP) Video QC & Metadata Operations teams are looking for a highly motivated and dedicated DataDev Specialist to support AMP Video QC & Compliance and UMC (Universal Media Content) Metadata teams’ data and analytics needs. In this role, a primary focus is on Client’s growing Video Operations through content-centric data...

  • IT-Sr Architecture

    3 weeks ago

    Austin, United States Saxon Global Full time

    Team Info: The team comprises of 1 Product Lead and 2-3 developers. The role would involve interacting with Data Science and BI team plus other application teams during the course of development. Day to Day: The candidate will be supporting big data application development on Hadoop and Cloud platforms, DevOps and snowflake data warehousing supporting...

  • Software Engineer

    24 hours ago

    Austin, United States H-E-B Full time

    Responsibilities H-E-B Digital is seeking new team members (Partners)! Since our inception, we've been investing heavily in our customers' digital experience, reinventing how they find inspiration from food, how they make food decisions, and how they ultimately get food into their homes. This is an exciting time to join H-E-B Digital, and we're...

  • Sr. Manager, Sales Compensation Business Systems

    1 week ago

    Austin, United States Visa Full time

    Job DescriptionThe Sr. Manager, Global Sales Compensation Business Systems Lead role is a unique opportunity that calls for a skilled, hands-on, analytical leader who will lead all activities related to incentive system: vendor management, system development, operations, reporting, and support. This role is part entrepreneur, part product manager, and part...

  • Sr. Manager, Sales Compensation Business Systems

    3 weeks ago

    Austin, United States Visa Full time

    Job DescriptionJob DescriptionCompany DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative,...