Hadoop Systems Administrator

3 weeks ago

Oklahoma City, United States ndoiljobs Full time

                    Preview JOB SUMMARY

As a Hadoop Systems Administrator, you will be responsible for daily operations and maintenance of IT systems centering around Continental’s big data platform. You will be required to keep these IT systems maintained and optimized through daily, weekly, and monthly system tuning and periodic system maintenance.  Day-to-day operations will require interfacing with other IT departments, developers and project management. Manage testing and implementation of upgrades and changes to supported systems following change control processes.

DUTIES/RESPONSIBILITIES

  • Day to Day maintenance activities including but not limited to Log monitoring and cleanup, Cluster monitoring, deployments, production support and performance tuning
  • Install, configure, monitor, tune, and troubleshoot all components of the CDH environments, including but not limited to, Cloudera Manager, Cloudera Management Services, HDFS, YARN, Zookeeper, Hive, Spark, Sprak Streaming, Hue, Kudu, Impala, HBase, Key Management Server, Kafka, Flume, Solr, SSL, Sqoop, and Sentry
  • Build, Tune and administer Search and Index frameworks like Solr and Elastic Search
  • Build, Tune and administer HBase cluster in multiple environments
  • Design, Document, Develop, Unit Test and Deploy scripts for automating cluster patching, application upgrades, Application deployments using UNIX and Java in multiple environments
  • Automate daily administrative tasks to guarantee high availability of systems, applications and data
  • Troubleshoot issues with applications, services and clusters in multiple environments
  • Implement and administer Active-Active cluster configuration for Disaster Recovery
  • Manage cluster hardening activities with security implementation to enforce data governance for the data accessed by data scientists and analysts using Sentry and LDAP integration
  • Performance tune cluster services in multiple environments
  • Capacity planning for cluster upgrades
  • Setup Monitoring and Alerting for applications and services on the clusters using tools like Splunk and Grafana
  • Automate data and log backups and archival
  • Automate log analysis and setup alerting
  • Build, Maintain and administer clusters to support highly available and fast real-time streaming applications
  • Daily communication with Business and Technical teams to understand the needs and build, maintain and support environments that help solve the use cases
  • Cluster patching activities
  • Cluster upgrades when required
  • Other duties assigned

SKILLS

  • Excellent knowledge of Linux (Redhat Preferred)
  • Deep understanding of Hadoop and Spark cluster security, networking connectivity and IO throughput along with other factors that affect distributed system performance
  • Strong working knowledge of disaster recovery, incident management, and security best practices
  • Working knowledge of containers (e.g., docker) and major orchestrators (e.g., Mesos, Kubernetes, Docker Datacenter)
  • Working knowledge of automation tools (e.g., Puppet, Chef, Ansible)
  • Working knowledge of software defined networking
  • Working knowledge of parcel based upgrades with Hadoop (i.e., Cloudera)
  • Working knowledge of hardening Hadoop with Kerberos, TLS, and HDFS encryption
  • Ability to quickly perform critical analysis and use creative approaches for solving complex problems
  • Excellent written and verbal communication skills

QUALIFICATIONS

  • Bachelor’s degree from an accredited college/university in Computer Science, Computer Engineering, or related field and minimum four years of big data experience with multiple programming languages and technologies
  • Understanding of cloud and distributed systems principles, including load balancing, networks, scaling, in-memory vs. disk, etc.; and experience with large-scale, big data methods, such as MapReduce, Hadoop, Spark, Hive, Impala, or Storm
  • Ability to work efficiently under Unix/Linux environment or .NET, with experience with source code management systems like GIT
  • Ability to work with team members and clients to assess needs, provide assistance, and resolve problems, using excellent problem-solving skills, verbal/written communication, and the ability to explain technical concepts to business people
  • An acceptable pre-employment background and drug test

  • Hadoop L-2 Support Admin

    3 weeks ago

    Texas City, United States Diverse Lynx Full time

    Hadoop L-2 Support / Dev Ops - Senior / Austin / 3 Hadoop/Big data administrator: Monitor the Hadoop platforms and debug both platform and application issues. Should be able to Automate manual tasks via ansible or Python Knowledge on HBase is plus. Should have good Hadoop issue debugging skills. Position is hybrid and will require the resource to work from...

  • Hadoop developer

    2 months ago

    Texas City, United States Logging-in Full time

    We are looking for a Big Data Engineer that will work on the collecting storing processing and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes then maintaining implementing and monitoring them. You will also be responsible for integrating them with the architecture used across the...

  • Lead Hadoop Admin-Foster City, CA,

    2 weeks ago

    Foster City, United States Georgia IT Inc Full time

    Lead Hadoop Admin Foster City, CA, (Onsite from Day 1) Max Rate: DOE Interview Process: 3 Rounds of Zoom Video Interview USC & GC Preferred. No Third-party C2C available for this job Job Description Responsible for implementation and ongoing administration of Hadoop infrastructure. Responsible for Cluster maintenance, trouble shooting,...

  • Hadoop Application Support specialist

    2 days ago

    Jersey City, United States Syntricate Technologies Inc Full time

    Role: Hadoop Application Support specialist Location: Pennington, TX / Jersey City, NJ Rate: w2 Fulltime Position Summary: Hadoop Application Support specialist able to work in one or more than one applications in the hadoop data lake Able to support the existing Hadoop applications. Able to support the application in rotating shifts (24x7)....

  • Systems Administrator

    5 days ago

    Oklahoma City, Oklahoma, United States General Dynamics Information Technology Full time

    Req ID: RQ173875Type of Requisition: RegularClearance Level Must Be Able to Obtain: NoneJob Family: Systems AdministrationSkills:Computer Systems,Hardware Systems,Operating Systems (OS)Certifications:Security+, CE - comp tia, Network Plus - comp tiaExperience:4 + years of related experienceUS Citizenship Required:YesJob Description:Unified Communications...

  • Systems Administrator

    5 days ago

    Oklahoma City, Oklahoma, United States GENERAL DYNAMICS INFORMATION TECHNOLOGY Full time

    Unified Communications Systems AdministratorTransform technology into opportunity as a Unified Communications Systems Administrator with GDIT. A career in enterprise IT means connecting and enhancing the systems that matter most. At GDIT you'll be at the forefront of innovation and play a meaningful part in improving how agencies operate.At GDIT, people are...

  • System Engineer

    4 days ago

    Oklahoma City, United States Albano Systems Full time

    A Systems Engineer is responsible for supporting equipment in a Microsoft Windows environment, from design through implementation and support. A System Engineer performs a wide variety of installation, configuration and upgrading of workstations, servers and related hardware and software in a LAN, WAN and stand-alone environment. A System Engineer provides...

  • Systems Administrator

    2 weeks ago

    Salt Lake City, United States Quality Electrical Systems Full time

    Job DescriptionJob DescriptionWe are looking for an outgoing and dynamic Systems Administrator to contribute to the successful administration, operation, and support of business-critical application and network business environments. The Systems Administrator is responsible for the collaborative maintenance of, and overseeing the management and...

  • System Administrator

    5 days ago

    Oklahoma City, United States Inceed Full time

    Compensation: $28-33hr Location: Woodward, OK System Administrator: Inceed has partnered with a great company to help find a skilled Sytem Administrator to join their team! Responsibilities: Complete service requests and incidents Develop and maintain knowledge articles Montior service availability (email, backup, Sharepoint, File...

  • Power System Administrator

    2 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte (South), NC Full time

    Job DescriptionJob DescriptionJob Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM...

  • Power System Administrator

    2 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte, NC Full time

    Job Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM Power i/ISA Power 9 and Power 10...

  • Power System Administrator

    2 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte, NC Full time

    Job Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM Power i/ISA Power 9 and Power 10...

  • Power System Administrator

    2 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte, NC Full time

    Job Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM Power i/ISA Power 9 and Power 10...

  • System Administrator

    3 days ago

    Atlantic City, United States A3 Technology, Inc. Full time

    Job DescriptionJob DescriptionSalary: A3 Technology, Inc. is seeking a senior level System Administrator to join our team in Egg Harbor Township, NJ. This position will support software maintenance, integration and installation of multiple complex computer systems across the enterprise.Essential Job Functions:Multitask on the following:Upgrade multiple...

  • Unix Systems Administrator

    5 days ago

    Oklahoma City, United States Diligent Consulting Full time

    Diligent Consulting is searching for a full-time Unix Systems Administrator to join our team. The qualified candidate will be responsible for day-to-day operation of various severs including hardware/software support, and special projects. About Us: Diligent Consulting, Inc. is a Service Disabled Veteran Owned Small Business (SDVOSB) focused on...

  • Senior System Administrator

    3 days ago

    Oklahoma City, United States Claims Management Resources Inc Full time

    Who We Are:We are in the business of subrogation - companies trust us to recover payments on damage claims so that the party responsible is the one paying for the damage that was caused. We strive to provide excellent customer service to both our customers and the other parties involved in a claim. In short, we help our customers focus on theirs.Our business...

  • Senior System Administrator

    3 days ago

    Oklahoma City, United States Claims Management Resources Inc Full time

    Who We Are:We are in the business of subrogation – companies trust us to recover payments on damage claims so that the party responsible is the one paying for the damage that was caused. We strive to provide excellent customer service to both our customers and the other parties involved in a claim. In short, we help our customers focus on theirs.Our...

  • Senior System Administrator

    2 days ago

    Oklahoma City, United States Claims Management Resources Inc Full time

    Who We Are:We are in the business of subrogation - companies trust us to recover payments on damage claims so that the party responsible is the one paying for the damage that was caused. We strive to provide excellent customer service to both our customers and the other parties involved in a claim. In short, we help our customers focus on theirs.Our business...

  • Bank Ops Systems Administrator

    2 weeks ago

    Oklahoma City, United States MidFirst Bank Full time

    A Bank Operations Systems Admin is responsible for executing the critical technical tasks that are integral in the overall Bank Operations workflow. The incumbent will also provide a wide array of technical assistance with regards to 3rd party applications utilized in the support of paper check processing for Bank Operations and Retail locations. Job...

  • PKI Systems Administrator

    1 month ago

    Oklahoma City, United States Agil3 Technology Solutions (A3T) Full time

    Job DescriptionJob DescriptionA3T Public Key Infrastructure (PKI) Systems Administrator provides support in the execution of application support, security, and administration to DISA and its mission partners.  Duties/ResponsibilitiesAdd/Remove/Modify CA access control of (Registration Authority) RA / (Local Registration Authority) LRA / (Key Recovery Agent)...