Hadoop Systems Administrator

4 weeks ago

Oklahoma City, United States ndoiljobs Full time

Preview JOB SUMMARY

As aHadoop Systems Administrator, you will be responsible for daily operations and maintenance of IT systems centering around Continental’s big data platform. You will be required to keep these IT systems maintained and optimized through daily, weekly, and monthly system tuning and periodic system maintenance. Day-to-day operations will require interfacing with other IT departments, developers and project management. Manage testing and implementation of upgrades and changes to supported systems following change control processes.

DUTIES/RESPONSIBILITIES

Day to Day maintenance activities including but not limited to Log monitoring and cleanup, Cluster monitoring, deployments, production support and performance tuning

Install, configure, monitor, tune, and troubleshoot all components of the CDH environments, including but not limited to, Cloudera Manager, Cloudera Management Services, HDFS, YARN, Zookeeper, Hive, Spark, Sprak Streaming, Hue, Kudu, Impala, HBase, Key Management Server, Kafka, Flume, Solr, SSL, Sqoop, and Sentry

Build, Tune and administer Search and Index frameworks like Solr and Elastic Search

Build, Tune and administer HBase cluster in multiple environments

Design, Document, Develop, Unit Test and Deploy scripts for automating cluster patching, application upgrades, Application deployments using UNIX and Java in multiple environments

Automate daily administrative tasks to guarantee high availability of systems, applications and data

Troubleshoot issues with applications, services and clusters in multiple environments

Implement and administer Active-Active cluster configuration for Disaster Recovery

Manage cluster hardening activities with security implementation to enforce data governance for the data accessed by data scientists and analysts using Sentry and LDAP integration

Performance tune cluster services in multiple environments

Capacity planning for cluster upgrades

Setup Monitoring and Alerting for applications and services on the clusters using tools like Splunk and Grafana

Automate data and log backups and archival

Automate log analysis and setup alerting

Build, Maintain and administer clusters to support highly available and fast real-time streaming applications

Daily communication with Business and Technical teams to understand the needs and build, maintain and support environments that help solve the use cases

Cluster patching activities

Cluster upgrades when required

Other duties assigned

SKILLS

Excellent knowledge of Linux (Redhat Preferred)

Deep understanding of Hadoop and Spark cluster security, networking connectivity and IO throughput along with other factors that affect distributed system performance

Strong working knowledge of disaster recovery, incident management, and security best practices

Working knowledge of containers (e.g., docker) and major orchestrators (e.g., Mesos, Kubernetes, Docker Datacenter)

Working knowledge of automation tools (e.g., Puppet, Chef, Ansible)

Working knowledge of software defined networking

Working knowledge of parcel based upgrades with Hadoop (i.e., Cloudera)

Working knowledge of hardening Hadoop with Kerberos, TLS, and HDFS encryption

Ability to quickly perform critical analysis and use creative approaches for solving complex problems

Excellent written and verbal communication skills

QUALIFICATIONS

Bachelor’s degree from an accredited college/university in Computer Science, Computer Engineering, or related field and minimum four years of big data experience with multiple programming languages and technologies

Understanding of cloud and distributed systems principles, including load balancing, networks, scaling, in-memory vs. disk, etc.; and experience with large-scale, big data methods, such as MapReduce, Hadoop, Spark, Hive, Impala, or Storm

Ability to work efficiently under Unix/Linux environment or .NET, with experience with source code management systems like GIT

Ability to work with team members and clients to assess needs, provide assistance, and resolve problems, using excellent problem-solving skills, verbal/written communication, and the ability to explain technical concepts to business people

An acceptable pre-employment background and drug test

#J-18808-Ljbffr

  • Hadoop Systems Administrator

    3 weeks ago

    Oklahoma City, United States ndoiljobs Full time

                        Preview JOB SUMMARY As a Hadoop Systems Administrator, you will be responsible for daily operations and maintenance of IT systems centering around Continental’s big data platform. You will be required to keep these IT systems maintained and optimized through daily, weekly, and monthly system tuning and periodic...

  • Hadoop L-2 Support Admin

    3 weeks ago

    Texas City, United States Diverse Lynx Full time

    Hadoop L-2 Support / Dev Ops - Senior / Austin / 3 Hadoop/Big data administrator: Monitor the Hadoop platforms and debug both platform and application issues. Should be able to Automate manual tasks via ansible or Python Knowledge on HBase is plus. Should have good Hadoop issue debugging skills. Position is hybrid and will require the resource to work from...

  • Hadoop L-2 Support Admin

    2 days ago

    Texas City, United States Diverse Lynx Full time

    Hadoop L-2 Support / Dev Ops - Senior / Austin / 3 Hadoop/Big data administrator: Monitor the Hadoop platforms and debug both platform and application issues. Should be able to Automate manual tasks via ansible or Python Knowledge on HBase is plus. Should have good Hadoop issue debugging skills. Position is hybrid and will require the resource to work from...

  • Hadoop developer

    2 months ago

    Texas City, United States Logging-in Full time

    We are looking for a Big Data Engineer that will work on the collecting storing processing and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes then maintaining implementing and monitoring them. You will also be responsible for integrating them with the architecture used across the...

  • Hadoop developer

    18 hours ago

    Texas City, United States Logging-in Full time

    We are looking for a Big Data Engineer that will work on the collecting storing processing and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes then maintaining implementing and monitoring them. You will also be responsible for integrating them with the architecture used across the...

  • Lead Hadoop Admin-Foster City, CA,

    3 weeks ago

    Foster City, United States Georgia IT Inc Full time

    Lead Hadoop Admin Foster City, CA, (Onsite from Day 1) Max Rate: DOE Interview Process: 3 Rounds of Zoom Video Interview USC & GC Preferred. No Third-party C2C available for this job Job Description Responsible for implementation and ongoing administration of Hadoop infrastructure. Responsible for Cluster maintenance, trouble shooting,...

  • Hadoop Application Support specialist

    1 week ago

    Jersey City, United States Syntricate Technologies Inc Full time

    Role: Hadoop Application Support specialist Location: Pennington, TX / Jersey City, NJ Rate: w2 Fulltime Position Summary: Hadoop Application Support specialist able to work in one or more than one applications in the hadoop data lake Able to support the existing Hadoop applications. Able to support the application in rotating shifts (24x7)....

  • Hadoop App Support | NJ,Texas

    4 hours ago

    Jersey City, United States Photon Full time

    Job Description Position Summary: Hadoop Application Support specialist able to work in one or more than one applications in the hadoop data lake Able to support the existing Hadoop applications. Able to support the application in rotating shifts (24x7). Job Description: Essential Duties and Responsibilities: Following is a summary of the essential...

  • Systems Administrator

    2 weeks ago

    Oklahoma City, Oklahoma, United States General Dynamics Information Technology Full time

    Req ID: RQ173875Type of Requisition: RegularClearance Level Must Be Able to Obtain: NoneJob Family: Systems AdministrationSkills:Computer Systems,Hardware Systems,Operating Systems (OS)Certifications:Security+, CE - comp tia, Network Plus - comp tiaExperience:4 + years of related experienceUS Citizenship Required:YesJob Description:Unified Communications...

  • Systems Administrator

    2 weeks ago

    Oklahoma City, Oklahoma, United States GENERAL DYNAMICS INFORMATION TECHNOLOGY Full time

    Unified Communications Systems AdministratorTransform technology into opportunity as a Unified Communications Systems Administrator with GDIT. A career in enterprise IT means connecting and enhancing the systems that matter most. At GDIT you'll be at the forefront of innovation and play a meaningful part in improving how agencies operate.At GDIT, people are...

  • Systems Administrator

    2 days ago

    Oklahoma City, Oklahoma, United States GENERAL DYNAMICS INFORMATION TECHNOLOGY Full time

    Unified Communications Systems AdministratorTransform technology into opportunity as a Unified Communications Systems Administrator with GDIT. A career in enterprise IT means connecting and enhancing the systems that matter most. At GDIT you'll be at the forefront of innovation and play a meaningful part in improving how agencies operate.At GDIT, people are...

  • System Engineer

    1 week ago

    Oklahoma City, United States Albano Systems Full time

    A Systems Engineer is responsible for supporting equipment in a Microsoft Windows environment, from design through implementation and support. A System Engineer performs a wide variety of installation, configuration and upgrading of workstations, servers and related hardware and software in a LAN, WAN and stand-alone environment. A System Engineer provides...

  • Systems Administrator

    3 weeks ago

    Salt Lake City, United States Quality Electrical Systems Full time

    Job DescriptionJob DescriptionWe are looking for an outgoing and dynamic Systems Administrator to contribute to the successful administration, operation, and support of business-critical application and network business environments. The Systems Administrator is responsible for the collaborative maintenance of, and overseeing the management and...

  • Systems Administrator

    2 days ago

    Salt Lake City, United States Quality Electrical Systems Full time

    Job DescriptionJob DescriptionWe are looking for an outgoing and dynamic Systems Administrator to contribute to the successful administration, operation, and support of business-critical application and network business environments. The Systems Administrator is responsible for the collaborative maintenance of, and overseeing the management and...

  • System Administrator

    2 weeks ago

    Oklahoma City, United States Inceed Full time

    Compensation: $28-33hr Location: Woodward, OK System Administrator: Inceed has partnered with a great company to help find a skilled Sytem Administrator to join their team! Responsibilities: Complete service requests and incidents Develop and maintain knowledge articles Montior service availability (email, backup, Sharepoint, File...

  • System Administrator

    2 days ago

    Oklahoma City, United States Inceed Full time

    Compensation: $28-33hr Location: Woodward, OK System Administrator: Inceed has partnered with a great company to help find a skilled Sytem Administrator to join their team! Responsibilities: Complete service requests and incidents Develop and maintain knowledge articles Montior service availability (email, backup, Sharepoint, File...

  • System Administrator

    1 week ago

    Atlantic City, United States A3 Technology, Inc. Full time

    Job DescriptionJob DescriptionSalary: A3 Technology, Inc. is seeking a senior level System Administrator to join our team in Egg Harbor Township, NJ. This position will support software maintenance, integration and installation of multiple complex computer systems across the enterprise.Essential Job Functions:Multitask on the following:Upgrade multiple...

  • Power System Administrator

    3 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte (South), NC Full time

    Job DescriptionJob DescriptionJob Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM...

  • Power System Administrator

    2 days ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte (South), NC Full time

    Job DescriptionJob DescriptionJob Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM...

  • Power System Administrator

    3 weeks ago

    Oklahoma City, United States Specialized Recruiting Group - Charlotte, NC Full time

    Job Title: Power System AdministratorLocation: Oklahoma City, OKFull-Time Employment, $100-120K, expected fully on-site, relocation assistance TBDJob Description:Seeking a skilled Power i System Administrator to join our team in Oklahoma City. The ideal candidate will have a strong background in managing and maintaining IBM Power i/ISA Power 9 and Power 10...