Hadoop Cluster Administrator
2 weeks ago
We are seeking a highly skilled Lead Hadoop Admin to join our team at Info Way Solutions. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale Hadoop infrastructure.
Key Responsibilities:- Implement and administer Hadoop infrastructure, ensuring high availability and performance.
- Perform cluster maintenance, troubleshooting, and monitoring, with a focus on backup and recovery strategies.
- Provision and manage the lifecycle of multiple clusters, including EMR and EKS.
- Monitor infrastructure, logging, and alerting using Prometheus, Grafana, and Splunk.
- Perform performance tuning and capacity planning for Hadoop clusters and workloads.
- Manage memory, queue allocation, and distribution experience in Hadoop and cloud environments.
- Scale clusters in production and work in 18/5 or 24/5 production environments.
- Monitor Hadoop cluster connectivity and security, file system management, and monitoring.
- 8-12 years of total experience, with at least 5 years of work experience in developing, maintaining, optimizing, and resolving Hadoop clusters.
- Strong knowledge of Linux/Unix OS services, administration, shell scripting, and programming languages such as Python, Scala, or Java.
- Experience in Hadoop (MapReduce, Hive, Pig, Spark, Kafka, HBase, HDFS, HCatalog, ZooKeeper, and Oozie/Airflow).
- Experience in Hadoop security (Kerberos, Knox, TLS) and SQL and NoSQL databases (HBASE) with performance optimization.
- Excellent oral and written communication, presentation, analytical, and problem-solving skills.
As a Lead Hadoop Admin at Info Way Solutions, you will have the opportunity to work with a talented team of data engineers and contribute to the design and implementation of large-scale Hadoop infrastructure. If you are passionate about big data and cloud computing, and have a strong background in Hadoop and related technologies, we encourage you to apply for this exciting opportunity.
-
Hadoop Administrator
3 days ago
Fremont, California, United States Info Way Solutions Full timeHadoop Admin Job DescriptionWe are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions. As a Hadoop Admin, you will be responsible for the implementation and ongoing administration of Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop clusters, ensuring high availability and performance.Monitor and troubleshoot...
-
Hadoop Administrator
2 weeks ago
Fremont, California, United States Info Way Solutions Full timeHadoop Admin Job DescriptionWe are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions. The successful candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop clusters, ensuring optimal performance and scalability.Monitor and...
-
Hadoop Administrator
3 weeks ago
Fremont, California, United States Info Way Solutions Full timeHadoop Admin Job DescriptionWe are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions, LLC.Key Responsibilities:Implement and administer Hadoop infrastructureMaintain and troubleshoot clusters, ensuring proper backup and recovery strategiesProvision and manage the lifecycle of multiple clusters, including EMR and EKSMonitor...
-
Database Administrator
1 month ago
Fremont, California, United States Info Way Solutions Full time**Job Summary**Info Way Solutions is seeking a highly skilled Database Administrator to join our team. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining our database systems.**Key Responsibilities:**Participate in database management system selection and maintain database performance.Have knowledge of...
-
Cassandra Database Administrator
2 weeks ago
Fremont, California, United States Omni Inclusive Full timeJob DescriptionOmni Inclusive is seeking a highly skilled Cassandra DBA to join our team.Key ResponsibilitiesDesign and implement scalable Cassandra clusters using Agile, Kanban, or Lean methodologyDevelop and maintain ITIL application processes and implementationUtilize Ansible automation tool to streamline database operationsCollaborate with architecture...
-
Staff Site Reliability Engineer
2 weeks ago
Fremont, California, United States Tesla Full timeAbout the RoleTesla's Platform Engineering team is seeking a highly skilled Site Reliability Engineer to join our team. As a Site Reliability Engineer, you will play a critical role in building and maintaining our Kubernetes clusters using infrastructure-as-code tools like Ansible, Terraform, ArgoCD, and Helm.ResponsibilitiesCollaborate with developers to...
-
Database Management Specialist
1 month ago
Fremont, California, United States Info Way Solutions Full time**Job Summary**Info Way Solutions is seeking a highly skilled Database Administrator to join our team. As a key member of our IT department, you will be responsible for ensuring the smooth operation of our database systems.**Key Responsibilities:**Participate in the selection and maintenance of database management systems to ensure optimal performance.Have...
-
Enterprise Systems Architect
3 weeks ago
Fremont, California, United States META Full timeEnterprise Systems EngineerAt Meta, we're building the infrastructure for our high-traffic, high-visibility services. As an Enterprise Systems Engineer, you'll build the foundation for our business to thrive. You'll work closely with our Reality Labs Research teams to implement mid-sized GPU clusters tailored to meet individual team needs.Key...
-
Data Scientist
1 month ago
Fremont, United States Pivotal Systems Full timeThe ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the right answers. ResponsibilitiesAnalyze raw data: assessing quality, cleansing, structuring for downstream processing...
