Hadoop Cluster Architect

4 weeks ago

Fremont, California, United States Info Way Solutions Full time
Job Title: Lead Hadoop Admin

At Info Way Solutions, we are seeking a highly skilled and experienced Lead Hadoop Admin to join our team. As a key member of our infrastructure team, you will be responsible for the implementation and ongoing administration of our Hadoop infrastructure.

Key Responsibilities:
  • Implement and maintain Hadoop clusters, ensuring optimal performance and reliability.
  • Monitor and troubleshoot Hadoop infrastructure, identifying and resolving issues promptly.
  • Provision and manage the lifecycle of multiple clusters, including EMR and EKS.
  • Implement infrastructure monitoring, logging, and alerting using Prometheus, Grafana, and Splunk.
  • Perform performance tuning of Hadoop clusters and workloads, ensuring optimal capacity planning.
  • Scale clusters in production, ensuring seamless operation in 18/5 or 24/5 environments.
  • Monitor Hadoop cluster connectivity and security, file system management, and monitoring.
  • Investigate and analyze new technical possibilities, tools, and techniques to improve efficiency and productivity.
  • Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades.
  • Maintain central dashboards for system, data, utilization, and availability metrics.
Requirements:
  • 8-12 years of total experience, with at least 5 years of work experience in developing, maintaining, optimizing, and resolving Hadoop clusters.
  • Strong knowledge of Linux/Unix OS services, administration, shell scripting, and programming languages such as Python, Scala, Java, and R.
  • Experience in Hadoop (Map Reduce, Hive, Pig, Spark, Kafka, HBase, HDFS, HCatalog, Zookeeper, and Oozie/Airflow).
  • Experience in Hadoop security (Kerberos, Knox, TLS) and SQL and NoSQL databases (HBASE) with performance optimization.
  • Excellent oral and written communication, presentation, analytical, and problem-solving skills.
What We Offer:

As a Lead Hadoop Admin at Info Way Solutions, you will have the opportunity to work with a talented team, develop your skills, and contribute to the success of our organization.

  • Hadoop Cluster Architect

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Lead Hadoop AdminJob Summary: Info Way Solutions is seeking a highly skilled Hadoop Cluster Architect to lead the implementation and ongoing administration of our Hadoop infrastructure. The ideal candidate will have a strong background in developing, maintaining, and optimizing Hadoop clusters, as well as experience in Linux/Unix OS services,...

  • Hadoop Cluster Administrator

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Hadoop Admin Job DescriptionWe are seeking a highly skilled Hadoop Admin to join our team at Info Way Solutions, LLC. As a Hadoop Admin, you will be responsible for the implementation and ongoing administration of Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop clusters, ensuring high availability and performance.Provision and manage...

  • Hadoop Cluster Engineer

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Lead Hadoop AdminWe are seeking a highly skilled Lead Hadoop Admin to join our team at Info Way Solutions. As a key member of our infrastructure team, you will be responsible for the implementation and ongoing administration of our Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop clusters, ensuring high availability and...

  • Hadoop Administrator

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop AdministratorJob Summary:We are seeking a highly skilled Hadoop Administrator to join our team at Info Way Solutions. The successful candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure, including cluster maintenance, troubleshooting, and performance tuning.Key Responsibilities:Implement...

  • Hadoop Infrastructure Specialist

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop Infrastructure SpecialistJob Summary:We are seeking a highly skilled Hadoop Infrastructure Specialist to join our team at Info Way Solutions. The successful candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure, including cluster maintenance, troubleshooting, and performance tuning.Key...

  • Hadoop Infrastructure Specialist

    3 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop Infrastructure SpecialistJob Summary:We are seeking a highly skilled Hadoop Infrastructure Specialist to join our team at Info Way Solutions. As a key member of our data engineering team, you will be responsible for the implementation and ongoing administration of Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop...

  • Cloud Architect

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title: Solution Architect - FinOps and Analytics / Sr. Director or VPJob Summary:We are seeking an experienced Solution Architect to lead our FinOps and Analytics team. The ideal candidate will have a strong background in architecting and delivering analytics solutions on premise and cloud, with a focus on cloud cost optimization and big data...

  • Cloud Storage Solutions Architect

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title:Cloud Storage Solutions ArchitectJob Summary:We are seeking a skilled Cloud Storage Solutions Architect to design and implement private cloud-based Cloud Storage solutions using Ceph. The ideal candidate will have experience with Ceph, OpenStack, and Kubernetes, as well as strong programming and scripting skills.Key Responsibilities:Design and...

  • Cloud Infrastructure Architect

    4 weeks ago

    Fremont, California, United States Deeproute Full time

    Job OverviewDeeproute.ai is revolutionizing the transportation industry with its Level 4 full-stack self-driving solution. We're seeking a talented Cloud Infrastructure Architect to design and build data-centric infrastructures and tools for continuous development, testing, and deployment on cloud.Key Responsibilities:Design and implement scalable cloud...

  • Ceph Cloud Storage Solutions Architect

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job DescriptionWe are seeking a highly skilled Ceph Cloud Storage Solutions Architect to join our team at Info Way Solutions. As a key member of our cloud storage team, you will be responsible for designing, implementing, and optimizing private cloud-based Cloud Storage solutions using Ceph.Key Responsibilities:Design and implement private cloud-based Cloud...

  • Cassandra Database Architect

    4 weeks ago

    Fremont, California, United States Maintec Technologies Full time

    Job Summary Maintec Technologies is seeking a skilled Cassandra Database Administrator to join our team. The ideal candidate will have a strong background in Cassandra, Agile, and ITIL application processes. Key Responsibilities • Design and implement Cassandra clusters for high-performance applications • Develop and maintain scripts for automation, log...

  • Senior Cloud Storage Engineer

    4 weeks ago

    Fremont, California, United States Info Way Solutions Full time

    Job Title:Senior Cloud Storage EngineerJob Summary:We are seeking a highly skilled Senior Cloud Storage Engineer to join our team at Info Way Solutions. The successful candidate will be responsible for designing, implementing, and optimizing private cloud-based Cloud Storage solutions using Ceph.Key Responsibilities:Design and implement private cloud-based...

  • Cloud Infrastructure Architect

    4 weeks ago

    Fremont, California, United States Deeproute Full time

    Job SummaryDeeproute.ai is a pioneering company in the field of Level 4 full-stack self-driving solutions. We are committed to providing the safest, smartest, and most reliable transportation systems. As a key member of our team, you will play a crucial role in designing and implementing data-centric infrastructures and tools for continuous development,...