Current jobs related to Hadoop Cluster Engineer - Fremont, California - Info Way Solutions


  • Fremont, California, United States Info Way Solutions Full time

    Job Title: Lead Hadoop AdminJob Summary: Info Way Solutions is seeking a highly skilled Hadoop Cluster Architect to lead the implementation and ongoing administration of our Hadoop infrastructure. The ideal candidate will have a strong background in developing, maintaining, and optimizing Hadoop clusters, as well as experience in Linux/Unix OS services,...


  • Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop Infrastructure SpecialistJob Summary:We are seeking a highly skilled Hadoop Infrastructure Specialist to join our team at Info Way Solutions. As a key member of our data engineering team, you will be responsible for the implementation and ongoing administration of Hadoop infrastructure.Key Responsibilities:Implement and maintain Hadoop...

  • Hadoop Administrator

    1 month ago


    Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop AdministratorJob Summary:We are seeking a highly skilled Hadoop Administrator to join our team at Info Way Solutions. The successful candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure, including cluster maintenance, troubleshooting, and performance tuning.Key Responsibilities:Implement...


  • Fremont, California, United States Info Way Solutions Full time

    Job Title: Hadoop Infrastructure SpecialistJob Summary:We are seeking a highly skilled Hadoop Infrastructure Specialist to join our team at Info Way Solutions. The successful candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure, including cluster maintenance, troubleshooting, and performance tuning.Key...


  • Fremont, California, United States AMAX Full time

    Job OverviewWe are seeking a highly skilled Cluster Test Engineer to join our team at AMAX. As a key member of our solution engineering group, you will be responsible for developing, validating, and deploying computing solutions. Your expertise in hardware and software will enable you to explore and address technical challenges, ensuring the success of our...


  • Fremont, California, United States Info Way Solutions Full time

    Job Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at Info Way Solutions. The ideal candidate will have a strong background in Hadoop technologies, Spark, and Scala, with a proven track record of building and supporting scalable Big Data applications.The successful candidate will have:5-7 years of overall experience in...


  • Fremont, California, United States Info Way Solutions Full time

    At Info Way Solutions, we are seeking a skilled Cloud Infrastructure Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining a hybrid cloud infrastructure for our analytics data platform.As a Cloud Infrastructure Engineer, you will work closely with our Data Engineering team to engineer custom solutions...


  • Fremont, California, United States Info Way Solutions Full time

    We are seeking a highly skilled Cloud Operations Engineer to join our team at Info Way Solutions. As a Cloud Operations Engineer, you will be responsible for designing, implementing, and maintaining scalable and highly available cloud-based systems.The ideal candidate will have a strong background in cloud computing, with experience in operating...


  • Fremont, California, United States Info Way Solutions Full time

    Job Title:Senior Cloud Storage EngineerJob Summary:We are seeking a highly skilled Senior Cloud Storage Engineer to join our team at Info Way Solutions. The successful candidate will be responsible for designing, implementing, and optimizing private cloud-based Cloud Storage solutions using Ceph.Key Responsibilities:Design and implement private cloud-based...


  • Fremont, California, United States Info Way Solutions Full time

    Job Title: Cloud Storage Solutions EngineerWe are seeking a highly skilled Cloud Storage Solutions Engineer to join our team at Info Way Solutions. As a key member of our cloud engineering team, you will be responsible for designing, implementing, and optimizing private cloud-based cloud storage solutions using Ceph.Key Responsibilities:Design and implement...

  • Data Science Engineer

    1 month ago


    Fremont, California, United States Info Way Solutions Full time

    We are seeking a skilled Data Science Engineer to contribute to the development and implementation of advanced data solutions using technologies such as AWS Glue, Python, Spark, Snowflake Data Lake, S3, SageMaker, and machine learning.As a Data Science Engineer, you will play a crucial role in designing, building, and optimizing data pipelines, machine...


  • Fremont, California, United States Tesla Full time

    Job DescriptionThe Cell Quality team at Tesla is seeking a highly skilled Data Engineer to support daily fleet diagnostics and analytics activities. The ideal candidate will have a strong background in data analysis, statistical modeling, and data visualization.Responsibilities:Perform extensive data study on all field failures and correlation studies with...


  • Fremont, California, United States Info Way Solutions Full time

    Job Title: Cloud Analytics DeveloperAbout the Role:We are seeking a skilled Cloud Analytics Developer to join our team at Info Way Solutions. As a Cloud Analytics Developer, you will be responsible for engineering, integrating, and maintaining an analytics data platform based on a hybrid cloud infrastructure.Key Responsibilities:- Engineer, integrate, and...


  • Fremont, California, United States Deeproute Full time

    Job SummaryDeeproute.ai is a pioneering company in the field of Level 4 full-stack self-driving solutions. We are committed to providing the safest, smartest, and most reliable transportation systems. As a key member of our team, you will play a crucial role in designing and implementing data-centric infrastructures and tools for continuous development,...


  • Fremont, United States Holy Grail Inc Full time

    Holy Grail developed a direct air carbon capture technology that removes CO2 from the atmosphere and permanently stores it above the ground. We are looking for proactive candidates ready to take ownership and passionate about creating a scalable solution to removing excess CO2 from the atmosphere.RequirementsAbility to work independently and take ownership...


  • Fremont, United States Info Way Solutions Full time

    Job Description: In this role you will be responsible for engineering, integrating and maintaining an analytics data platform based on a hybrid cloud infrastructure. Work collaboratively with our Data Engineering team to engineer custom solutions when required. Participate and provide support to our stakeholders and platform users when required. Key...


  • Fremont, United States GSPANN Technologies, Inc Full time

    About GSPANNHeadquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+...


  • Fremont, CA, United States GSPANN Technologies, Inc Full time

    About GSPANNHeadquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+...

Hadoop Cluster Engineer

1 month ago


Fremont, California, United States Info Way Solutions Full time
Job Title: Lead Hadoop Admin

We are seeking a highly skilled Lead Hadoop Admin to join our team at Info Way Solutions. As a key member of our infrastructure team, you will be responsible for the implementation and ongoing administration of our Hadoop infrastructure.

Key Responsibilities:
  • Implement and maintain Hadoop clusters, ensuring high availability and performance.
  • Provision and manage the life cycle of multiple clusters, including EMR and EKS.
  • Monitor and troubleshoot Hadoop infrastructure, including file system management and security.
  • Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades.
  • Develop and maintain central dashboards for system, data, utilization, and availability metrics.
Requirements:
  • 8-12 years of total experience with at least 5 years of work experience in developing, maintaining, optimizing, and resolving Hadoop clusters.
  • Strong knowledge of programming languages, including Python, Scala, Java, and debugging skills.
  • Experience in Hadoop (Map Reduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper, and Oozie/Airflow).
  • Experience in Hadoop security (Kerberos, Knox, TLS).
  • Hands-on experience in SQL and NoSQL databases (HBASE) with performance optimization.
  • Excellent oral and written communication and presentation skills, analytical and problem-solving skills.

If you are a motivated and experienced professional looking for a new challenge, please submit your application to join our team at Info Way Solutions.