Hadoop Platform Specialist

3 days ago


Charlotte, North Carolina, United States Zenith Services Inc. Full time

Job Title: Hadoop Developer

About the Role:

We are seeking a highly skilled Hadoop Developer to join our team at Zenith Services Inc. As a Hadoop Developer, you will be responsible for designing, implementing, and maintaining large-scale Hadoop clusters to support our business operations.

Key Responsibilities:

  • Lead complex technology initiatives to ensure Hadoop platform stability and automation.
  • Manage platform incidents and problems, working closely with cross-functional teams to resolve issues.
  • Collaborate with platform tenants, development teams, and Hadoop vendors to assess and prioritize triage efforts.
  • Perform root cause analysis and implement permanent resolutions for platform incidents.
  • Communicate with stakeholders and leadership on triage progress and status.
  • Troubleshoot tenant-reported failures by analyzing client logs and identifying root causes.
  • Use Autosys to schedule and execute platform routine activities.

Hadoop Cluster Management:

  • Monitor Hadoop cluster health and performance, automating new monitoring opportunities using tools like Prometheus and Splunk.
  • Perform troubleshooting and tuning to ensure optimal cluster performance.
  • Configure and tune Hadoop ecosystem components, including HDFS, YARN, Hive, HBase, Spark, and HPOS.
  • Schedule and track change requests for implementation.
  • Ensure Hadoop platform resilience with data backup and recovery strategies in place.
  • Perform emergency or scheduled failover to disaster recovery sites and fall back.

Upgrades and Patch Management:

  • Plan and execute upgrades of Hadoop ecosystem components and patches.
  • Ensure compatibility and smooth integration of new features and enhancements.
  • Work with OS administrators and patching automation teams to schedule and execute patching.
  • Perform cluster health validation post-patching and communicate with stakeholders.

Documentation and Reporting:

  • Maintain comprehensive documentation of Hadoop cluster configurations and troubleshooting processes.
  • Develop and schedule reports on cluster usage, performance metrics, and capacity utilization.

Collaboration and Support:

  • Collaborate with platform development and tenant teams to troubleshoot and fix Hadoop platform issues.
  • Consult with key technical experts and Hadoop vendors to resolve complex technical issues.

Mandatory Skills and Qualifications:

  • Proven experience in technology incident and problem management.
  • Experience with monitoring tools like Prometheus, Splunk, SiteScope, and Thousand Eyes.
  • Unix scripting experience.
  • Proven experience in Hadoop administration or a similar role.
  • Strong knowledge of Hadoop ecosystem components.
  • Experience with Autosys or similar job schedulers.
  • Excellent problem-solving and troubleshooting skills.
  • Excellent communication and people skills for collaborating with cross-functional teams.


  • Charlotte, North Carolina, United States Zenith Services Inc. Full time

    Job Title: Hadoop DeveloperAbout the Role:We are seeking a highly skilled Hadoop Developer to join our team at Zenith Services Inc. As a Hadoop Developer, you will be responsible for designing, implementing, and maintaining large-scale Hadoop clusters to support our business operations.Key Responsibilities:Lead complex technology initiatives to ensure Hadoop...


  • Charlotte, North Carolina, United States Pyramid Consulting, Inc Full time

    Java Hadoop Developer OpportunityWe are seeking a skilled Java Hadoop Developer to join our team at Pyramid Consulting, Inc. in Charlotte, NC. This is a 06+ months contract opportunity with long-term potential.Key Responsibilities:Design, develop, maintain, and test software for the ECR R&A team using Java and Hadoop.Collaborate with the development team and...


  • Charlotte, North Carolina, United States CapB InfoteK Full time

    Position Overview: Application Consultant - Junior Hadoop/Spark-ScalaWe are seeking a dedicated individual to fill the role of Application Consultant, focusing on Data Processing applications. This position involves working with advanced technologies such as Java, Spring Boot, Hive, Spark, Scala, and REST APIs.Responsibilities:Apply DevOps methodologies...


  • Charlotte, North Carolina, United States CapB InfoteK Full time

    Position Overview: Application Consultant - Junior Hadoop/Spark-ScalaWe are seeking a dedicated professional to contribute to a long-term project focused on developing Data Processing applications. This role involves utilizing technologies such as Java, Spring Boot, Hive, Spark, Scala, and REST APIs.Responsibilities:Apply DevOps methodologies, including...

  • GCP Platform Engineer

    2 months ago


    Charlotte, North Carolina, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity A well-known Financial Services Company is looking for a Production Platform Engineer in Charlotte, NC (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package Our client has been around for...


  • Charlotte, North Carolina, United States Innova Solutions Full time

    Job Description:We are seeking a highly skilled Python Developer to join our team at Innova Solutions. As a key member of our data platforms team, you will be responsible for designing, developing, and implementing data solutions that drive business growth and innovation.Key Responsibilities:Design and develop data platforms using Python, including data...

  • AI-ML Engineer

    2 weeks ago


    Charlotte, North Carolina, United States AIT Global Full time

    Job Title: AI-ML Engineer - Gen AI Data SpecialistLocation: RemoteKey Responsibilities:Participate in developing Generative AI & Traditional AI Platform Capabilities on enterprise on-prem and cloud platforms.Primary responsibilities include working on vector database, creating index, writing Python code for data ingestion, working with content management...


  • Charlotte, North Carolina, United States Collabera Full time

    Position Overview:We are seeking a skilled Automation Database Tester to oversee and enhance our testing processes.Key Qualifications:- Demonstrated expertise in a Test Automation leadership role or equivalent position.- Proficient in utilizing the Taska testing tool for effective automation.- Extensive experience in database testing, particularly with...

  • Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    About the RoleWe are seeking a highly skilled Data Engineer - Machine Learning Specialist to join our team at Randstad Digital. As a key member of our data engineering team, you will play a critical role in designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning...

  • Software Engineer

    2 days ago


    Charlotte, North Carolina, United States Dexian - DISYS Full time

    Dexian - DISYS is seeking a skilled Java Developer to join our team. As a leading provider of staffing, IT, and workforce solutions, we connect talent, technology, and organizations to produce game-changing results. The ideal candidate will have experience with Java, J2EE-Spring 5, JSP, JQuery, and ETL processes/Hadoop knowledge. Strong querying and PL/SQL...


  • Charlotte, North Carolina, United States Centraprise Full time

    Job DescriptionCompany OverviewCentraprise is dedicated to delivering exceptional staffing solutions, encompassing professional and technical staffing as well as management services to some of the most prominent organizations in the industry.With our extensive expertise across various technological platforms and skill sets, Centraprise serves a diverse array...


  • Charlotte, North Carolina, United States Indotronix International Corporation Full time

    Job Title: Big Data/Hadoop QA TestingJob Summary:We are seeking an experienced QA professional with expertise in Agile Functional, Teradata, Hadoop, and Automation testing to lead our QA team across various LOBs.Key Responsibilities:Lead the QA team in Agile Functional, Teradata, Hadoop, and Automation testingInterface with onshore and offshore QA teams for...

  • Senior Software Engineer

    13 minutes ago


    Charlotte, North Carolina, United States Wells Fargo Full time

    About the RoleWe are seeking a highly skilled Ab Initio Lead Software Engineer to join our Enterprise Data Environment team. As a key member of our team, you will be responsible for designing and implementing complex data pipelines using Hadoop and Ab Initio.Key ResponsibilitiesDesign and develop high-performing and scalable data pipeline platforms using...

  • Data Engineer

    2 days ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    Machine Learning Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Randstad Digital. As a Data Engineer, you will play a critical role in designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning models and applications.Key...

  • Cloud Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    Job SummaryRandstad Digital is seeking a highly skilled Data Engineer - Machine Learning Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning models and...

  • AI-ML Engineer

    2 weeks ago


    Charlotte, North Carolina, United States AIT Global Full time

    Job SummaryWe are seeking an experienced AI-ML Engineer to join our team at AIT Global. The successful candidate will be responsible for developing and implementing Generative AI and Traditional AI Platform Capabilities on enterprise on-prem and cloud platforms.Key ResponsibilitiesDevelop and Implement AI-ML Solutions: Participate in the development of...

  • Senior Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    About the RoleWe are seeking a highly skilled Data Engineer - Machine Learning Specialist to join our team at Randstad Digital. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning models...


  • Charlotte, North Carolina, United States Driven Brands Full time

    About the Role:The Technical Platform Owner, B2B Ecommerce Systems will inspire, design, implement and support ecommerce and marketplace solutions within Driven Brands. This role demands a strategic focus on technical frameworks that support growth and efficient operations, an enhanced user experience, and can be measured through business results.Key...


  • Charlotte, North Carolina, United States BrightSpeed Full time

    About the RoleWe are seeking a highly skilled IT Lead Data Engineer to join our team at BrightSpeed. As a key member of our Data Warehouse team, you will be responsible for designing and implementing modern data pipelines to meet key business objectives.Key ResponsibilitiesDesign and implement ETL processes and controls to ingest, organize, and curate large...


  • Charlotte, North Carolina, United States Pyramid Consulting, Inc Full time

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pyramid Consulting, Inc. in Charlotte, NC. This is a 12+ months contract opportunity with long-term potential.Job Summary:The successful candidate will have a strong background in Big Data, Solution Architecture, and Data Analytics. They...