Hadoop Technical Lead

7 days ago


Charlotte, North Carolina, United States JobRialto Full time
Senior Hadoop Engineer Job Summary

JobRialto is seeking a highly experienced Senior Hadoop Engineer to lead complex technology initiatives focused on maintaining platform stability, automating monitoring, and providing 24/7 support for Hadoop clusters.

Key Responsibilities
  • Platform Stability and Incident Management:
    • Lead complex technology initiatives focused on Hadoop platform stability and automation.
    • Manage and troubleshoot platform incidents, serving as part of a 24/7 platform support team.
    • Assess the impact of platform issues, prioritize triaging efforts, and partner with tenants, developers, and vendors.
    • Perform root cause analysis of incidents and implement permanent solutions.
    • Communicate progress and status updates to stakeholders and leadership.
  • Hadoop Cluster Monitoring and Troubleshooting:
    • Monitor Hadoop cluster health and performance using tools such as Prometheus, Splunk, and Thousand Eyes.
    • Automate monitoring opportunities and fine-tune alert systems for optimal performance.
    • Use Autosys or similar scheduling tools to manage platform activities.
    • Troubleshoot tenant-reported failures by analyzing logs to identify root causes.
  • Hadoop Configuration and Tuning:
    • Periodically configure and tune Hadoop components (HDFS, YARN, Hive, HBase, Spark, HPOS).
    • Schedule and track change requests for implementation.
    • Collaborate with tenants and operating system administrators to manage patches and upgrades.
  • Backup, Recovery, and Patching Management:
    • Ensure platform resilience through robust data backup and recovery strategies.
    • Execute failover to disaster recovery sites and manage fallback processes.
    • Plan and perform upgrades and patch management of Hadoop components.
    • Validate cluster health post-patching and communicate with stakeholders.
    • Identify automation opportunities to enhance patching processes.
  • Documentation and Reporting:
    • Maintain detailed documentation of cluster configurations, troubleshooting processes, and procedures.
    • Generate reports on cluster usage, performance metrics, and capacity utilization.
  • Collaboration and Support:
    • Collaborate with platform tenants, development teams, and Hadoop vendors to troubleshoot complex issues.
    • Work independently and in coordination with key technical experts to ensure production stability.


  • Charlotte, North Carolina, United States CapB InfoteK Full time

    Job Title: Ab Initio Application Consultant Lead - Hadoop/Spark-ScalaAbout the Job:CapB InfoteK is seeking a talented Application Consultant Lead - Hadoop/Spark-Scala to join our team for one of our long-term, multi-year projects. If you have experience with Ab Initio and Hadoop and possess strong problem-solving skills, we encourage you to apply.Primary...


  • Charlotte, North Carolina, United States Motion Recruitment Full time

    We are seeking a highly skilled Big Data Engineering Lead to join our team at Motion Recruitment in Charlotte, NC. This full-time consulting assignment will be a long-term opportunity for the right candidate.The ideal candidate should have a strong understanding of big data development and experience working with Hadoop, Spark, Python, Scala, Unix, and SQL.A...


  • Charlotte, North Carolina, United States Syntricate Technologies Full time

    Job SummaryWe are seeking a highly skilled Pyspark Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems using Pyspark and Hadoop. Key responsibilities include working on Pyspark frameworks to ingest data from various...


  • Charlotte, North Carolina, United States The Dignify Solutions LLC Full time

    Job Description:We are seeking a seasoned Cloud Computing Expert to join our team at The Dignify Solutions LLC. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale data processing pipelines using Hadoop/Big Data technologies.About the Role:This is an exciting opportunity for a motivated individual...


  • Charlotte, North Carolina, United States FST Technical Services Full time

    About the RoleAs a Senior Commissioning Project Engineer at FST Technical Services, you will play a critical role in ensuring that equipment in mechanical, electrical, plumbing, and associated systems are designed, installed, and functionally tested to meet client requirements and design intent.This position offers an excellent salary and benefits package....


  • Charlotte, North Carolina, United States Canonical - Jobs Full time

    Role OverviewWe are seeking a seasoned Technical Lead to spearhead our Observability Engineering team. As a key member of our technical leadership, you will be responsible for driving the development and implementation of our Logging, Monitoring, and Alerting elements.


  • Charlotte, North Carolina, United States Anagh Technology Full time

    Technical Lead for Frontend DevelopmentAt Anagh Technology, we are seeking a highly skilled Technical Lead for our Frontend Development team. The ideal candidate will have extensive experience with React and a proven track record of delivering high-quality software solutions.Key Responsibilities:Lead the development of our frontend applications using React,...


  • Charlotte, North Carolina, United States City National Bank Full time

    City National Bank is a leading financial services company seeking an experienced Technical Lead to drive the design and development of cross-platform systems. The ideal candidate will have a strong background in full-stack development, cloud solutions, and team leadership.About the Role:We are looking for a highly skilled Technical Lead to lead the design...


  • Charlotte, North Carolina, United States CapB InfoteK Full time

    We are seeking a Senior AEM Technical Lead to join our team at CapB InfoteK. This role involves leading the technical design, development, and deployment of Adobe Experience Manager solutions. The ideal candidate will have experience with AEM component development, asset workflow development, and integrating AEM with other applications.Key...


  • Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Senior Data Engineering ManagerJob Summary:We are seeking a Senior Data Engineering Manager to lead our data engineering team at TechnoGen. The ideal candidate will have 12+ years of experience in data engineering and a strong background in SQL, Python, and Spark programming languages.Key Responsibilities:Lead multiple teams and drive technical...


  • Charlotte, North Carolina, United States The Haskell Company Full time

    Unlock a rewarding career at The Haskell Company as a Technical Lead for Healthcare Project Development. We're seeking an experienced Architect with over 10 years of expertise to shape the future of healthcare environments.Key Responsibilities:We are looking for someone to develop innovative and cost-effective designs and specifications for healthcare...


  • Charlotte, North Carolina, United States ProSearch Recruiting Partners Inc Full time

    Job OverviewThis position is responsible for leading the Applications Engineering team in providing technical direction and oversight for complex machining processes using cutting-edge technology.Salary Range: $120,000-$160,000 per annum, depending on experienceKey ResponsibilitiesTechnical Leadership: Set clear goals and deliverables for technical center...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job Title: Senior Technology and Data EngineerJob Summary:We are seeking a highly skilled Senior Technology and Data Engineer to join our team at Aloden, Inc. As a key member of our engineering team, you will be responsible for developing and implementing innovative technology solutions to drive business growth and improve operational efficiency.Key...


  • Charlotte, North Carolina, United States Boomerang Design Full time

    Exceptional Architectural Talent WantedWe are seeking a highly skilled Architect Level II and/or Construction Administrator to join our team at Boomerang Design. With over four decades of experience in delivering exceptional results, we are committed to providing a supportive environment that fosters growth and success.About the Role:This is an exciting...


  • Charlotte, North Carolina, United States Experis Full time

    We are seeking a highly skilled Lead Technical Architect to join our team in the financial services industry. This is a unique opportunity to work on a cutting-edge project and drive technical collaboration across multiple teams and organizations.The ideal candidate will have 15 years of experience in software development, with expertise in designing and...


  • Charlotte, North Carolina, United States XomegaIT Inc Full time

    Job OverviewXomegaIT Inc is a cutting-edge technology company seeking an experienced Technical Lead to join our Salesforce development team. This full-time opportunity in St Louis MO offers a unique chance to lead the development of innovative Salesforce solutions.About the RoleThe successful candidate will be responsible for leading the design, development,...

  • Technical Lead

    2 hours ago


    Charlotte, North Carolina, United States ShiftCode Analytics Full time

    Job Title: Technical Lead - Java & Angular Developer for Wells FargoAbout the Role:This is a fantastic opportunity to lead a team of skilled developers in creating cutting-edge solutions for Operational Risk Measurement. As a Senior Full Stack Java/Angular Developer, you will be responsible for designing and developing efficient UI, as well as implementing...


  • Charlotte, North Carolina, United States RVO Health Full time

    About UsRVO Health is a leading digital healthcare platform that aims to build relationships with individuals throughout their health and wellness journey. Founded in 2022, we combine the strengths of Red Ventures and UnitedHealth Group's Optum Health to deliver innovative solutions for a stronger and healthier world.


  • Charlotte, North Carolina, United States First Horizon Bank Full time

    OverviewWe are seeking a highly skilled Technical Sitecore Lead Developer to join our team at First Horizon Bank. This is an excellent opportunity to work with a leading regional financial services company, dedicated to helping our clients, communities and associates unlock their full potential with capital and counsel.Salary: $120,000 - $150,000 per annum,...


  • Charlotte, North Carolina, United States Synechron Full time

    About the JobSynechron is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have a strong technical background, excellent communication skills, and experience working with cloud-based data solutions, Apache tools, and programming languages such as Java, Python, or C#. As a Data Engineer, you will be responsible for developing...