Lead Hadoop Developer

3 weeks ago


Jersey City, United States Nitor Infotech Full time

Please Note: This is a W2 role

Job Summary:

We are seeking a talented Hadoop Engineer / Architect to join our team. The ideal candidate will have strong experience designing, building, and maintaining large-scale data solutions using the Hadoop ecosystem. This role will involve working closely with cross-functional teams to architect, implement, and optimize data processing systems for big data analytics and storage.

Key Responsibilities:

Architect and design scalable, reliable, and high-performance Hadoop-based big data solutions.

Manage and maintain Hadoop clusters, ensuring optimal performance, scalability, and security.

Collaborate with data engineers and data scientists to design efficient data pipelines and ETL processes.

Develop Architect and design solutions for data ingestion, processing, and storage using tools within the Hadoop ecosystem such as HDFS, Hive, HBase, MapReduce, Pig, Spark, Flume, and Kafka.

Implement monitoring, tuning, and troubleshooting strategies for performance optimization.

Ensure data integrity and implement security protocols for sensitive data.

Provide thought leadership and recommend enhancements to the existing architecture based on the latest Hadoop technologies and best practices.

Assist with the migration of legacy systems and ensure seamless data integration with the Hadoop ecosystem.

Guide the bank in meeting its product goals with deep focus on big data architecture modernization, data monetization, data availability and data management.

Collaborate with DevOps teams to ensure efficient deployment and automation of Hadoop solutions

Qualifications:

Bachelor s/Master s degree in Computer Science, Engineering, or a related field.

5+ years of experience working with Hadoop ecosystem components (HDFS, Hive, HBase, etc.).

Proven expertise in data architecture and Hadoop cluster management.

Hands-on experience with Spark, MapReduce, and NoSQL databases.

Proficient in Java, Python, or Scala for data processing and scripting.

Strong understanding of distributed computing and parallel processing.

Experience with cloud platforms (AWS, Azure, Google Cloud Platform) and their big data solutions (e.g., Amazon EMR, Azure HDInsight).

Knowledge of data governance, security protocols, and compliance.

Familiarity with DevOps practices, including automation of deployments and scaling solutions.

Excellent problem-solving skills and ability to work in a fast-paced environment.

Preferred Skills:

Experience with containerization technologies (Docker, Kubernetes).

Knowledge of machine learning tools and integration with Hadoop.

Experience in migrating on-prem Hadoop clusters to cloud platforms.

Familiarity with CI/CD pipelines for big data solutions.

A product mindset is a must. Should have played a key role in formulating product centric data strategy for a financial services client.

Exposure to treasury areas like liquidity management, payments or capital management will be a huge plus.

Technical skills: Big data, cloud data management, Data lineage, data quality platforms, data distribution architectures, Enterprise data patterns across multiple data layers.

Lead Hadoop Developer
  • Hadoop Developer

    3 weeks ago


    Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Job Title: Hadoop DeveloperWe are seeking a highly skilled Hadoop Developer to join our team at The Dignify Solutions LLC. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop Hadoop-based data processing...

  • Hadoop Developer

    3 weeks ago


    Jersey City, New Jersey, United States Photon Full time

    Job Title: Hadoop DeveloperWe are seeking a highly skilled Hadoop Developer to join our digital platform team at Photon. As a key member of our team, you will be responsible for designing, developing, and implementing large-scale data analytics solutions using Hadoop and related technologies.Key Responsibilities:Design and develop data ingestion pipelines...

  • Hadoop Developer

    1 week ago


    Jersey City, New Jersey, United States HexaQuEST Global, Inc. Full time

    We are seeking a highly skilled Hadoop Developer to join our team at HexaQuEST Global, Inc. The ideal candidate will have strong experience in Hadoop, Impala, Hive, Spark, Unix, and Python, with a strong grasp of PySpark development.Key Responsibilities:Design, develop, and enhance software applications that support Business unitsProvide innovative solutions...

  • Hadoop Developer

    3 weeks ago


    Jersey City, New Jersey, United States HexaQuEST Global, Inc. Full time

    Job Title: Hadoop DeveloperWe are seeking a highly skilled Hadoop Developer to join our team at HexaQuEST Global, Inc. The ideal candidate will have strong experience in Hadoop, Impala, Hive, Spark, Unix, and Python, with a strong grasp of Bigtable design and HBASE experience.Key Responsibilities:Design, develop, enhance, debug, support, maintain, and test...


  • Jersey City, New Jersey, United States Matlen Silver Full time

    Job Title: Senior Hadoop DeveloperDuration: 12-18 MonthsLocation: RemoteRequired Pay Scale: $62.00/hr W2***Due to client requirements this role is only open to USC or GC candidates***Job Summary:1. Good knowledge of Hadoop Architecture and various components such as HDFS, Impala, Hive, Job Tracker, Task, Tracker, Name Node, Data Node, Map Reduce Concepts...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    Hadoop Developer with Scala ExpertiseWe are seeking a skilled Hadoop developer with strong expertise in Scala to join our team at Diverse Lynx LLC. As a Hadoop developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala.Key Responsibilities:Design and develop scalable data...

  • Hadoop Developer

    2 weeks ago


    Rapid City, South Dakota, United States Centraprise Full time

    Job Title: Hadoop DeveloperCentraprise is seeking a highly skilled Hadoop Developer to join our team. As a Hadoop Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using the Hadoop ecosystem.Key Responsibilities:Design and develop scalable data processing systems using Hadoop and related...


  • Jersey City, New Jersey, United States Genesis Corp dba Genesis10 Full time

    We are seeking a skilled Hadoop/Teradata Developer to join our team at Genesis10. As a key member of our team, you will be responsible for designing and developing data processing and ingestion solutions using Hadoop and related technologies.Responsibilities:Design and develop data processing and ingestion solutions using Hadoop and related technologies...


  • Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Job Title: Hadoop with TeradataWe are seeking a highly skilled Hadoop developer with expertise in Teradata to join our team at The Dignify Solutions LLC.Key Responsibilities:Design and develop scalable Hadoop solutions using Cloudera ecosystem.Develop and maintain complex data pipelines using Spark, Scala, and Python.Work with Hive and Impala to optimize...

  • Hadoop Engineer

    2 weeks ago


    Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Job Title: Hadoop DeveloperThe Dignify Solutions LLC is seeking a highly skilled Hadoop Developer to join our team.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop and related technologies.Collaborate with cross-functional teams to identify business requirements and develop solutions.Ensure data quality, integrity, and...


  • Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Job Title: Hadoop with TeradataWe are seeking a highly skilled Hadoop developer with expertise in Teradata to join our team at The Dignify Solutions LLC.Key Responsibilities:Design and develop Hadoop-based data processing pipelines using Cloudera.Work with Spark, Scala, Python, and PySpark to build scalable data processing solutions.Develop and maintain Hive...


  • Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Job Requirements:As a Hadoop Developer with Teradata expertise, you will be responsible for designing and implementing data processing solutions using Hadoop and Teradata. Key responsibilities include:Developing and maintaining Hadoop ecosystem components, including Cloudera, Spark, and Scala.Designing and implementing data pipelines using Hive, Impala, and...


  • Jersey City, New Jersey, United States Genesis Corp dba Genesis10 Full time

    Job Title: Hadoop/Teradata DeveloperGenesis10 is seeking an experienced Application Programmer to join our team in Jersey City, NJ. This is a 12+ month contract position.Responsibilities:Design and develop data processing and ingestion solutions using Hadoop and related technologies (HDFS, MapReduce, Hive, Impala, PySpark) or Teradata.Write scalable, robust,...


  • Jersey City, New Jersey, United States Genesis Corp dba Genesis10 Full time

    Job Title: Hadoop/Teradata: JCGenesis10 is seeking an experienced Application Programmer to join our client in the financial industry located in Jersey City, NJ. This is a 12+ month contract position.Responsibilities:Design and develop data processing and ingestion solutions using Hadoop and related technologies (HDFS, MapReduce, Hive, Impala, PySpark) or...


  • Foster City, California, United States Maintec Technologies Full time

    Hadoop Infrastructure LeadAt Maintec Technologies, we are seeking a highly skilled Hadoop Infrastructure Lead to join our team. The ideal candidate will have a strong background in developing, maintaining, and optimizing Hadoop clusters. Key responsibilities include: Implementing and administering Hadoop infrastructure Maintaining cluster health,...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    Job Title: Hadoop Developer with Strong Scala SkillsLocation: RemoteJob Description:As a Hadoop Developer with strong Scala skills, you will be responsible for designing and implementing scalable data processing solutions using Hadoop and Scala. You will work closely with our team to develop and maintain our data processing infrastructure, ensuring high...

  • Hadoop Engineer

    2 weeks ago


    Jersey City, New Jersey, United States The Dignify Solutions LLC Full time

    Senior Hadoop DeveloperThe Dignify Solutions LLC is seeking a highly skilled Senior Hadoop Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop complex data...


  • Foster City, California, United States Swift Technologies Inc Full time

    Lead Hadoop Admin Job DescriptionJob Title: Lead Hadoop AdminLocation: Foster City, CAWe are seeking an experienced Lead Hadoop Admin to join our team at Swift Technologies Inc. The ideal candidate will have a strong background in Hadoop, Spark, and related technologies, with a focus on leading and managing Hadoop clusters in a production environment.Key...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    Job Title:Hadoop Developer with Strong Scala SkillsLocation:Remote OpportunityJob Description:We are seeking a skilled Hadoop developer with strong Scala expertise to join our team at Diverse Lynx LLC. The ideal candidate will have hands-on experience with Scala and a strong background in HDFS. Key Responsibilities: Develop and maintain large-scale data...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    Job Title:Hadoop with strong ScalaJob Description:We are seeking a highly skilled Hadoop developer with strong expertise in Scala to join our team at Diverse Lynx LLC. The ideal candidate will have hands-on experience with Scala and a strong background in HDFS.Key Responsibilities:Design and develop scalable data processing pipelines using Hadoop and...