Big Data Engineer(Infra)

5 days ago


Whippany, United States Iris Software Inc. Full time

Iris’s client, one of their Banking client is looking to hire Bigdata Infra Engineer for Whippany, NJ /Wilmington, DE (Hybrid)


Location – Whippany, NJ /Wilmington, DE (Hybrid)

Tech stack : Big Data, Performance Tunning, Backup & Recovery, Cluster, HDFS, Hadoop Infrastructure


  • Responsible for implementation and ongoing administration of Hadoop infrastructure, cluster maintenance as well as creation and removal of nodes.
  • HDFS support and maintenance, Backup and restores.
  • Cluster Monitoring and Troubleshooting.
  • Manage and review Hadoop log files. File system management and monitoring. Implement and maintain security. Data capacity and node forecasting and planning.
  • Will install operating system and Hadoop updates, patches, version upgrades as required. Also closely working with the network, application, and business intelligence teams to ensure data quality and availability.
  • Be able to support Data Scientist/Engineering team for trouble-shooting on day-to-day issues on Hadoop Cluster and other application components.
  • This role requires a wide variety of strengths and capabilities, including: BS/BA degree or equivalent experience Basic knowledge of application development.
  • Working knowledge in one or more general purpose programming languages, plus an interest in learning other coding languages and skills as needed.
  • Working knowledge of development toolset to design, develop, test, deploy, maintain and improve software.
  • Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals.
  • 7 or more years of Knowledge in Linux and Unix shell scripting, Infrastructure Administration Knowledge in Kerberos and Keon Security.
  • Knowledge or experience working with structured and unstructured data, ETL, and scripting languages
  • Experience in managing large cluster ecosystem, including new hardware design/build/deployments Demonstrated Experience in Hadoop, Cloudera, MapReduce, along with supporting tools Pig, Sqoop, Splunk, Hive, Sentry, Nifi, Flink




Thanks & Regards

Sunil Kamboj

Sr. Executive - TA

Iris Software

www.irissoftware.com



  • whippany, United States Iris Software Inc. Full time

    Iris’s client, one of their Banking client is looking to hire Bigdata Infra Engineer for Whippany, NJ /Wilmington, DE (Hybrid) Location – Whippany, NJ /Wilmington, DE (Hybrid)Tech stack : Big Data, Performance Tunning, Backup & Recovery, Cluster, HDFS, Hadoop InfrastructureResponsible for implementation and ongoing administration of Hadoop...


  • Whippany, United States SysMind Tech Full time

    •AWS, Big Data, Scala, Python, Spark, Performance tuning, Big data processing, Infrastructure maintenance, •Quantexa framework, AML domain knowledge, Autosys batch processing, CI/CD pipeline, CHEF deployments •Need to develop and maintain applications using Bigdata framework and AWS technologies. Must know the Spark and Scala technologies.


  • Whippany, United States SysMind Tech Full time

    • AWS, Big Data, Scala, Python, Spark, Performance tuning, Big data processing, Infrastructure maintenance, • Quantexa framework, AML domain knowledge, Autosys batch processing, CI/CD pipeline, CHEF deployments • Need to develop and maintain applications using Bigdata framework and AWS technologies. Must know the Spark and Scala technologies.


  • Whippany, New Jersey, United States Omni Inclusive Full time

    Cloud Data Engineering ManagerOmni Inclusive is looking for a skilled Cloud Data Engineering Manager to lead our team in the design, implementation, and maintenance of our cloud-based data architecture.We are seeking a professional with a strong background in cloud computing, big data, and data engineering. The ideal candidate will have hands-on experience...


  • Whippany, United States Bayer U.S. LLC Full time

    Senior Data Engineer for Whippany, NJ to translate business & IT strategy into technology solutions; design IT architecture & artifacts; develop, evaluate & update IT architecture strategy and landscape roadmaps; contribute to business prioritization, planning & optimization initiatives; guide evaluation & selection of strategic technology; forecast outcomes...

  • Data Architect

    6 months ago


    Whippany, United States eTeam Full time

    What you need Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS) Minimum of 10 years of experience in big data, database and data warehouse architecture and delivery Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, AutoScaling, CloudFormation,...

  • Chief Data Architect

    3 weeks ago


    whippany, United States Metropolitan Life Insurance Company Full time

    City/Cities Cary, Tampa, Whippany Country United States Working Schedule Full-Time Work Arrangement Hybrid Travel Required 10% Relocation Assistance Available No Posted Date 23-Sep-2024 Job ID 4280 Description and Requirements The TeamOn MetLife’s Global Technology team, what you build here matters. We...


  • Whippany, New Jersey, United States Suburban Propane Full time

    Job OverviewWe are seeking a highly skilled Data Engineer Manager to join our team at Suburban Propane. As a key member of our data management team, you will be responsible for overseeing the architecture and management of our data systems.


  • Whippany, United States Capgemini Full time

    Title - Python Pyspark DeveloperLocation - Whippany NJ (Hybrid)Duration - FulltimeKey ResponsibilitiesWe are looking for a highly skilled Python/PySpark Developer with hands-on experience in Big Data technologies to join our dynamic data engineering team.The ideal candidate will have a strong background in building scalable distributed data processing...


  • Whippany, United States American Global Co Full time

    Position Overview: We are looking for an Infrastructure & Data Analyst to join our Infrastructure team. In this role, you will support insurance advisory mandates, gathering, analyzing, and synthesizing data from diverse sources to help inform risk management and insurance strategies for major construction and infrastructure projects. Key Responsibilities: ...

  • Technical Lead

    7 days ago


    Whippany, New Jersey, United States Bayer U.S. LLC Full time

    We are seeking a Senior Data Engineer to translate business & IT strategy into technology solutions; design IT architecture & artifacts; develop, evaluate & update IT architecture strategy and landscape roadmaps; contribute to business prioritization, planning & optimization initiatives; guide evaluation & selection of strategic technology; forecast outcomes...


  • Whippany, United States NR Consulting Full time

    Title: Senior Financial Data Analyst Location: Whippany, NJ (Hybrid model 2/3 days in office) Evaluation Process: In Person interview during evaluation process Type: Contract Duration: Long Term Job Description: Financial certifications like CFA, CPA, FRM bility to map and trace data from various source systems to solve a given business problem ...


  • Whippany, United States Iceberg Cyber Security Full time

    I am representing a leading Tier 1 financial institution seeking a talented and experienced Senior Cyber Fraud Engineer to play a key role in bridging the gap between cybersecurity and data to combat financial crime and fraud. This is a unique opportunity to work with a dynamic team at the forefront of financial security.Our client is looking for a highly...


  • whippany, United States Iceberg Cyber Security Full time

    I am representing a leading Tier 1 financial institution seeking a talented and experienced Senior Cyber Fraud Engineer to play a key role in bridging the gap between cybersecurity and data to combat financial crime and fraud. This is a unique opportunity to work with a dynamic team at the forefront of financial security.Our client is looking for a highly...

  • Security Engineer

    1 week ago


    Whippany, United States Barclays Full time

    Job Description Purpose of the role To manage change projects that help the organisation achieve its strategic objectives, while ensuring that projects are delivered on time, within budget, in control and in compliance with regulatory requirements and internal policies and procedures. Accountabilities Management of change projects within the organisation,...

  • Security Engineer

    1 week ago


    Whippany, United States Barclays Full time

    Job Description Purpose of the role To manage change projects that help the organisation achieve its strategic objectives, while ensuring that projects are delivered on time, within budget, in control and in compliance with regulatory requirements and internal policies and procedures. Accountabilities Management of change projects within the organisation,...

  • AWS Cloud Engineer

    5 months ago


    Whippany, United States CapB InfoteK Full time

    For one of our ongoing multiyear projects we are looking for an AWS Engineer out of Whippany, NJ. In depth knowledge of AWS IaaS and PaaS services • Well versed with Cloud design patterns • Designing and developing of automation tools and infrastructure to run service-oriented stacks on an internal data centers, Public and Private clouds • Experience...

  • Database Engineer

    7 days ago


    Whippany, New Jersey, United States Saxon Global Full time

    Job Description:We are seeking a seasoned Database Engineer - Senior SQL to join our team at Saxon Global. As a key member of our database team, you will be responsible for designing, implementing, and maintaining large-scale PostgreSQL databases.Responsibilities:Implement database enhancements to deliver committed customer project objectives.Develop and...


  • Whippany, United States Barclays Full time

    Job Description Purpose of the role To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues. Accountabilities Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks,...

  • Cloud Engineer

    1 week ago


    Whippany, New Jersey, United States PSKW LLC dba ConnectiveRx LLC Full time

    OverviewWe are seeking a highly skilled Cloud Engineer to join our team in Whippany, NJ. As a Cloud Engineer, you will be responsible for designing and implementing global infrastructure solutions using AWS cloud services.Job DescriptionThis is a full-time position that requires 5+ years of IT experience, with a focus on cloud technology. The ideal candidate...