Big Data Engineer(Infra)
5 days ago
Iris’s client, one of their Banking client is looking to hire Bigdata Infra Engineer for Whippany, NJ /Wilmington, DE (Hybrid)
Location – Whippany, NJ /Wilmington, DE (Hybrid)
Tech stack : Big Data, Performance Tunning, Backup & Recovery, Cluster, HDFS, Hadoop Infrastructure
- Responsible for implementation and ongoing administration of Hadoop infrastructure, cluster maintenance as well as creation and removal of nodes.
- HDFS support and maintenance, Backup and restores.
- Cluster Monitoring and Troubleshooting.
- Manage and review Hadoop log files. File system management and monitoring. Implement and maintain security. Data capacity and node forecasting and planning.
- Will install operating system and Hadoop updates, patches, version upgrades as required. Also closely working with the network, application, and business intelligence teams to ensure data quality and availability.
- Be able to support Data Scientist/Engineering team for trouble-shooting on day-to-day issues on Hadoop Cluster and other application components.
- This role requires a wide variety of strengths and capabilities, including: BS/BA degree or equivalent experience Basic knowledge of application development.
- Working knowledge in one or more general purpose programming languages, plus an interest in learning other coding languages and skills as needed.
- Working knowledge of development toolset to design, develop, test, deploy, maintain and improve software.
- Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals.
- 7 or more years of Knowledge in Linux and Unix shell scripting, Infrastructure Administration Knowledge in Kerberos and Keon Security.
- Knowledge or experience working with structured and unstructured data, ETL, and scripting languages
- Experience in managing large cluster ecosystem, including new hardware design/build/deployments Demonstrated Experience in Hadoop, Cloudera, MapReduce, along with supporting tools Pig, Sqoop, Splunk, Hive, Sentry, Nifi, Flink
Thanks & Regards
Sunil Kamboj
Sr. Executive - TA
Iris Software
www.irissoftware.com
-
whippany, United States Iris Software Inc. Full timeIris’s client, one of their Banking client is looking to hire Bigdata Infra Engineer for Whippany, NJ /Wilmington, DE (Hybrid) Location – Whippany, NJ /Wilmington, DE (Hybrid)Tech stack : Big Data, Performance Tunning, Backup & Recovery, Cluster, HDFS, Hadoop InfrastructureResponsible for implementation and ongoing administration of Hadoop...
-
Aws Big data Developer
3 days ago
Whippany, United States SysMind Tech Full time•AWS, Big Data, Scala, Python, Spark, Performance tuning, Big data processing, Infrastructure maintenance, •Quantexa framework, AML domain knowledge, Autosys batch processing, CI/CD pipeline, CHEF deployments •Need to develop and maintain applications using Bigdata framework and AWS technologies. Must know the Spark and Scala technologies.
-
Aws Big data Developer
2 weeks ago
Whippany, United States SysMind Tech Full time• AWS, Big Data, Scala, Python, Spark, Performance tuning, Big data processing, Infrastructure maintenance, • Quantexa framework, AML domain knowledge, Autosys batch processing, CI/CD pipeline, CHEF deployments • Need to develop and maintain applications using Bigdata framework and AWS technologies. Must know the Spark and Scala technologies.
-
Data Architect Specialist
7 days ago
Whippany, New Jersey, United States Omni Inclusive Full timeCloud Data Engineering ManagerOmni Inclusive is looking for a skilled Cloud Data Engineering Manager to lead our team in the design, implementation, and maintenance of our cloud-based data architecture.We are seeking a professional with a strong background in cloud computing, big data, and data engineering. The ideal candidate will have hands-on experience...
-
Senior Data Engineer
1 week ago
Whippany, United States Bayer U.S. LLC Full timeSenior Data Engineer for Whippany, NJ to translate business & IT strategy into technology solutions; design IT architecture & artifacts; develop, evaluate & update IT architecture strategy and landscape roadmaps; contribute to business prioritization, planning & optimization initiatives; guide evaluation & selection of strategic technology; forecast outcomes...
-
Data Architect
6 months ago
Whippany, United States eTeam Full timeWhat you need Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS) Minimum of 10 years of experience in big data, database and data warehouse architecture and delivery Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, AutoScaling, CloudFormation,...
-
Chief Data Architect
3 weeks ago
whippany, United States Metropolitan Life Insurance Company Full timeCity/Cities Cary, Tampa, Whippany Country United States Working Schedule Full-Time Work Arrangement Hybrid Travel Required 10% Relocation Assistance Available No Posted Date 23-Sep-2024 Job ID 4280 Description and Requirements The TeamOn MetLife’s Global Technology team, what you build here matters. We...
-
Data Architecture Specialist
5 days ago
Whippany, New Jersey, United States Suburban Propane Full timeJob OverviewWe are seeking a highly skilled Data Engineer Manager to join our team at Suburban Propane. As a key member of our data management team, you will be responsible for overseeing the architecture and management of our data systems.
-
Python Pyspark Developer
1 month ago
Whippany, United States Capgemini Full timeTitle - Python Pyspark DeveloperLocation - Whippany NJ (Hybrid)Duration - FulltimeKey ResponsibilitiesWe are looking for a highly skilled Python/PySpark Developer with hands-on experience in Big Data technologies to join our dynamic data engineering team.The ideal candidate will have a strong background in building scalable distributed data processing...
-
Infrastructure & Data Associate
3 weeks ago
Whippany, United States American Global Co Full timePosition Overview: We are looking for an Infrastructure & Data Analyst to join our Infrastructure team. In this role, you will support insurance advisory mandates, gathering, analyzing, and synthesizing data from diverse sources to help inform risk management and insurance strategies for major construction and infrastructure projects. Key Responsibilities: ...
-
Technical Lead
7 days ago
Whippany, New Jersey, United States Bayer U.S. LLC Full timeWe are seeking a Senior Data Engineer to translate business & IT strategy into technology solutions; design IT architecture & artifacts; develop, evaluate & update IT architecture strategy and landscape roadmaps; contribute to business prioritization, planning & optimization initiatives; guide evaluation & selection of strategic technology; forecast outcomes...
-
Senior Financial Data Analyst
4 weeks ago
Whippany, United States NR Consulting Full timeTitle: Senior Financial Data Analyst Location: Whippany, NJ (Hybrid model 2/3 days in office) Evaluation Process: In Person interview during evaluation process Type: Contract Duration: Long Term Job Description: Financial certifications like CFA, CPA, FRM bility to map and trace data from various source systems to solve a given business problem ...
-
Senior Cyber Fraud Engineer
4 weeks ago
Whippany, United States Iceberg Cyber Security Full timeI am representing a leading Tier 1 financial institution seeking a talented and experienced Senior Cyber Fraud Engineer to play a key role in bridging the gap between cybersecurity and data to combat financial crime and fraud. This is a unique opportunity to work with a dynamic team at the forefront of financial security.Our client is looking for a highly...
-
Senior Cyber Fraud Engineer
4 weeks ago
whippany, United States Iceberg Cyber Security Full timeI am representing a leading Tier 1 financial institution seeking a talented and experienced Senior Cyber Fraud Engineer to play a key role in bridging the gap between cybersecurity and data to combat financial crime and fraud. This is a unique opportunity to work with a dynamic team at the forefront of financial security.Our client is looking for a highly...
-
Security Engineer
1 week ago
Whippany, United States Barclays Full timeJob Description Purpose of the role To manage change projects that help the organisation achieve its strategic objectives, while ensuring that projects are delivered on time, within budget, in control and in compliance with regulatory requirements and internal policies and procedures. Accountabilities Management of change projects within the organisation,...
-
Security Engineer
1 week ago
Whippany, United States Barclays Full timeJob Description Purpose of the role To manage change projects that help the organisation achieve its strategic objectives, while ensuring that projects are delivered on time, within budget, in control and in compliance with regulatory requirements and internal policies and procedures. Accountabilities Management of change projects within the organisation,...
-
AWS Cloud Engineer
5 months ago
Whippany, United States CapB InfoteK Full timeFor one of our ongoing multiyear projects we are looking for an AWS Engineer out of Whippany, NJ. In depth knowledge of AWS IaaS and PaaS services • Well versed with Cloud design patterns • Designing and developing of automation tools and infrastructure to run service-oriented stacks on an internal data centers, Public and Private clouds • Experience...
-
Database Engineer
7 days ago
Whippany, New Jersey, United States Saxon Global Full timeJob Description:We are seeking a seasoned Database Engineer - Senior SQL to join our team at Saxon Global. As a key member of our database team, you will be responsible for designing, implementing, and maintaining large-scale PostgreSQL databases.Responsibilities:Implement database enhancements to deliver committed customer project objectives.Develop and...
-
AVP Software Engineer
1 week ago
Whippany, United States Barclays Full timeJob Description Purpose of the role To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues. Accountabilities Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks,...
-
Cloud Engineer
1 week ago
Whippany, New Jersey, United States PSKW LLC dba ConnectiveRx LLC Full timeOverviewWe are seeking a highly skilled Cloud Engineer to join our team in Whippany, NJ. As a Cloud Engineer, you will be responsible for designing and implementing global infrastructure solutions using AWS cloud services.Job DescriptionThis is a full-time position that requires 5+ years of IT experience, with a focus on cloud technology. The ideal candidate...