Hadoop Data Engineer at New York

2 weeks ago


New York, United States CapB InfoteK Full time

The ETL Hadoop Data Engineer will be responsible for analyzing the business requirements design develop and implement highly efficient highly scalable ETL processes
Candidate is required to perform daily project functions with a focus on meeting the business objectives on time in rapidly changing work environment and should be able to lead and drive globally located team to achieve business objectives

Required Skills
3 8 years of hands on experience working with ETL Hadoop Knowledge of various components of Hadoop ecosystem and experience in applying them to practical problems Hive Impala Spark Strong knowledge of working with relational databases like Teradata DB2 Oracle Sql server
Hands on experience in writing shell scripts on Unix platform Experience in data warehousing ETL tools MPP database systems
Understanding of Data Models Conceptual Logical and Physical Dimensional Relational Data Model Design Analyze functional specifications and assist in designing potential technical solutions Identifies data sources and works with source system team and data analyst to define data extraction methodologies
Good knowledge in writing complex queries in Teradata DB2 Oracle PL SQL Maintain batch processing jobs and respond to critical production issues communicate well with stakeholders on his her proposal recommendations
Knowledge status risks regarding delivering solution on time
Strong experience with Data Analysis Data Profiling Root Cause Analysis
Should able to understand Banking system processes and data flow
Can work independently lead and mentor the team.


  • Data Engineer

    6 days ago


    New York, United States New York Blood Center Full time

    Data EngineerJob Locations US-NY-New YorkJob ID 2024-6284Category Information TechnologyMinimum Rate USD $100,000.00/Yr.Maximum Rate USD $115,000.00/Yr.Work Location Type HybridOverviewAt New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge...

  • Hadoop Developer

    1 day ago


    New York, United States Webologix Ltd INC Full time

    Job Title: “Hadoop developer” Locations: Newark, Atlanta, Plano, Pennington, Charlotte Type of hire: Fulltime Job Description: Responsibilities Write software to interact with HDFS (Hadoop Distributed File System) and MapReduce . Assess requirements and evaluate existing solutions. Build, operate, monitor, and troubleshoot Hadoop infrastructure . Develop...

  • Data Engineer

    1 week ago


    New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...

  • Data Engineer

    2 weeks ago


    New York, United States The New York Public Library Full time

    Overview This is a temporary four-year grant-funded position. The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you’ll have the opportunity to contribute to new and existing data pipelines that help the library understand our activities and support many staff members in making important decisions...

  • Lead Data Engineer

    3 weeks ago


    New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...


  • New York, United States Reddit Full time

    **Data Warehouse Engineer** at Reddit New York Our mission is to bring community and belonging to everyone in the world. Reddit is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communities daily, it is home to the most...


  • New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center, one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse...


  • New York, United States New York Blood Center Full time

    Donor Relations Associate-New York, NY Job Locations US-NY-New York Job ID 2024-5607 Category Administrative/Clerical Minimum Rate USD $16.00/Hr. Maximum Rate USD $16.00/Hr. Work Location Type Physical Overview At New York Blood Center, one of the most comprehensive blood centers in...


  • New York, United States New York Blood Center Full time

    Overview At New York Blood Center, one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse...

  • Data Engineer

    4 weeks ago


    New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following • Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines • Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. • Ensures the upkeep of the Hadoop Data Lake Platform...

  • Data Engineering Lead

    4 weeks ago


    New York, United States Bayforce Full time

    Position: Data Engineering Lead (Permanent Direct Hire)Location: New York, NYMaximum Salary: $188,700Target Salary: $160,000We're excited to announce a fantastic opportunity for a Data Engineering Lead to join our team in New York, NY. This is a permanent direct hire position with competitive compensation.Role Description:As the Data Engineering Lead, you...

  • Data Engineer

    4 weeks ago


    New York, New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. Ensures the upkeep of the Hadoop Data Lake Platform by monitoring...


  • New York, United States New York Cleaning Wizards Full time

    Overview: We are seeking Residential Cleaning Subcontractors to join our team. If you have experience in residential cleaning, hotel housekeeping, commercial cleaning, or related fields, we want to hear from you. **Responsibilities**: - Clean and sanitize designated areas, including but not limited to restrooms, offices, common areas, and kitchens - Sweep,...

  • data scientist:

    1 month ago


    New York, New York, United States Veracity Software Inc. Full time

    Looking For Data Scientist Candidates (Expi.1- 10)Veracity Software Inc. – New Jersey NJData ScientistHiring For Data Scientist Candidates (Fresher's/ Experience)Veracity Software Inc. – New York NYData ScientistWe are hiring Data Scientists (Exp 2-8 years) for multiple positions. Kindly go through below mentioned details and let me know if you would be...

  • Senior AEM Engineer

    7 days ago


    New York, United States New York Technology Partners Full time

    Title: Senior AEM EngineerLocation: New York, NY (Hybrid)Position Type: ContractJob DescriptionWork with data integration technologies to design and implement new solutions and processes for clients to support new customer experience strategiesWork with business and technology client representatives to gather functional and technical requirementsServe as a...


  • New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center, one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse...


  • New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...


  • New York, NY, United States Goldman Sachs Full time

    YOUR IMPACT Are you passionate about developing mission-critical, high quality software solutions, using cutting-edge technology, in a dynamic environment? OUR IMPACT We are Compliance Engineering, a global team of more than 300 engineers and scientists who work on the most complex, mission-critical problems We: build and operate a suite of...


  • New York, United States New York Blood Center Full time

    Senior Software EngineerJob Locations US-NY-New YorkJob ID 2024-5635Category Information TechnologyMinimum Rate USD $136,000.00/Yr.Maximum Rate USD $146,000.00/Yr.Work Location Type HybridOverviewNew York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging...


  • New Britain, United States Elajika Inc Full time

    Job Title Hadoop Consultant | PythonLocation New Britain CTJob type ContractDuration 6+ monthsJob Details -Must Have Skills - Minimum Experience 5 years of experienced candidate Strong working experience on Big Data / Hadoop Strong hands-on experience over Python HivePreferredAgile scrum methodologiesDescription End-to-end work experience...