Hadoop ETL Developer

2 months ago


Charlotte, United States Motion Recruitment Full time

Outstanding long-term contract opportunity A well-known Financial Services Company is looking for a Hadoop ETL Engineer in Charlotte NC (Hybrid).


Job Expectations:

  • Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
  • Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
  • Design and develop automated testing framework to perform data validation.
  • Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations.
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist


Required Qualification:

  • 5+ years of experience of software engineering experience
  • 5+ years of experience delivering complex enterprise wide information technology solutions
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
  • 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats
  • 6+ years of ETL (Extract, Transform, Load) Programming experience
  • 2+ years of Kafka or equivalent experience
  • 2+ years of NoSQL DB like Couchbase/MongoDB experience.
  • 5+ experience working with complex SQLs and performance tuning


  • Hadoop ETL Developer

    2 months ago


    Charlotte, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop ETL Engineer in Charlotte NC (Hybrid).Job Expectations:Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.Implement security protocols such as Kerberos Authentication, Encryption of data at...

  • Hadoop ETL Developer

    2 months ago


    Charlotte, North Carolina, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity A well-known Financial Services Company is looking for a Hadoop ETL Engineer in Charlotte NC (Hybrid).Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package Our client has been around for over 150...


  • Charlotte, United States Luytens Technology Solutions Pvt. Ltd. Full time

    Job DescriptionJob DescriptionHadoop/Informatica Developer -L3 Production SupportLocation: Charlotte ,NC /Atlanta& ,GA(Hybrid-3 days office 2 days remote)Duration: 12 Months& JD::& & Hadoop Dev, previous Informatica ETL and now Hadoop ETL Developer.This is L3 Production Support of Treasury Systems.& 80% production support with oncall rotation.& Must...

  • Java Hadoop Developer

    2 weeks ago


    Charlotte, United States Pyramid Consulting Full time

    Immediate need for a talented Java Hadoop Developer. This is a 06+months contract opportunity with long-term potential and is located in Charlotte, NC (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38490Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance...

  • Java Hadoop Developer

    3 weeks ago


    Charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Java Hadoop Developer. This is a 06+months contract opportunity with long-term potential and is located in Charlotte, NC (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38490 Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance...

  • Java Hadoop Developer

    3 weeks ago


    Charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Java Hadoop Developer. This is a 06+months contract opportunity with long-term potential and is located in Charlotte, NC (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38490 Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance...

  • Hadoop Developer

    3 months ago


    Charlotte, United States The Dignify Solutions LLC Full time

    8+ years of overall IT experience with more that 4+ years of experience in Hadoop/Big Data technologies (HDFS, SQOOP, Hive, Pig, Spark, Impala, Oozie etc.) Strong Hands-on experience in working with Cloudera Data Hadoop (CDH) and Cloudera Distribution (CDP) on Hadoop, Kerberos AD Integration, Upgradation to new CDP versions and migration Strong...

  • Sr. Data Engineer

    2 weeks ago


    Charlotte, United States raag solutions Full time

    ONLY LOCAL CANDIDATES NO C2C, NO H1 TRANSFERS Top 5 Skills : Python Spark/PySpark BigData Ecosystem ( Hadoop , HIVE , Hbase etc ) ETL/Informatica Heavy SQL Experience in Teradata 16.x , SQL/BTEQ scripting, TPT, Informatica 10.x UNIX Shell scripting, Autosys, Cloudera CDP, Hadoop (Hive, Impala, PySpark, Scala) and Data analysis. Strong Data sourcing, data...


  • Charlotte, North Carolina, United States The Dignify Solutions LLC Full time

    Senior Big Data Engineer RoleOverview: We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Hadoop and related technologies. The ideal candidate will have a proven track record in delivering high-quality data solutions.Experience: Over 8 years in the IT industry, with a minimum of 4 years specializing in Hadoop and Big Data...


  • Charlotte, North Carolina, United States The Dignify Solutions LLC Full time

    Senior Big Data Engineer RoleOverview: We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Hadoop and related technologies to join our team at The Dignify Solutions LLC.Key Responsibilities:Possess over 8 years of IT experience, with a minimum of 4 years dedicated to Hadoop and Big Data frameworks.Demonstrate strong...


  • Charlotte, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionEmployment type Full TimeJob Title Angular Developer with HadoopJob Location Charlotte, NCDuration Full TimeExperience level 10+ yrsMandatory Skills Angular and HAdoopJob Description Angular Developer with HadoopTekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age,...

  • SQL SSIS ETL Developer

    2 months ago


    Charlotte, United States Motion Recruitment Partners LLC Full time

    SQL SSIS ETL Developer CHARLOTTE, North Carolina Hybrid Contract $70.32/hr - $77.67/hr Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's...

  • Hadoop Developer

    1 month ago


    Charlotte, North Carolina, United States ICONMA, LLC Full time

    As an Hadoop developer to support production and project work in the GTS Data space, the individual will be responsible for understanding the requirements, design and functionality of the jobs and propose strategic solutions and innovative tactical work-around solutions as needed.Th


  • Charlotte, United States Aloden, Inc. Full time

    Software Engineer - .Net Full Stack with ETL and Data Modeling ExpertiseLocation: Charlotte, NC (Hybrid - 3 days onsite, 2 days WFH) Duration: 12+ Months Contract Responsibilities: Participate in and consult on moderately complex software engineering initiatives and deliverables. Contribute to large-scale planning efforts related to software engineering...

  • ETL Developer

    2 months ago


    Charlotte, United States Randstad Digital Full time

    Get a high score on this assessment and you'll be first to interview. The hiring Manager asked that we find ETL Informatica Candidates with Python and AWS Glue Experience. Fully Remote OK. EST Hours.ResponsibilitiesWrite fast and performant database queries using a flavor of SQL Server, such as MySQL, MSSQL, or PostgreSQLTroubleshooting and problem-solving...


  • Charlotte, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data ETL Engineer in Charlotte, NC (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over...


  • Charlotte, United States CapB InfoteK Full time

    For one of our long-term multiyear projects, we are looking for an Application Consultant - Lead Hadoop/Spark-Scala out of Charlotte, NC. Primary Skill- Ab Initio Secondary Skill - Hadoop 7+ experience with Spark/Scala, Hadoop, Java Good Knowledge in ETL Tools (Abinitio/talend/informatica) and Scheduling tools (Autosys preferred) Good Knowledge in Hadoop...


  • Charlotte, North Carolina, United States Motion Recruitment Partners LLC Full time

    About the RoleMotion Recruitment Partners LLC is seeking a highly skilled Senior Data Engineer to join our team as a SQL SSIS ETL Developer. This is a long-term contract opportunity that includes a competitive benefit package.Key ResponsibilitiesDesign, code, test, debug, and document complex data warehouse solutions using SQL Server, Oracle, and MySQL.Lead...


  • Charlotte, United States Motion Recruitment Partners LLC Full time

    SQL SSIS ETL Developer CHARLOTTE, North Carolina Hybrid Contract $70.32/hr - $77.67/hr Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age....

  • Hadoop Developer

    1 month ago


    Charlotte, United States Synechron Full time

    Our ChallengeAs a Hadoop developer, the role encompasses the full development lifecycle: requirements, design, develop, documentation, test and deployment.Salary: $90K-100K per annumThe RoleResponsibilitiesThe candidate will be responsible to Participate in the design, development and implementation of complex applications, often using new technologiesThe...