Big Data Hadoop Engineer

3 days ago

Charlotte, United States Aloden, Inc. Full time
Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer)
Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH)

Job Descriptions:
  • In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors.
  • Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables.
  • Strategically collaborate and consult with client personnel.
Required Qualifications:
  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.
  • Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
  • Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
  • Design and develop automated testing framework to perform data validation.
  • Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations.
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
  • Support ongoing data management efforts for Development, QA and Production environments
  • Provide tool support, help consumers troubleshooting pipeline issues.
  • Utilizes a thorough understanding of available technology, tools, and existing designs.
  • Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.
Required Qualification:
  • 5+ years of experience of software engineering experience
  • 5+ years of experience delivering complex enterprise wide information technology solutions
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
  • 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats
  • 6+ years of ETL (Extract, Transform, Load) Programming experience
  • 2+ years of Kafka or equivalent experience
  • 2+ years of NoSQL DB like Couchbase/MongoDB experience.
  • 5+ experience working with complex SQLs and performance tuning
Desired Qualification:
  • 3+ years of Agile experience
  • 2+ years of reporting experience, analytics experience or a combination of both
  • 2+ years of operational risk or credit risk or compliance domain experience
  • 2+ years of experience integrating with RESTful API
  • 2+ years of experience with CICD tools.

  • Big Data Hadoop Developer

    2 weeks ago

    Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job Title: Big Data Hadoop DeveloperJob Summary:We are seeking a highly skilled Big Data Hadoop Developer to join our team at Aloden, Inc. As a key member of our software engineering team, you will be responsible for designing and implementing automated spark-based frameworks to facilitate data ingestion, transformation, and consumption.Key...

  • Big Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and other big data technologies.Key Responsibilities:Design and implement data pipelines using...

  • Big Data Engineer

    3 weeks ago

    Charlotte, United States Collabera LLC Full time

    Experience in MapR, Hadoop, Scala, Pyspark and Java08- 10+ years of application development and implementation experienceExperience in Hadoop ecosystem tools for real-time batch data ingestion, processing and provisioning.Experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as HadoopExperience of Java or...

  • Big Data Engineer

    1 month ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and other big data technologies.Key Responsibilities:Design and implement data pipelines using...

  • Big Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Data EngineerJob Summary: We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. The successful candidate will have expertise in Big Data technologies, including Hadoop, Spark, and Scala. They will be responsible for designing, developing, and maintaining large-scale data processing systems, as well as providing...

  • Big Data Engineer

    1 month ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerAt Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and MapR.Key Responsibilities:Design and...

  • Big Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerAt Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key Responsibilities:Design and implement data pipelines...

  • Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Collabera Full time

    Job DescriptionCollabera is seeking a skilled Big Data Engineer to join our team. The ideal candidate will have experience in MapR, Hadoop, Scala, PySpark, and Java, with a strong background in application development and implementation. Key ResponsibilitiesDesign and implement big-data architecture using HadoopDevelop ETL, data warehouse, and data analytics...

  • Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and MapR.Key Responsibilities:- Design and develop...

  • Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerJob Summary:Diverse Lynx LLC is seeking a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and Spark. You will work closely with our data science team to develop and deploy data pipelines,...

  • Big Data/Hadoop Application Architect

    2 weeks ago

    Charlotte, United States Genesis10 Full time

    Genesis10 is currently seeking a Big Data/Hadoop Application Architect with our client in the financial industry located in Charlotte, NC, Plano, TX, and Pennington, NJ. This is a 12+ month contract position. Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply...

  • Big Data Engineer

    3 days ago

    Charlotte, United States Diverse Lynx Full time

    Role-Big Data Engineer Location-Charlotte, NC Type- ContractRole Description: Data Engineer - Bigdata, Hadoop, Spark, Scala, PySpark, Strong SQL, Cloudera Data Platform (CDP), Primary Skills: Big Data: Spark, Scala, Pyspark, HDFS Microsoft Stack: MS-SQL with strong knowledge in RDBMS concepts Hadoop (Hortonworks) and Hiveo Cloudera Data platform (CDP)...

  • Senior Hadoop Engineer

    2 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    Job Title: Senior Hadoop EngineerJob Summary:We are seeking a skilled Senior Hadoop Engineer to join our team. The successful candidate will have a strong background in Hadoop administration and a proven track record of delivering complex technology initiatives.Key Responsibilities:Lead complex technology initiatives towards Hadoop platform stability and...

  • Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Randstad Full time

    Job Title: Data Engineer - Hadoop/Google Cloud ProfessionalJob Summary: We are seeking an experienced Data Engineer to join our team at Randstad Digital. The ideal candidate will have a strong background in Hadoop and Google Cloud Platform, with a proven track record of designing and optimizing complex data systems.Responsibilities: • Migrate data to...

  • Big Data/Hadoop QA Testing

    4 months ago

    Charlotte, United States Indotronix International Corporation Full time

    Role: Big Data Testing Primary Skill: Hadoop/Teradata/Agile Testing (Must have) Secondary Skill: Tosca (Good to have) Job Description: Experienced QA with expertise in Agile Functional, Teradata, Hadoop and Automation testing. Ability to lead the QA team across various LOBs. Ability to interface with onshore and offshore QA team for all QA and Cross...

  • Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Randstad Full time

    Job Title: Data Engineer - Hadoop/Google CloudJob Summary: We are seeking an experienced Data Engineer to join our team at Randstad Digital. The ideal candidate will have a strong background in Hadoop and Google Cloud Platform, with a proven track record of designing and optimizing complex data systems.Responsibilities:* Migrate data to Google Cloud...

  • Hadoop Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Lorven technologies Full time

    Job Title: Hadoop Data EngineerLocation: Charlotte, NCDuration: Long termJob description:Responsibilities:Design, develop, and maintain Hadoop-based data processing applications.Build, operate, monitor, and troubleshoot Hadoop infrastructure.Develop tools and libraries to support data access and processing.Write and optimize MapReduce programs.Implement data...

  • Big Data Engineer

    2 weeks ago

    charlotte, United States Collabera Full time

    Experience in MapR, Hadoop, Scala, Pyspark and Java 08- 10+ years of application development and implementation experience Experience in Hadoop ecosystem tools for real-time batch data ingestion, processing and provisioning. Experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop Experience of...

  • Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Collabera Full time

    Job Description:Collabera is seeking a highly skilled Data Architecture Specialist to join our team. The ideal candidate will have experience in designing and implementing big-data architecture using Hadoop ecosystem tools. Key responsibilities include delivering ETL, data warehouse, and data analytics capabilities. The successful candidate will have a...

  • Big Data Engineer

    2 weeks ago

    Charlotte, United States Collabera Full time

    Experience in MapR, Hadoop, Scala, Pyspark and JavaDo you have the following skills, experience and drive to succeed in this role Find out below. 08- 10+ years of application development and implementation experience Experience in Hadoop ecosystem tools for real-time batch data ingestion, processing and provisioning. Experience delivering ETL, data warehouse...