Big Data Hadoop Engineer

7 days ago

Charlotte, United States Aloden, Inc. Full time
Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer)
Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH)

Job Descriptions:
  • In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors.
  • Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables.
  • Strategically collaborate and consult with client personnel.
Required Qualifications:
  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.
  • Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
  • Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
  • Design and develop automated testing framework to perform data validation.
  • Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations.
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
  • Support ongoing data management efforts for Development, QA and Production environments
  • Provide tool support, help consumers troubleshooting pipeline issues.
  • Utilizes a thorough understanding of available technology, tools, and existing designs.
  • Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.
Required Qualification:
  • 5+ years of experience of software engineering experience
  • 5+ years of experience delivering complex enterprise wide information technology solutions
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
  • 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats
  • 6+ years of ETL (Extract, Transform, Load) Programming experience
  • 2+ years of Kafka or equivalent experience
  • 2+ years of NoSQL DB like Couchbase/MongoDB experience.
  • 5+ experience working with complex SQLs and performance tuning
Desired Qualification:
  • 3+ years of Agile experience
  • 2+ years of reporting experience, analytics experience or a combination of both
  • 2+ years of operational risk or credit risk or compliance domain experience
  • 2+ years of experience integrating with RESTful API
  • 2+ years of experience with CICD tools.

  • Senior Data Engineer

    5 days ago

    Charlotte, North Carolina, United States ApTask Full time

    About This Role:Candidates for the Senior Data Engineer - Big Data Hadoop position at ApTask will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data Hadoop. The ideal candidate will have experience working with big data technologies, including Hadoop, PySpark, and Teradata, and will be able to...

  • Big Data Hadoop Engineer

    1 week ago

    Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...

  • Big Data Hadoop Engineer

    4 weeks ago

    Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...

  • Big Data Hadoop Developer

    4 weeks ago

    Charlotte, United States Collabera Full time

    Description Home Search Jobs Job Description Big Data Hadoop Developer Contract: Charlotte, North Carolina, US Salary: $70.00 Per Hour Job Code: 355675 End Date: 2024-12-07 Days Left: 20 days, 2 hours left Apply Job Title: Big Data Hadoop Developer Location: Charlotte NC (Hybrid) Duration: 12+ Months Contract Must Haves: Experience in MapR, Hadoop,...

  • Big Data Engineer

    4 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Role-Big Data Engineer Location-Charlotte, NC Type- ContractRole Description: Data Engineer - Bigdata, Hadoop, Spark, Scala, PySpark, Strong SQL, Cloudera Data Platform (CDP), Primary Skills: Big Data: Spark, Scala, Pyspark, HDFS Microsoft Stack: MS-SQL with strong knowledge in RDBMS concepts Hadoop (Hortonworks) and Hiveo Cloudera Data platform (CDP)...

  • Big Data Engineer

    1 week ago

    Charlotte, United States Diverse Lynx Full time

    Big Data Engineer with mapreduce , spark , hive , sql skillset" Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on...

  • Big Data/Hadoop QA Testing

    5 months ago

    Charlotte, United States Indotronix International Corporation Full time

    Role: Big Data Testing Primary Skill: Hadoop/Teradata/Agile Testing (Must have) Secondary Skill: Tosca (Good to have) Job Description: Experienced QA with expertise in Agile Functional, Teradata, Hadoop and Automation testing. Ability to lead the QA team across various LOBs. Ability to interface with onshore and offshore QA team for all QA and Cross...

  • Big Data Engineer

    3 days ago

    Charlotte, North Carolina, United States Atlantis IT group Full time

    About the RoleAt Atlantis IT group, we are seeking an experienced Big Data Engineer to join our team in Charlottte. This is a full-time W2 position that requires US citizenship or a Green Card.We need someone with expertise in Hadoop, Python, and Spark, as well as Pyspark and custom-built Spark SQL. MapR experience is preferred, but Hortonworks and Cloudera...

  • Big Data Engineering Lead

    1 week ago

    Charlotte, North Carolina, United States Motion Recruitment Full time

    We are seeking a highly skilled Big Data Engineering Lead to join our team at Motion Recruitment in Charlotte, NC. This full-time consulting assignment will be a long-term opportunity for the right candidate.The ideal candidate should have a strong understanding of big data development and experience working with Hadoop, Spark, Python, Scala, Unix, and SQL.A...

  • Senior / Lead Hadoop Engineer

    2 months ago

    Charlotte, United States NTT DATA Full time

    Req ID: 297836NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior / Lead Hadoop Engineer to join our team in Charlotte, North Carolina (US-NC), United States (US).Job Duties and...

  • Senior Big Data Engineer

    5 days ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering group, you will design, build, and maintain large-scale data processing systems using big data technologies such as Spark, Scala, and PySpark.The ideal candidate will have a strong background in big data, including...

  • Python/Big Data Engineer

    4 weeks ago

    Charlotte, United States Genesis10 Full time

    Genesis10 is currently seeking a Python/ Big Data Engineer with our client in the financial industry located in Charlotte, NC. This is a 12+ month contract position. Responsibilities: Consult as an expert to develop or influence initiatives and resources for highly complex business and technical needs across Engineering Consult on the strategy and...

  • Hadoop Developer

    1 month ago

    Charlotte, United States Collabera Full time

    About Collabera:Collabera is a leading global technology services and solutions provider committed to delivering high-quality, innovative solutions to our clients. Our diverse, global talent helps clients transform every aspect of their business and achieve exceptional results. We achieve success through collaboration and the use of our digital platforms....

  • Hadoop Developer

    4 weeks ago

    charlotte, United States Collabera Full time

    About Collabera:Collabera is a leading global technology services and solutions provider committed to delivering high-quality, innovative solutions to our clients. Our diverse, global talent helps clients transform every aspect of their business and achieve exceptional results. We achieve success through collaboration and the use of our digital platforms....

  • Hadoop Developer

    1 month ago

    charlotte, United States Collabera Full time

    About Collabera:Collabera is a leading global technology services and solutions provider committed to delivering high-quality, innovative solutions to our clients. Our diverse, global talent helps clients transform every aspect of their business and achieve exceptional results. We achieve success through collaboration and the use of our digital platforms....

  • Artificial Intelligence and Machine Learning Software Engineer

    1 week ago

    Charlotte, North Carolina, United States NTT DATA Full time

    We are seeking a highly skilled Artificial Intelligence and Machine Learning Software Engineer to join our team in Charlotte, North Carolina.Job DescriptionThe successful candidate will be responsible for designing and implementing AI and ML solutions using Python, Big Query, Hadoop, and other related technologies.A key part of this role will be working...

  • Data Engineering Specialist for Complex Big Data Solutions

    1 week ago

    Charlotte, North Carolina, United States Genesis10 Full time

    Job OverviewGenesis10 is currently seeking a highly skilled Python/Big Data Engineer to join our client in the financial industry in Charlotte, NC. This 12+ month contract position offers an exciting opportunity to leverage your expertise in developing innovative data solutions.About the RoleAs a Data Engineering Specialist, you will be responsible for...

  • Hadoop Developer

    6 days ago

    Charlotte, United States Experis Full time

    Position Title: Hadoop Developer Start Date: ASAP On-Site Location(s): Charlotte, NC On-Site Schedule: Hybrid # Of Openings: 1 Line of Business: Consumer Technology Contract Duration: 12-24 months (strong likelihood to convert to full-time) Candidate Citizenship Options: USC or GC - NO C2C *NO C2C* Group’s responsibility/Current Project and...

  • Data Science Engineer

    4 days ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About NTT DATA ServicesNTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications...

  • Big Data Engineer

    7 days ago

    Charlotte, United States Innova Full time

    Innova Solutions has a client that is immediately hiring for a Big Data Engineer.   Position Type: Full-time (Contract) Duration: 12+ Months Location: Charlotte, NC 28202 (Hybrid)   As a Big Data Engineer, you will:  Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.Review and analyse complex...