BigData Engineer

1 week ago

Raleigh, United States SysMind Tech Full time

9+ yrs IT experience and good expertise in SDLC/Agile
5+ yrs in Big Data technologies Hadoop, AWS, Python, Scala, Kafka, Spark etc

Mandatory:

Good listing skills to understand business objectives and collaborate well with team and business partners

Proficient in data consolidation/flattening, optimizing 'Big-Data' pipelines, architecture, and large data sets.

Hands on experience in writing complex queries on data sets in Hadoop and mongoDB

Good experience in implementing Kafka, spark streaming, Mongo db and Shell scripting

Hands on experience in migrating Hadoop on-prem to cloud AWS/Snowflake

Enable/recommend proactive measures to enhance data quality and improve SLA of Production components