Lead Hadoop Big Data Engineer

4 weeks ago


Cleveland, United States TEK Connexion Full time

Position Title: Lead Hadoop Big Data Engineer

Position Location: Hybrid - 3 office / 2 remote

  • 1st Preference - Strongsville/Cleveland/Columbus OH
  • 2nd Preference - Pittsburgh, PA, Birmingham, AL, Dallas, TX, Phoenix, AZ


Must Have Technical Skills:

Hadoop Big Data Engineer with PySpark, HQL, Python skills.

Hadoop Platform utilities - Hive, Oozie, Yarn, Impala, HDFS, Hbase- Hue, Beeline

Python and Shell Programming (PySpark) - Python 2.7, 0

DSP (Data Streaming Platform) - Kafka Confluent

  • Model Implementation - PySpark
  • Data science-based libraries (SciPy, Pandas etc) - Jupyterhub, Jupyter Notebooks, Anaconda
  • Deep Learning - Keras , tensorflow, Pytorch - Jupyterhub, Jupyter Notebooks, Anaconda
  • Time series Modelling - Jupyterhub, Jupyter Notebooks, Anaconda
  • Model Extraction - Data Robot

CA7 Mainframe

  • Familiarity of the Hadoop technology stack and utilities associated
  • Python used for all data engineering tasks like ingest, ETL and aggregation
  • Building consumer and producers apps to consume real time events
  • To manage Kafka based dependent java libraries
  • Object oriented programming language for data processing


Education:

  • Bachelor's degree required.
  • Certs not required, but please notate in Comments what certs a candidate possesses.


Years Required:

  • Lead – 8+ yrs


Soft Skills:

  • Attention to detail, team player, and self-starter.


  • Cleveland, United States TEK Connexion Full time

    Position Title: Lead Hadoop Big Data Engineer Position Location: Hybrid - 3 office / 2 remote 1st Preference - Strongsville/Cleveland/Columbus OH 2nd Preference - Pittsburgh, PA, Birmingham, AL, Dallas, TX, Phoenix, AZ Must Have Technical Skills: Hadoop Big Data Engineer with PySpark, HQL, Python skills. Hadoop Platform utilities - Hive, Oozie, Yarn,...


  • Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Hadoop Data Integrator

    2 months ago


    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...


  • Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...


  • Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Technical Lead

    2 weeks ago


    Cleveland, United States Tata Consultancy Services Full time

    Skill: Tech Lead - Hadoop Candidate shell have 6+ years of experience. Full stack big data developer, python, hive, impala, hdfs, java, ranger, sqoop, linux, the whole 9 yards. Build, operate, monitor, and troubleshoot Hadoop infrastructure. Develop documentation and playbooks to operate Hadoop infrastructure. Write software to ingest data into Hadoop....

  • Lead Data Engineer

    2 weeks ago


    Cleveland, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...

  • Lead Data Engineer

    2 weeks ago


    Cleveland, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...

  • Lead Data Engineer

    4 days ago


    Cleveland, United States The Sherwin-Williams Company Full time

    The Lead Data Engineer in the Architecture, Experience, Digital Platforms and Strategy department within Digital Technology is responsible and accountable to lead the design, development, testing, analysis, documentation, implementation, and support of the Enterprise Data Platform processes and related infrastructure. The Lead Data Engineer is also...

  • Ab Initio Lead

    2 weeks ago


    Cleveland, United States The Dignify Solutions LLC Full time

    •Lead and own all technical aspects of ETL projects from Requirement till Implementation. •Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool •Should have minimum 1+ years of hands-on experience with Google Cloud Technologies •Basics of Pyhton •Should have minimum 3+ years of hands-on experience with Teradata & Hadoop...

  • Technical Lead

    3 weeks ago


    Cleveland, United States Tata Consultancy Services Full time

    Skill: Ab Initio Tech Lead Ab Initio, UNIX, Teradat, Hadoop, Google BigWuery, Google Cloud Storage. Basics of data processing tools in GCP and Python Basics. Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool. Should have minimum 1+ years of hands-on experience with Google Cloud Technologies. Basics of Python. Should have minimum 3+...

  • Staff Data Engineer

    3 weeks ago


    Cleveland, United States Splash Financial Full time

    Job DescriptionJob DescriptionABOUT OUR COMPANY:The crushing weight of debt is something that we believe holds people back from reaching their dreams and making a splash in the world. So in 2013, after seeing our friends and family struggle with student loans, we created Splash Financial. Over the years, our mission has expanded to include helping people...

  • Data Engineer

    2 weeks ago


    Cleveland, United States Medical Mutual of Ohio Full time

    Theres a reason weve been selected as a Top Workplace in Northeast Ohio for 14 consecutive years. At Medical Mutual, we are committed to caring for our most valuable asset our dedicated employees. Founded in 1934, Medical Mutual is the oldest and one of the largest health insurance companies based in Ohio. We provide peace of mind to more than 1.6 million...

  • Data Engineer

    1 week ago


    Cleveland, United States Medical Mutual of Ohio Full time

    Theres a reason weve been selected as a Top Workplace in Northeast Ohio for 14 consecutive years. At Medical Mutual, we are committed to caring for our most valuable asset our dedicated employees. Founded in 1934, Medical Mutual is the oldest and one of the largest health insurance companies based in Ohio. We provide peace of mind to more than 1.6 million...

  • Data Engineer

    5 days ago


    Cleveland, United States Medical Mutual of Ohio Full time

    Theres a reason weve been selected as a Top Workplace in Northeast Ohio for 14 consecutive years. At Medical Mutual, we are committed to caring for our most valuable asset our dedicated employees. Founded in 1934, Medical Mutual is the oldest and one of the largest health insurance companies based in Ohio. We provide peace of mind to more than 1.6 million...

  • Data Engineer

    2 weeks ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...

  • Data Engineer

    1 week ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...

  • Data Engineer

    2 weeks ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...

  • Data Engineer

    1 week ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...

  • DevOps Data Engineer

    3 weeks ago


    Cleveland, United States ApTask Full time

    About Client: The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong...