See more Collapse

Lead Hadoop Big Data Engineer

1 month ago

Cleveland, United States TEK Connexion Full time

Position Title: Lead Hadoop Big Data Engineer

Position Location: Hybrid - 3 office / 2 remote

  • 1st Preference - Strongsville/Cleveland/Columbus OH
  • 2nd Preference - Pittsburgh, PA, Birmingham, AL, Dallas, TX, Phoenix, AZ


Must Have Technical Skills:

Hadoop Big Data Engineer with PySpark, HQL, Python skills.

Hadoop Platform utilities - Hive, Oozie, Yarn, Impala, HDFS, Hbase- Hue, Beeline

Python and Shell Programming (PySpark) - Python 2.7, 0

DSP (Data Streaming Platform) - Kafka Confluent

  • Model Implementation - PySpark
  • Data science-based libraries (SciPy, Pandas etc) - Jupyterhub, Jupyter Notebooks, Anaconda
  • Deep Learning - Keras , tensorflow, Pytorch - Jupyterhub, Jupyter Notebooks, Anaconda
  • Time series Modelling - Jupyterhub, Jupyter Notebooks, Anaconda
  • Model Extraction - Data Robot

CA7 Mainframe

  • Familiarity of the Hadoop technology stack and utilities associated
  • Python used for all data engineering tasks like ingest, ETL and aggregation
  • Building consumer and producers apps to consume real time events
  • To manage Kafka based dependent java libraries
  • Object oriented programming language for data processing


Education:

  • Bachelor's degree required.
  • Certs not required, but please notate in Comments what certs a candidate possesses.


Years Required:

  • Lead – 8+ yrs


Soft Skills:

  • Attention to detail, team player, and self-starter.

We have other current jobs related to this field that you can find below

  • Hadoop Data Integrator

    2 months ago

    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Hadoop Data Integrator

    2 months ago

    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Hadoop Data Integrator

    2 days ago

    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Hadoop Data Integrator

    2 weeks ago

    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Hadoop Data Integrator

    3 weeks ago

    Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Technical Lead

    4 weeks ago

    Cleveland, United States Tata Consultancy Services Full time

    Skill: Tech Lead - Hadoop Candidate shell have 6+ years of experience. Full stack big data developer, python, hive, impala, hdfs, java, ranger, sqoop, linux, the whole 9 yards. Build, operate, monitor, and troubleshoot Hadoop infrastructure. Develop documentation and playbooks to operate Hadoop infrastructure. Write software to ingest data into Hadoop....

  • Lead Data Engineer

    3 weeks ago

    Cleveland, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...

  • Lead Data Engineer

    3 weeks ago

    Cleveland, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...

  • Lead Data Engineer

    5 days ago

    Cleveland, Ohio, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...

  • Lead Data Engineer

    4 days ago

    Cleveland, Ohio, United States The Sherwin-Williams Company Full time

    The Lead Data Engineer in the Architecture, Experience, Digital Platforms and Strategy department within Digital Technology is responsible and accountable to lead the design, development, testing, analysis, documentation, implementation, and support of the Enterprise Data Platform processes and related infrastructure. The Lead Data Engineer is also...

  • Lead Data Engineer

    2 weeks ago

    Cleveland, United States The Sherwin-Williams Company Full time

    The Lead Data Engineer in the Architecture, Experience, Digital Platforms and Strategy department within Digital Technology is responsible and accountable to lead the design, development, testing, analysis, documentation, implementation, and support of the Enterprise Data Platform processes and related infrastructure. The Lead Data Engineer is also...

  • Lead Data Engineer

    7 days ago

    Cleveland, United States Insight Global Full time

    LOCATION: Cleveland OH (HYBRID)** MUST be able to work directly on a W2 **Day to Day:Insight Global is seeking a Lead Data Engineer for one of our largest clients in Downtown Cleveland, Ohio. This individual will be a part of the centralized Data Engineering team, where all data needs go through across the entire organization. This team supports all data...

  • Lead Data Engineer

    5 days ago

    Cleveland, Ohio, United States Sherwin-Williams Full time

    Job Description The Lead Data Engineer in the Architecture, Experience, Digital Platforms and Strategy department within Digital Technology is responsible and accountable to lead the design, development, testing, analysis, documentation, implementation, and support of the Enterprise Data Platform processes and related infrastructure. The Lead Data Engineer...

  • Ab Initio Lead

    4 weeks ago

    Cleveland, United States The Dignify Solutions LLC Full time

    •Lead and own all technical aspects of ETL projects from Requirement till Implementation. •Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool •Should have minimum 1+ years of hands-on experience with Google Cloud Technologies •Basics of Pyhton •Should have minimum 3+ years of hands-on experience with Teradata & Hadoop...

  • Technical Lead

    4 weeks ago

    Cleveland, United States Tata Consultancy Services Full time

    Skill: Ab Initio Tech Lead Ab Initio, UNIX, Teradat, Hadoop, Google BigWuery, Google Cloud Storage. Basics of data processing tools in GCP and Python Basics. Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool. Should have minimum 1+ years of hands-on experience with Google Cloud Technologies. Basics of Python. Should have minimum 3+...

  • Technical Lead

    5 days ago

    Cleveland, Alabama, United States Tata Consultancy Services Full time

    Skill: Ab Initio Tech LeadAb Initio, UNIX, Teradat, Hadoop, Google BigWuery, Google Cloud Storage.Basics of data processing tools in GCP and Python Basics.Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool.Should have minimum 1+ years of hands-on experience with Google Cloud Technologies.Basics of Python.Should have minimum 3+ years...

  • Data Analytics Engineer

    2 days ago

    Cleveland, United States Splash Financial Full time

    Job DescriptionJob DescriptionABOUT OUR COMPANY:The crushing weight of debt is something that we believe holds people back from reaching their dreams and making a splash in the world. So in 2013, after seeing our friends and family struggle with student loans, we created Splash Financial. Over the years, our mission has expanded to include helping people...

  • Staff Data Engineer

    4 weeks ago

    Cleveland, United States Splash Financial Full time

    Job DescriptionJob DescriptionABOUT OUR COMPANY:The crushing weight of debt is something that we believe holds people back from reaching their dreams and making a splash in the world. So in 2013, after seeing our friends and family struggle with student loans, we created Splash Financial. Over the years, our mission has expanded to include helping people...

  • Data Engineer

    3 weeks ago

    Cleveland, United States Medical Mutual of Ohio Full time

    Theres a reason weve been selected as a Top Workplace in Northeast Ohio for 14 consecutive years. At Medical Mutual, we are committed to caring for our most valuable asset our dedicated employees. Founded in 1934, Medical Mutual is the oldest and one of the largest health insurance companies based in Ohio. We provide peace of mind to more than 1.6 million...

  • Data Engineer

    3 weeks ago

    Cleveland, United States Medical Mutual of Ohio Full time

    Theres a reason weve been selected as a Top Workplace in Northeast Ohio for 14 consecutive years. At Medical Mutual, we are committed to caring for our most valuable asset our dedicated employees. Founded in 1934, Medical Mutual is the oldest and one of the largest health insurance companies based in Ohio. We provide peace of mind to more than 1.6 million...