Lead Hadoop Big Data Engineer

2 weeks ago


Cleveland, United States TEK Connexion Full time

Position Title: Lead Hadoop Big Data Engineer

Position Location: Hybrid - 3 office / 2 remote

  • 1st Preference - Strongsville/Cleveland/Columbus OH
  • 2nd Preference - Pittsburgh, PA, Birmingham, AL, Dallas, TX, Phoenix, AZ


Must Have Technical Skills:

Hadoop Big Data Engineer with PySpark, HQL, Python skills.

Hadoop Platform utilities - Hive, Oozie, Yarn, Impala, HDFS, Hbase- Hue, Beeline

Python and Shell Programming (PySpark) - Python 2.7, 0

DSP (Data Streaming Platform) - Kafka Confluent

  • Model Implementation - PySpark
  • Data science-based libraries (SciPy, Pandas etc) - Jupyterhub, Jupyter Notebooks, Anaconda
  • Deep Learning - Keras , tensorflow, Pytorch - Jupyterhub, Jupyter Notebooks, Anaconda
  • Time series Modelling - Jupyterhub, Jupyter Notebooks, Anaconda
  • Model Extraction - Data Robot

CA7 Mainframe

  • Familiarity of the Hadoop technology stack and utilities associated
  • Python used for all data engineering tasks like ingest, ETL and aggregation
  • Building consumer and producers apps to consume real time events
  • To manage Kafka based dependent java libraries
  • Object oriented programming language for data processing


Education:

  • Bachelor's degree required.
  • Certs not required, but please notate in Comments what certs a candidate possesses.


Years Required:

  • Lead – 8+ yrs


Soft Skills:

  • Attention to detail, team player, and self-starter.


  • Cleveland, United States TEK Connexion Full time

    Position Title: Lead Hadoop Big Data Engineer Position Location: Hybrid - 3 office / 2 remote 1st Preference - Strongsville/Cleveland/Columbus OH 2nd Preference - Pittsburgh, PA, Birmingham, AL, Dallas, TX, Phoenix, AZ Must Have Technical Skills: Hadoop Big Data Engineer with PySpark, HQL, Python skills. Hadoop Platform utilities - Hive, Oozie, Yarn,...


  • Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...


  • Cleveland, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Hadoop Data IntegratorLocation: Cleveland, OH, Columbus, OH (Hybrid)Duration: 12 MonthsMandatory Skills in Beeline: 6-8 years in eachData Engineering and ML skillsExperience in managing kafka based dependent java libraries.Experience with Python as used for all data engineering tasks like ingest, etl and...

  • Technical Lead

    3 days ago


    Cleveland, United States Tata Consultancy Services Full time

    Skill: Tech Lead - Hadoop Candidate shell have 6+ years of experience. Full stack big data developer, python, hive, impala, hdfs, java, ranger, sqoop, linux, the whole 9 yards. Build, operate, monitor, and troubleshoot Hadoop infrastructure. Develop documentation and playbooks to operate Hadoop infrastructure. Write software to ingest data into Hadoop....

  • Ab Initio Lead

    1 day ago


    Cleveland, United States The Dignify Solutions LLC Full time

    •Lead and own all technical aspects of ETL projects from Requirement till Implementation. •Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool •Should have minimum 1+ years of hands-on experience with Google Cloud Technologies •Basics of Pyhton •Should have minimum 3+ years of hands-on experience with Teradata & Hadoop...

  • Technical Lead

    4 days ago


    Cleveland, United States Tata Consultancy Services Full time

    Skill: Ab Initio Tech Lead Ab Initio, UNIX, Teradat, Hadoop, Google BigWuery, Google Cloud Storage. Basics of data processing tools in GCP and Python Basics. Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool. Should have minimum 1+ years of hands-on experience with Google Cloud Technologies. Basics of Python. Should have minimum 3+...

  • Staff Data Engineer

    3 days ago


    Cleveland, United States Splash Financial Full time

    Job DescriptionJob DescriptionABOUT OUR COMPANY:The crushing weight of debt is something that we believe holds people back from reaching their dreams and making a splash in the world. So in 2013, after seeing our friends and family struggle with student loans, we created Splash Financial. Over the years, our mission has expanded to include helping people...

  • Data Engineer

    24 hours ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...

  • Data Engineer

    17 hours ago


    Cleveland, United States Insight Global Full time

    Hybrid Schedule in Cleveland, OH - 3 Days In-OfficeRelocation assistance provided if necessary! Must Haves: Bachelor’s degree in Computer Science or related field5+ years of professional Data Engineering experienceBuilding applications, system integrations, and web servicesExperience utilizing ETL tools, specifically Informatica (IDMC/IICS)Strong Snowflake...


  • Cleveland, United States ApTask Full time

    About Client: The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong...


  • Cleveland, United States Splash Financial Full time

    Job DescriptionJob DescriptionABOUT OUR COMPANY:The crushing weight of debt is something that we believe holds people back from reaching their dreams and making a splash in the world. So in 2013, after seeing our friends and family struggle with student loans, we created Splash Financial. Over the years, our mission has expanded to include helping people...


  • Cleveland, United States Actalent Full time

    Description: Software Engineering Lead We are looking for a Software engineering Leader that will be able to come in, integrate with the business, and become the lead in our new Software project initiatives. This person will be focused on running a software team and needs to be able to leverage technical skills and leadership skills to oversee the...


  • Cleveland, United States BlackRock Resources Full time

    Lead Electrical Engineer  Cleveland, OH As a Lead Electrical Engineer you will be responsible for directing a discipline design team throughout the entire project cycle from initial concept through successful completion. The Lead Electrical Engineer will also manage the organization, control, integration and completion of their discipline's part of a...


  • Cleveland, United States Actalent Full time

    Actalent Software Engineering Lead Cleveland , Ohio Apply Now We are looking for a Software engineering Leader that will be able to come in, integrate with the business, and become the lead in our new Software project initiatives. This person will be focused on running a software team and needs to be able to leverage technical skills and leadership skills to...


  • Cleveland, United States Manpower Group Inc. Full time

    Data Warehouse Mainframe Lead (Multiple position) 100% Remote Role - TBD Highland Heights OH 44143 United States 12+ month contract with high potential for extension and can convert to permanent. Pay range: $60/hr to $65/hr Our Fortune 500 client (One of the world's largest Insurance companies) in Heights OH is looking for hardworking, motivated talent to...

  • SAP Data Lead

    2 weeks ago


    Cleveland, United States Bayforce Full time

    Looking for an SAP Data Lead who will lead a team in managing data conversion and governance for system implementations and deployments. You will report to the SAP PMO and provide strategy and updates to the PMO on data conversion activities, governance processes and deployment related to data conversion into SAP.Compensation: $150,000-$175,000Location:...


  • Cleveland, United States The Sherwin-Williams Company Full time

    The Sherwin-Williams Company Lead Observability Engineer Cleveland , Ohio Apply Now At Sherwin-Williams, traceable, event-based Observability enables exploratory investigation when issues occur, for causes both known and unknown. It helps teams troubleshoot issues without first having to predict what or how problems may happen, especially with complex,...

  • Lead Project Engineer

    2 weeks ago


    Cleveland, United States CESO Full time

    Are you a Civil Lead Project Engineer seeking purpose, challenge, and talented colleagues? With a diverse portfolio of residential, energy, commercial, light industrial and public programs, CESO has the opportunity for you to develop your career. We develop leaders and empower our associates to use their skills and talents to positively impact the world...

  • Lead Project Engineer

    2 weeks ago


    Cleveland, United States ceso Full time

    Are you a Civil Lead Project Engineer seeking purpose, challenge, and talented colleagues? With a diverse portfolio of residential, energy, commercial, light industrial and public programs, CESO has the opportunity for you to develop your career. We develop leaders and empower our associates to use their skills and talents to positively impact the world...

  • Ab Initio Developer

    2 weeks ago


    Cleveland, United States The Dignify Solutions LLC Full time

    • Should have minimum 5+ years of hands-on experience with Ab Initio ETL tool • Should have minimum 1+ years of hands-on experience with Google Cloud Technologies • Basics of Pyhton • Should have minimum 3+ years of hands-on experience with Teradata & Hadoop • Minimum 2+ years of experience on the Banking Domain. • Strong technical skills in Ab...