Hadoop Data Quality Engineer

6 days ago


Chicago, Illinois, United States Axiom Global Full time
Hadoop Framework Developer Job Description

Axiom Global is seeking a skilled Hadoop Framework Developer to join our team. As a key member of our data quality team, you will be responsible for designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem.

Key Responsibilities:
  • Design and develop scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
  • Implement automated data quality checks and validations to ensure data integrity throughout the ETL processes.
  • Optimize Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.
Requirements:
  • A minimum of 3 years of experience with Hadoop Framework.
  • A minimum of 3 years of experience with ETL Processing.
  • A minimum of 3 years of experience with Spark.
  • Associate's Degree.
Preferred Qualifications:
  • Experience with Python.
  • Experience with Data.
  • Experience with Hive.


  • Chicago, Illinois, United States Indotronix Avani Group Full time

    Job Title: Hadoop DeveloperJob Summary:We are seeking a highly skilled Hadoop Developer to join our team at Indotronix Avani Group. As a Hadoop Developer, you will play a crucial role in designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem.Key Responsibilities:Designing and developing scalable data quality frameworks...


  • Chicago, Illinois, United States HexaQuEST Global, Inc. Full time

    Job Title: Senior Systems Engineer with Strong Unix ExperienceWe are seeking a highly skilled Senior Systems Engineer with strong experience in Unix to join our team at HexaQuEST Global, Inc.Job Description:As a Senior Developer on our large Incentive Compensation project, you will be responsible for building out our new Data Quality framework within the...

  • Big Data Engineer

    1 month ago


    Chicago, Illinois, United States Collabera Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key ResponsibilitiesData Ingestion and Processing: Design and implement data ingestion pipelines to collect and...


  • Chicago, Illinois, United States Epsilon Data Interactive, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Epsilon Data Interactive, Inc. as an AI/ML Expert. In this role, you will collaborate with decision scientists and cross-functional teams to develop innovative AI and machine learning applications using Spark and Scala.Key ResponsibilitiesCollaborate with decision...


  • Chicago, Illinois, United States Talencia LLC Full time

    Job Title: Hadoop Developer with PythonWe are seeking a highly skilled Hadoop Developer with expertise in Python to join our team at Talencia LLC.Key Responsibilities:Design and develop big data pipelines using Hadoop and SparkWork with distributed systems and data ingestion from various sourcesDevelop and maintain data processing applications using Python...

  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Mid-Level Data EngineerWe are seeking a skilled Mid-Level Data Engineer to join our team. This is a full-time direct-hire opportunity with a reputable company in the data, technology, and finance industry.About the RoleThis position involves working on ETL, data warehouse architecture, and streamlining data processing. The ideal candidate will have strong...

  • Hadoop Administrator

    2 weeks ago


    Chicago, Illinois, United States Insight Global Full time

    About the RoleWe are seeking a highly skilled Hadoop Admin to join our team at Insight Global. As a key member of our Big Data Platform team, you will play a critical role in designing and implementing scalable data architectures, ensuring seamless data flow, and optimizing system performance.Key ResponsibilitiesDesign and implement container orchestration...


  • Chicago, Illinois, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures.Key Responsibilities:Collaborate with cross-functional teams to design and implement data systems and architecturesDevelop and...


  • Chicago, Illinois, United States Aloden, Inc. Full time

    Job Title: Hadoop Developer with PythonAloden, Inc. is seeking a highly skilled Hadoop Developer with expertise in Python to join our team.About the RoleWe are looking for a talented individual to design, develop, and maintain data pipelines using Hadoop, Spark, and Python/Scala. The ideal candidate will have extensive experience with Hadoop ecosystem and...


  • Chicago, Illinois, United States Epsilon Data Interactive, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Epsilon Data Interactive, Inc. as an AI/ML Expert. In this role, you will collaborate with decision scientists and cross-functional teams to develop innovative AI and machine learning applications using Spark and Scala.Key Responsibilities:Collaborate with decision...

  • Cloud Data Architect

    1 month ago


    Chicago, Illinois, United States Tardis Tech Full time

    About the Role:We're seeking a highly skilled Cloud Data Architect to join our team at Tardis Tech. As a key member of our data engineering team, you will be responsible for designing and managing data pipelines within AWS and Hadoop environments.Key Responsibilities:Design and implement data pipelines using AWS and Hadoop technologies, ensuring seamless...

  • Senior Data Engineer

    4 weeks ago


    Chicago, Illinois, United States Motion Recruitment Full time

    {"title": "Mid-Level Data Engineer Position", "description": "We are seeking a skilled Mid-Level Data Engineer to join our team at Motion Recruitment. This is a full-time direct-hire opportunity with a hybrid schedule, offering a great work-life balance and growth opportunities.Our client is a leading industry player in data, technology, and finance,...

  • Big Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Collabera Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Kafka, Pyspark, and real-time data processing techniquesDevelop...

  • Big Data Engineer

    1 month ago


    Chicago, Illinois, United States Collabera Full time

    Job DescriptionJob Title: Big Data EngineerCompany: CollaberaLocation: Remote/HybridJob Type: Full-timeJob Category: EngineeringAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key...

  • Data Engineer

    4 weeks ago


    Chicago, Illinois, United States Capital One Full time

    About the RoleCapital One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, developing, and implementing technical solutions that drive business value.Key ResponsibilitiesCollaborate with cross-functional teams to design and develop scalable data architecturesDevelop and maintain...

  • Lead Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using AWS services.Key Responsibilities:Design and implement data pipelines using AWS services such as Lambda,...

  • Lead Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using AWS services.Key Responsibilities:Design and implement data pipelines using AWS services such as Lambda,...


  • Chicago, Illinois, United States United Software Group Full time

    Job Title: Senior Palantir Data EngineerWe are seeking a highly skilled Senior Palantir Data Engineer to join our team at United Software Group. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing effective analytics solutions and models using Palantir and other technologies.Key...

  • Data Scientist

    6 days ago


    Chicago, Illinois, United States Acunor Full time

    Job Title: Data EngineerLocation: RemoteDuration: Full TimeWe are seeking a highly skilled Data Engineer to join our team at Acunor. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines to extract,...

  • Data Scientist

    2 weeks ago


    Chicago, Illinois, United States Acunor Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Acunor. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various...