Big Data Framework Engineer

2 days ago


Chicago, Illinois, United States Axiom Global Full time
Job Title: Big Data Framework Engineer

At Axiom Global, we're seeking a skilled Big Data Framework Engineer to join our team. As a key member of our data quality team, you will play a crucial role in designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem.

Key Responsibilities:
Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.
Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.

Basic Qualifications:
A minimum of 3 years of experience with Hadoop Framework
A minimum of 3 years of experience with ETL Processing
A minimum of 3 years of experience with Spark
Associate's Degree

Preferred Qualifications:
Experience with Python
Experience with Data
Experience with Hive
  • Big Data Engineer

    4 weeks ago


    Chicago, Illinois, United States Collabera Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Kafka, Pyspark, and real-time data processing techniquesDevelop...

  • Big Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Collabera Full time

    Job OverviewAs a Big Data Developer at Collabera, you will be responsible for designing and developing scalable data processing systems. Your primary focus will be on working with large datasets, developing data pipelines, and ensuring data quality.Key ResponsibilitiesDesign and develop data processing systems using big data technologiesWork with large...

  • Lead Data Engineer

    3 days ago


    Chicago, Illinois, United States Capital One Full time

    Job Title: Lead Data EngineerCapital One is seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test, implement, and...

  • Data Engineer III

    3 weeks ago


    Chicago, Illinois, United States Goli Tech Full time

    Job Title: Data Engineer IIIAbout the RoleWe are seeking a highly skilled Data Engineer III to join our Product Analytics team at Goli Tech. As a key member of our team, you will play a critical role in defining and executing data acquisition, storage, transformation, and processing to make data actionable for operational and analytics initiatives.Key...


  • Chicago, Illinois, United States Algo Capital Group Full time

    Quantitative Data EngineerWe are seeking a highly skilled Quantitative Data Engineer to join our Front Office Data Engineering team at Algo Capital Group. As a key member of our team, you will play a crucial role in designing and implementing cutting-edge data platforms that drive investment decisions and support critical...

  • Data Engineer

    2 days ago


    Chicago, Illinois, United States Lorven Technologies Full time

    Job DescriptionLorven Technologies is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing robust machine learning models and algorithms that solve complex business problems.You will work closely with cross-functional teams to understand business requirements and translate them into...


  • Chicago, Illinois, United States Akuna Capital Full time

    About Akuna CapitalAkuna Capital is a cutting-edge trading firm that leverages collaboration, innovative technology, and data-driven solutions to provide liquidity as an options market-maker. Our team is committed to designing and implementing low-latency technologies, trading strategies, and mathematical models to drive success.Job SummaryWe are seeking a...

  • Data Engineer III

    8 hours ago


    Chicago, Illinois, United States Mindlance Full time

    Job OverviewAt Mindlance, we are seeking a highly skilled Data Engineer III to join our Product Analytics team. As a key member of our team, you will be responsible for designing and implementing large-scale data pipelines in a distributed and scalable environment. You will work closely with various teams to define and execute data acquisition, storage,...


  • Chicago, Illinois, United States Enova Full time

    About the RoleWe are seeking a highly skilled Data Engineering Team Lead to join our team at Enova International. As a key member of our Data Engineering, Warehouse, and Operations Team, you will be responsible for designing and implementing technical solutions to address business challenges.Key ResponsibilitiesLead a team of engineers in the design and...

  • Machine Learning

    2 days ago


    Chicago, Illinois, United States NinjaTrader Full time

    We're seeking a highly skilled Machine Learning & Data Science Engineer to join our team at NinjaTrader. As a key member of our data science team, you'll design, implement, and optimize machine learning models to drive business growth and improve trading strategies.Key Responsibilities:Build and deploy machine learning models for financial analytics,...


  • Chicago, Illinois, United States Elevance Health Full time

    Job Title: Cloud Data Engineer Senior LeadAt Elevance Health, we are seeking a highly skilled Cloud Data Engineer Senior Lead to join our team. As a key member of our data engineering team, you will be responsible for leading the end-to-end application system development and maintenance on large complex enterprise-wide technology platforms.Key...

  • Machine Learning

    2 days ago


    Chicago, Illinois, United States NinjaTrader Full time

    Unlock the Power of Data Science at NinjaTraderAs a Machine Learning & Data Science Engineer at NinjaTrader, you'll play a crucial role in designing, implementing, and optimizing machine learning models to drive business growth and innovation. With a strong foundation in both machine learning and data engineering principles, you'll tackle complex problems in...


  • North Chicago, Illinois, United States Abbott Laboratories Full time

    Job Title: Senior Data Engineer - Cloud ComputingAbbott Laboratories is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals, and branded generic medicines.Job...

  • Senior Data Engineer

    4 weeks ago


    Chicago, Illinois, United States fairlife Full time

    Job Title: Sr. Data EngineerAt fairlife, LLC, we are seeking a highly skilled Sr. Data Engineer to join our team. As a key member of our Data and Decision Intelligence (DDI) ecosystem, you will play a critical role in delivering our ambition of building a best-in-class data framework.Job Summary:The Sr. Data Engineer will be responsible for translating...


  • Chicago, Illinois, United States Enova Full time

    About the Role:The Data Engineering, Warehouse, and Operations Team crafts sustainable data strategies and delivers impactful solutions across the organization. We integrate and optimize data at both project and enterprise levels, driving streamlined processes, greater efficiencies, and smarter decision-making.By focusing on the critical "last mile of data,"...


  • Chicago, Illinois, United States Omni Inclusive Full time

    Key Responsibilities:As a Senior Data Science Engineer at Omni Inclusive, you will be responsible for developing and maintaining production-grade Python framework development, with a focus on AWS MLOps and cloud platforms. You will work on delivering data-science projects, including operationalizing in cloud platforms using AWS SageMaker and creating an...

  • Data Engineer

    8 hours ago


    Chicago, Illinois, United States CDC Foundation Full time

    Job Title: Data Engineer - Cloud Infrastructure SpecialistThe CDC Foundation is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining data infrastructure for a public health organization.This role is aligned with the Workforce Acceleration Initiative (WAI), a...


  • Chicago, Illinois, United States Adobe Systems Full time

    Job Title: Senior AI/ML Fraud Data Scientist EngineerWe are seeking a highly skilled Senior AI/ML Fraud Data Scientist Engineer to join our team at Adobe. As a key member of our fraud detection and prevention team, you will be responsible for developing and implementing machine learning models to detect and prevent fraud across various platforms and...

  • Data Engineer

    2 days ago


    Chicago, Illinois, United States The Hartford Financial Services Group Full time

    Job Title: Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our Commercial Lines (CL) Data modernization and simplification program at The Hartford Financial Services Group.Key Responsibilities:Drive End-to-End solution delivery involving multiple platforms and technologies with medium to large complexity or oversee certain...


  • Chicago, Illinois, United States Omni Inclusive Full time

    Key Responsibilities:As a Senior Data Science Engineer at Omni Inclusive, you will be responsible for leading the development of data-driven solutions using machine learning and statistical techniques. Your expertise in data science, machine learning, and software engineering will be essential in delivering high-quality projects that meet the needs of our...