Senior Data Engineer
3 weeks ago
84.51° Overview
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.
Join us at 84.51°
__________________________________________________________
As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.
Our data engineers use PySpark/Python, Databricks, Hadoop, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.
Responsibilities
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:
Participate in the design and development of Databricks and Cloud-based solutions.
Implement automated unit and integration testing.
Collaborate with architecture and lead engineers to ensure consistent development practices.
Provide mentoring to junior engineers.
Participate in retrospective reviews.
Participate in the estimation process for new work and releases.
Collaborate with other engineers to solve and bring new perspectives to complex problems.
Drive improvements in data engineering practices, procedures, and ways of working.
Embrace new technologies and an ever-changing environment.
Requirements
4+ years proven ability of professional Data Development experience
3+ years proven ability of developing with Databricks or Hadoop/HDFS
3+ years of experience with PySpark/Spark
3+ years of experience with SQL
3+ years of experience developing with either Python, Java, or Scala
Full understanding of ETL concepts and Data Warehousing concepts
Experience with CI/CD
Experience with version control software
Strong understanding of Agile Principles (Scrum)
Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)
Bonus Points
Experience with Azure
Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
Proficient with Relational Data Modeling
Experience with Python Library Development
Experience with Structured Streaming (Spark or otherwise)
Experience with Kafka and/or Azure Event Hub
Experience with GitHub SaaS / GitHub Actions
Experience with Snowflake
Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
#J-18808-Ljbffr
-
Senior Data Engineer
4 weeks ago
Chicago, United States InterEx Group Full timeJob Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...
-
Senior Data Engineer
4 weeks ago
Chicago, United States InterEx Group Full timeJob Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...
-
Senior Data Engineer
4 weeks ago
Chicago, United States InterEx Group Full timeJob Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...
-
Senior Data Engineer
1 week ago
Chicago, United States ULINE Full timeSenior Data Engineer Corporate Headquarters 12575 Uline Drive, Pleasant Prairie, WI 53158 Fuel the future of data engineering and analytics for our growing North American company! As a Senior Data Engineer at Uline, you’ll play a pivotal role in constructing and maintaining our new, cutting-edge data collection systems and analytics platform. Better...
-
Senior Data Engineer
1 month ago
Chicago, United States Monarch Collective Full timeFirm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...
-
Senior Data Engineer
1 month ago
Chicago, United States Monarch Collective Full timeFirm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...
-
Senior Data Engineer
1 month ago
Chicago, United States Monarch Collective Full timeFirm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...
-
Senior Data Engineer
1 month ago
Chicago, United States Green Thumb Full timeThe Role As a Senior Data Engineer, you will be responsible for developing and implementing data pipelines, focusing on efficient extraction, transformation, and loading (ETL) processes. Your role will involve creating scalable services for data tracking, translating complex requirements into detailed designs, and exploring alternatives for streamlined data...
-
Senior Analyst, Data, Performance, and Operations
9 minutes ago
Chicago, United States Senior Analyst, Data, Performance, and Operations Full timeSeeking to hire a Senior Analyst, Data, Performance, and Operations for a direct hire opportunity in Chicago for one of the nation's largest independent foundations. Organizations supported by the Foundation work in about fifty countries. Will support our client’s Investment Department’s data management infrastructure. Will provide support for the...
-
Senior Data Engineer remote
23 minutes ago
Chicago, United States LaBine and Associates Full timeSenior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between systemsIncorporate best practices to...
-
Senior Systems Engineer
4 hours ago
Chicago, United States VetsEZ Full time**Senior Systems Engineer (Data Warehouse)** * Chicago, IL * Full-Time * Senior Systems Engineer (Data Warehouse) VetsEZ (Veterans EZ Info, Inc.), a verified Service-Disabled Veteran-Owned Small Business (SDVOSB), is a leading provider of information technology services to commercial and Government markets. VetsEZ is a company of Subject Matter Experts with...
-
Senior Data Engineer
1 day ago
Chicago, United States LaBine and Associates Full timeSenior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between systemsIncorporate best practices to...
-
Senior Data Engineer
5 hours ago
Chicago, United States CNA Insurance Full timePosition: Senior Data EngineerYou have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. CNA seeks to offer a comprehensive and...
-
Senior Systems Engineer
24 hours ago
Chicago, United States VetsEZ Full time**Senior Systems Engineer (Data Warehouse)** * Chicago, IL * Full-Time * Senior Systems Engineer (Data Warehouse) VetsEZ (Veterans EZ Info, Inc.), a verified Service-Disabled Veteran-Owned Small Business (SDVOSB), is a leading provider of information technology services to commercial and Government markets. VetsEZ is a company of Subject Matter Experts...
-
Senior Data Engineer
20 hours ago
Chicago, United States LaBine and Associates Full timeJob DescriptionJob DescriptionSenior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between...
-
Senior Data Solutions Engineer
3 days ago
Chicago, United States Epsilon Full timeJob Description We are looking for a senior data solutions engineer with extensive experience in the big data and data warehouse ecosystems. The Epsilon Digital Data Organization builds and maintains MPP, HDFS and Elastic platforms to capture all data generated from the Ad Stack and external sources to support all aspects of the business. The candidate...
-
Senior Software Engineer
5 hours ago
Chicago, United States Adyen Full timeThis is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture...
-
Senior Software Engineer
2 weeks ago
Chicago, United States Balyasny Asset Management Full timeROLE OVERVIEW The Senior Software Engineer will be a key member of a small, focused product team working to create the core data platform that BAM’s data analysts, data scientists, quantitative investors, and researchers can rely on for sourcing investment data sets. The platform’s cloud-native ecosystem includes Dockerized ingestion pipelines running in...
-
Senior Data Engineer
16 hours ago
Chicago, Illinois, United States Homeward Health Full timeHomeward is a technology-enabled healthcare provider delivering quality, affordable and comprehensive care to those who don't have it. Starting in rural America. Today, 60 million Americans living in rural communities are facing a crisis of access to care. In the U.S. healthcare system, rural Americans experience significantly poorer clinical outcomes. This...
-
Senior Data Engineer
13 hours ago
Chicago, Illinois, United States Intelligent Medical Objects Full timeAt IMO, a core team of clinicians, software developers, and data scientists combine computer science and medical expertise to help patients and healthcare professionals access high quality health information quickly and easily to improve total patient health. We are currently in need of a Data Engineer to join this team The hire will be responsible for...