Senior Data Engineer

4 weeks ago

Chicago, Illinois, United States Grainger Full time

As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we're dedicated to providing value for customers, fostering an engaging culture for team members and driving strong financial results.
Our welcoming workplace enables you to learn, grow and make a difference by keeping businesses running and their people safe. As a 2024 Glassdoor Best Place to Work and a Great Place to Work-CertifiedTM company, we're looking for passionate people to join our team as we continue leading the industry over our next 100 years.
Position Details:
The search team comprises the e-commerce search platform, backend services, machine learning endpoints, and our search engine, which enables customers to findproducts that serve relevant content to online customers, internal support teams, and marketing programs. We are looking for a Senior Data engineer.
You will report to the Mgr, Product Engineering
You will:

  • Design and implement technical solutions and processes to ensure data reliability and accuracy.
  • Build pipelines that feed embedding models and vector databases while working with platform-oriented teams to ensure database response times meet expectations.
  • Develop data models and mappings and build new data assets required by data science teams. Perform exploratory data analysis on existing products and datasets.
  • Understand trends and emerging technologies and evaluate the performance and applicability of potential tools for our requirements.
  • Enable data discovery and curation for analytical purposes by collaborating with data scientists and providing data integration solutions.
  • Collaborate with stakeholders, including team and product managers, to create secure and efficient data products.
  • Ensure that data processing pipelines and ETL jobs are designed for scalability, using distributed technologies to handle increasing data volumes efficiently.
  • Work within an Agile delivery / DevOps methodology to deliver product increments in iterative sprints.

You Have:

  • 3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. Snowflake and Databricks are a must.
  • 3+ years orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi
  • 3+ years of experience prepping structured and unstructured data for data science models.
  • 3+ years of experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix, or Windows shell is preferable.
  • Experience working in vector databases like Milvus, Pinecone, or Weaviate
  • Experience using machine learning in data pipelines to discover, classify, and clean data.
  • Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD
  • Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB
  • Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking, and matching .

Rewards and Benefits:
With benefits starting day one, our programs provide choice and flexibility to meet team members' individual needs. Check out the highlights below and review all our benefits at .

  • Medical, dental, vision, life, and pet insurance plans and 6 free sessions each year with a licensed therapist to support your emotional wellbeing
  • Paid time off (PTO) and 6 company holidays per year
  • 6% company contribution to a 401(k) Retirement Savings Plan each pay period, no match required
  • Employee discounts, tuition reimbursement, student loan refinancing and free access to financial counseling, education and tools

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.
We are committed to fostering an inclusive, accessible environment that includes both providing reasonable accommodations to individuals with disabilities during the application and hiring process as well as throughout the course of one's employment. With this in mind, should you need a reasonable accommodation during the application and selection process, please advise us so that we can provide appropriate assistance.

  • Senior Data Engineer

    1 month ago

    Chicago, Illinois, United States Belvedere Trading Full time

    Belvedere Trading is a leading proprietary trading firm proudly headquartered in downtown Chicago. Our traders work hard to provide liquidity to the market through their market-making activities and are the masters of a diverse set of commodities, interest rates, exchange-traded funds (ETF), and equity index options. From the beginning, we began iteratively...

  • Senior Data Solutions Engineer

    10 hours ago

    Chicago, Illinois, United States Oak Street Health Full time

    About the RoleOak Street Health is seeking a highly skilled Senior Data Solutions Engineer to join our team. As a Senior Data Solutions Engineer, you will be responsible for designing, developing, and implementing modern data solutions that drive business growth and improve patient outcomes.Key ResponsibilitiesDesign and develop scalable data architectures...

  • Senior Data Engineer

    2 months ago

    Chicago, Illinois, United States DRW Full time

    DRW is a dynamic trading company with a rich history of utilizing advanced technology and top-tier talent to engage in global markets. Operating with our own capital and taking risks, we prioritize autonomy and agility to seize opportunities effectively. Based in Chicago and with a presence in various locations across the U.S., Canada, Europe, and Asia, we...

  • Senior Data Engineer

    2 months ago

    Chicago, Illinois, United States Rocket Travel by Agoda Full time

    About the RoleRocket Travel by Agoda is the strategic partnerships arm of Agoda, part of Booking Holdings (NASDAQ: BKNG). Rocket Travel by Agoda partners with global brands to bring their customers rewarding and engaging travel experiences that deliver value, maximize rewards, and build customer loyalty for partners' brands.Rocket Travel by Agoda is looking...

  • Senior Data Engineer

    2 months ago

    Chicago, Illinois, United States Cylinder Full time

    About CylinderFounded in 2021 and offered as an employer benefit, Cylinder (formerly Vivante Health) delivers personalized, clinician-backed care to those suffering from digestive issues through its virtual health platform. Cylinder's tech-forward, human-first program connects members to the right level of support at the right time through an easy interface,...

  • Senior Data Engineer

    3 months ago

    Chicago, Illinois, United States Grainger Businesses Full time

    As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we're dedicated to providing value for customers,...

  • Senior Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Grainger Businesses Full time

    As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we're dedicated to providing value for customers,...

  • Senior Data Scientist

    6 days ago

    Chicago, Illinois, United States Hyatt Hotels Full time

    About the RoleWe are seeking an exceptional Senior Machine Learning Engineer to join our team at Hyatt Hotels. As a key member of our data science team, you will be responsible for designing and implementing algorithmic product architectures across various domains, including Personalization, Generative AI, Forecasting, and Decision Science.Key...

  • Senior Software Engineer

    3 days ago

    Chicago, Illinois, United States Adyen Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Data Connect team in Chicago. As a key member of our team, you will play a critical role in building our global data product suite that our customers use to grow their business.Key ResponsibilitiesCollaborate with data scientists and data analysts to implement data pipelines...

  • Senior Manager, Data Product Strategist

    3 days ago

    Chicago, Illinois, United States AMADA Senior Care Mesa Full time

    About the RoleWe are seeking a highly skilled Senior Manager, Data Product Manager to join our team at AMADA Senior Care Mesa. This is a pivotal role in advancing our growth strategy through the effective use of data.Key ResponsibilitiesOversee data integrations for a customer data platform to ensure real-time and accurate data for our marketing team.Lead a...

  • Senior Data Engineer

    2 months ago

    Chicago, Illinois, United States Tovala Full time

    We're Tovala, a food-tech company reinventing home cooking to save consumers time. Through an innovative combination of hardware, software, and fresh food delivery, we make it incredibly simple for anyone to prepare and enjoy delicious, home-cooked meals without sacrificing time to do whatever matters to them. Through our superior technology, product...

  • Senior Engineering Manager

    10 hours ago

    Chicago, Illinois, United States Kin Insurance Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineering Manager to lead our Data Engineering team at Kin Insurance. As a key member of our engineering organization, you will be responsible for overseeing the development and implementation of data solutions that drive business growth and improve customer experiences.Key...

  • Senior Data Architect

    4 weeks ago

    Chicago, Illinois, United States AbbVie Full time

    Company DescriptionAbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas immunology, oncology, neuroscience, and eye care and products and services in our...

  • Senior Data Engineer

    8 hours ago

    Chicago, Illinois, United States Tiger Analytics Full time

    About Tiger AnalyticsTiger Analytics is a leading advanced analytics consulting firm that helps Fortune 500 companies generate business value from data. Our team of experts brings deep expertise in Data Science, Machine Learning, and AI, and we are recognized by market research firms such as Forrester and Gartner for our business value and leadership.Job...

  • Senior Sales Engineer

    3 days ago

    Chicago, Illinois, United States DDN Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Sales Engineer to join our team at DDN, a global leader in AI and multi-cloud data management at scale. As a Senior Sales Engineer, you will play a critical role in providing technical expertise and solution design support to our sales team and customers, with a specific focus on AI-powered...

  • Senior Data Engineer Position

    11 hours ago

    Chicago, Illinois, United States Motion Recruitment Full time

    About the RoleWe are seeking a highly skilled Mid-Level Data Engineer to join our team at Motion Recruitment. This is a full-time direct-hire opportunity that offers a chance to work with a leading industry player in data, technology, and finance.Key ResponsibilitiesDesign and implement efficient ETL processes to streamline data processingCollaborate with...

  • Senior Data Reliability Engineer

    15 hours ago

    Chicago, Illinois, United States CME Group Full time

    Job OverviewA critical role in CME Group's Cloud data transformation, the Data SRE will be aligned to data product pods ensuring the firm's data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.Key ResponsibilitiesOptimize data pipelines to ensure efficient data processing and reduce latency.Ensure data integrity...

  • Senior Data Engineer

    13 hours ago

    Chicago, Illinois, United States United Airlines Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at United Airlines. As a Data Engineer, you will play a critical role in designing and building scalable and reliable data infrastructure and pipelines to support data for measurement and reporting across our digital platforms.Key ResponsibilitiesDesign and build scalable and reliable...

  • Senior Data Architect

    1 month ago

    Chicago, Illinois, United States Bounteous Full time

    Bounteous x Accolite makes the future faster for the world's most ambitious brands. Our services span Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. We are guided by Co-Innovation, our proven methodology of collaborative partnership. Bounteous x Accolite brings together 5000+ employees spanning North America,...

  • Director of Data and Software Engineering

    4 days ago

    Chicago, Illinois, United States 1872 Consulting Full time

    About the RoleThis is a unique opportunity to lead a team of professionals in building full stack web applications, modern data pipelines, and a microservices-based application ecosystem for a leading consulting firm like 1872 Consulting.Key ResponsibilitiesLead, coach, and mentor a team of Software and Data Engineers to drive innovation and excellence in...