Senior Data Reliability Engineer

2 weeks ago


Chicago, United States Chicago Mercantile Exchange Inc. Full time

Description

Position Overview:

Data System Reliability Engineer (dSRE)

CME Group: Where Futures Are Made

CME Group is the world's leading and most diverse derivatives marketplace. But who we are goes deeper than that, here you can impact markets worldwide, transform industries and build a career shaping tomorrow. We invest in your success and you own it, all the while working alongside a team of leading experts who inspire you in ways big and small. Joining our company gives you the opportunity to make a difference in global financial markets every day, whether you work on our industry-leading technology and risk management services, our benchmark products or in a corporate services area that helps us serve our customers better. We're small enough for you and your contributions to be known. But big enough for your ideas to make an impact. The pace is dynamic, the work is unlike any other firm in the business, and the possibilities are endless. Problem solvers, difference makers, trailblazers. Those are our people. And we're looking for more.

To learn more about what a career at CME Group can offer you, visit us at www.wherefuturesaremade.com .

Role Overview:

A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the firm's data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. Responsibilities include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting and monitoring for data pipelines, and automating repetitive data-oriented tasks.

Accountabilities: Automate data tasks on GCP Work with data domain owners, data scientists and other stakeholders to ensure that data is consumed effectively on GCP Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP Measure and monitor the quality of data on GCP data platforms Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss. Develop automation scripts and tools to streamline data operations and make them scalable to accommodate growing data volumes and user traffic. Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance. Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements. Ensure data security and compliance with data protection regulations. Implement best practices for data access controls and encryption. Collaborate with data engineers, data scientists, and software engineers to understand data requirements, troubleshoot issues, and support data-driven initiatives. Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance. Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.

Qualifications: Bachelor's or Master's degree in Computer Science, Software Engineering, Data Science or related field, or equivalent practical experience Proven experience as a Data Site Reliability Engineer or a similar role, with a strong focus on data infrastructure management Good understanding of SRE practice. Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure). Strong programming skills in languages like Python (numpy, pandas, pyspark), Java (Core Java, Spark with Java, functional interface, lambda, java collections), or Scala, with experience in automation and scripting. Experience with containerization and orchestration tools like Docker and Kubernetes is a plus. Experience with data governance(data plex), data security, and compliance best practices on GCP Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines. Strong background in cloud computing and data-Intensive applications and services, with a focus on Google Cloud Platform Experience with data quality assurance and testing on GCP Proficiency with GCP data services (BigQuery; Dataflow; Data Fusion; Dataproc; Cloud Composer; Pub/Sub; Google Cloud Storage) Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc. Knowledge of AI and ML tools is a plus Google Associate Cloud Engineer or Data Engineer certification is a plus 2+ years of experience in data engineering or data science on GCP

#LI-Hybrid #LI-DS #dice

CME Group: Where Futures Are Made

CME Group (www.cmegroup.com) is the world's leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career shaping tomorrow. We invest in your success and you own it, all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we're looking for more.

At CME Group, we embrace our employees' diverse experiences, cultures and skills, and work to ensure that everyone's perspectives are acknowledged and valued. As an equal opportunity employer, we recognize the importance of a diverse and inclusive workplace and consider all potential employees without regard to any protected characteristic.

The Candidate Privacy Policy can be found here. #J-18808-Ljbffr



  • Chicago, United States Allied Reliability Full time

    Overview: The Maintenance Reliability Engineer is responsible for implementing machinery and process improvements using management of change best practices while promoting values of a safe, environmentally compliant workplace, and philosophy of continuous improvement with the workforce. Responsibilities: Process Improvements and Operational Upgrading Works...


  • Chicago, United States Allied Reliability Full time

    Overview The Maintenance Reliability Engineer is responsible for implementing machinery and process improvements using management of change best practices while promoting values of a safe, environmentally compliant workplace, and philosophy of continuous improvement with the workforce. Responsibilities Process Improvements and Operational Upgrading Works...


  • Chicago, United States CME Group Full time

    Description This role is hybrid requires to be 2 days on site in our Chicago office. This role does not allow to work outside of Illinois state. Position Overview: Data System Reliability Engineer (dSRE) CME Group: Where Futures Are Made CME Group is the world's leading and most diverse derivatives marketplace. But who we are goes deeper than...


  • Chicago, IL, United States CME Group Full time

    Description This role is hybrid requires to be 2 days on site in our Chicago office. This role does not allow to work outside of Illinois state. Position Overview: Data System Reliability Engineer (dSRE) CME Group: Where Futures Are Made CME Group is the world's leading and most diverse derivatives marketplace. But who we are goes deeper than...


  • Chicago, United States Deere & Company Full time

    Advanced Options 28 open jobs. Use your resume to get matched with the right job. Senior Platform Engineer (Chicago, Visa Sponsorship available) Reliability Engineer Dubuque, Iowa, United States Reliability Engineer Dubuque, Iowa, United States Senior Software Engineer - DevOps eCommerce (Chicago) SOFTWARE ENGINEER (Chicago, IL or Moline, IL - Hybrid) SAP...

  • Senior Data Engineer

    4 weeks ago


    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Senior Data Engineer

    4 weeks ago


    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Senior Data Engineer

    4 weeks ago


    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...


  • Chicago, United States Balyasny Asset Management Full time

    We are looking for a Senior Site Reliability Engineer who can cultivate our SRE philosophy, processes, and technologies from the ground up. As a Senior Site Reliability Engineer within the Platform group, you will lay the groundwork for our SRE infrastructure. Your role will entail driving standards and fostering adoption across our technology teams, whilst...


  • Chicago, United States LaBine and Associates Full time

    Senior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between systemsIncorporate best practices to...


  • Chicago, United States LaBine and Associates Full time

    Senior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between systemsIncorporate best practices to...

  • Reliability Engineer

    12 hours ago


    Chicago, United States Metropolitan Water District Full time

    Apply engineering knowledge and skills for moderately complex engineering projects focused on developing, measuring, analyzing, and implementing plans and procedures which ensure reliability of manufacturing components, equipment, and processes. Day-to-Day Role: Follow and commit to meet Key Performance Indicators (KPI’s) for safety, quality, production,...


  • Chicago, United States LaBine and Associates Full time

    Job DescriptionJob DescriptionSenior Data Engineer ~ Remote within the United StatesResponsibilities:Data Architecture and Integration - Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure.Build ETL processes using a variety of methods to facilitate efficient movement of data between...

  • Senior Data Engineer

    18 hours ago


    Chicago, United States CNA Insurance Full time

    Position: Senior Data EngineerYou have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. CNA seeks to offer a comprehensive and...

  • Senior Data Engineer

    1 month ago


    Chicago, United States Monarch Collective Full time

    Firm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...

  • Senior Data Engineer

    1 month ago


    Chicago, United States Monarch Collective Full time

    Firm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...

  • Senior Data Engineer

    1 month ago


    Chicago, United States Monarch Collective Full time

    Firm Overview:We are a PE-backed Vacation Rental Property Management (VRM) platform, encompassing a number of local and regional brands across the United States. Our strategy involves a significant degree of growth via M&A – with over 20 acquisitions to date - augmented by organic growth and operational improvements. We are focused on helping our operating...

  • Senior Data Engineer

    1 month ago


    Chicago, United States Green Thumb Full time

    The Role As a Senior Data Engineer, you will be responsible for developing and implementing data pipelines, focusing on efficient extraction, transformation, and loading (ETL) processes. Your role will involve creating scalable services for data tracking, translating complex requirements into detailed designs, and exploring alternatives for streamlined data...

  • Reliability Engineer

    4 weeks ago


    Chicago, United States Daubert Chemical Co. Inc. Full time

    Job DescriptionJob DescriptionDaubert Chemical Company is seeking an experienced Reliability Engineer at its specialty chemical production plant at 4700 S. Central in Forest View, IL.  The successful candidate will be a degreed engineer with at least 6 years in process and/or manufacturing engineering operations plus extensive project management experience...


  • Chicago, United States beBee S US Full time

    Overview As a Senior Data Engineer with a focus on data UX/visualization, you will play a critical role in our data infrastructure and analytics team. Your primary objective will be to design, develop, and maintain robust data pipelines while also ensuring that data is easily accessible and comprehensible through intuitive visualization techniques. You will...