Sr. Data Engineer

18 hours ago


Chicago, United States Saxon Global Full time
CAPITAL ONE
CHICAGO IL (onsite 3 days week)


REQ ID 73155-1Sr Data Engineer

We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, there's a plan to migrate the existing AWS EMR application to AWS Glue.

The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.

Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints. If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.

Skill Set:

AWS Cloud Technologies:
  • Strong command of Apache Spark (3-5 years)
  • AWS EMR proficiency (3-5 years)
  • AWS Glue expertise (1-5 years)
PySpark Application Development:
  • Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications
  • Proven track record in processing and handling large datasets
Performance Tuning:
  • Hands-on experience in performance tuning Spark applications
  • Skills to optimize Spark code for scalability, performance, and maintainability
Microservices Development:
  • Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years)
  • Code Management:
  • Strong proficiency in using GitHub for efficient code management and sharing
Nice to have:
  • Experience in the node.js, vue.js.
  • Experience in Databricks

Required Skills : AWS EMR AWS Glue AWS Lambda AWS SNS DynamoDB Apache Spark PySpark / Python CodingNo Tenure Limit Policy
Background Check :Yes
Notes :
Selling points for candidate :No Tenure Limit Policy
Project Verification Info :"The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management. MSA: Blanket Approval Received Client Letter: Will Provide"
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :
Master Job Title :
Branch Code :
  • Sr. Data Engineer

    13 hours ago


    Chicago, United States SysMind Tech Full time

    1 Job Title Sr. Data Engineer Relevant Experience 10+ Yrs Technical/Functional Skills • Productivity - G-Suite, Lucid Chart, Jira, Confluence, Slack • GCP - Artifact Registry, Container Registry, Cloud Composer, Cloud Functions, Cloud Run, Data Proc, • Languages - Python, SQL, MQL, Docker • Kubernetes Engine, PubSub, Secret Manager,...

  • Sr. Data Engineer

    6 months ago


    Chicago, United States Ampcus Full time

    Position: Sr. Data Engineer Location: Chicago, IL. (Hybrid) Duration: + Months Contract Summary: We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with...

  • Sr. Data Engineer

    2 months ago


    Chicago, United States fairlife, LLC Full time

    fairlife, LLC is a Chicago-based nutrition company that creates great-tasting, nutrition-rich and dairy products to nourish consumers.With nearly $3B in annual retail sales, fairlife s portfolio of delicious, lactose-free, real dairy products includes: fairlife ultra-filtered milk; Core Power High Protein Shakes, a sports nutrition drink to support...

  • Senior Data Modeler

    1 month ago


    chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Modeler

    2 months ago


    Chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Sr. ETL/Data Engineer

    5 months ago


    Chicago, United States Saxon Global Full time

    CIBC BankChicago IL (hybrid onsite, 2-days per week) Sr ETL/Data Engineer (Talend/SQL) What You'll Be Doing By joining company's Capital Markets Enterprise Solutions Group, you'll be at the heart of a team bringing innovative technology to life as part of our digital transformation. As a Senior Data Engineer/ETL Developer, you'll contribute to the technical...

  • Senior Data Engineer

    1 month ago


    Chicago, Illinois, United States fairlife Full time

    Job DescriptionAt fairlife, LLC, we're building a best-in-class Data and Decision Intelligence (DDI) ecosystem to drive our digital transformation. As a Sr. Data Engineer, you'll play a key role in delivering this vision by translating technical requirements into targeted solutions that fit into our broader data framework, architecture, and roadmap.Key...

  • Sr. Data Analyst

    4 weeks ago


    Chicago, United States Procom Full time

    BMO is currently sourcing for a Sr. Data Analyst position on a 12-month contract. Summary of Role: Sr. Data Analyst role in Business Intelligence at BMO, based in Chicago with a hybrid work model, supporting EMM/MM/LMM strategic project for legacy data migrations. Project: EMM/MM/LMM strategic project for legacy data migrations to BMO platforms. Years of...


  • Chicago, United States Northern Trust Corporation Full time

    About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world’s most successful individuals, families, and institutions by remaining true to our...

  • Sr. Data Engineer

    3 weeks ago


    Chicago, United States Argo Group Full time

    Job DescriptionJob DescriptionArgo Group is a leader in specialty insurance with a vibrant culture built on respect, equality, wellness and opportunity. We're an innovative organization that's small enough to be agile and big enough to make a difference in our industry. Our flexible workplace is continuously evolving to ensure all employees feel:...

  • Sr. Software Engineer

    4 weeks ago


    Chicago, United States DTI Full time

    WHO WE ARE: Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop. WHAT WE DO: We focus on providing delivery, staffing, and supported services such as enterprise integration/implementations including, but not limited to, CRM, EAM, ERP, PMO, and QA. We service clients in...


  • Chicago, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract for a Sr. Data Entry Clerk position in the heart of Chicago, Illinois. This role involves a high level of data management and office administration, providing critical support to our team. The workplace is a hybrid model, with a schedule of 3 to 4 days a week.Responsibilities: • Accurately entering...


  • Chicago, Illinois, United States Cyclotron, Inc. Full time

    Job DescriptionSr. Data EngineerLevel: SeniorDepartment: AzureLocation: Fully RemoteType: Full-TimeJob SummaryCyclotron, Inc. is seeking a highly skilled Senior Data Engineer to lead the creation of high-value data-driven solutions leveraging our proven implementation methodology and solutions for enterprise projects. The ideal candidate will have extensive...

  • Sr. Platform Engineer

    14 hours ago


    Chicago, United States Saxon Global Full time

    Sr. Platform Engineer Apex Systems is seeking a Sr. Platform Engineer to support our Education Organization client. The Sr. Platform Engineer will be responsible for implementing cloud platforms and DevOps tooling to improve the developer experience. The ideal candidate will have a foundational knowledge of containerization, CI/CD patterns, scriptwriting,...

  • Sr. Data Engineer-GCP

    18 hours ago


    Chicago, United States CNA Full time

    You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. CNA seeks to offer a comprehensive and competitive benefits package to...


  • chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...


  • chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...


  • Chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...


  • Chicago, United States LHH Recruitment Solutions Full time

    Job DescriptionJob DescriptionSenior Data Protection EngineerResponsibilities:Develop and coordinate the data protection strategy, focusing on the implementation and adoption of secure data deidentification tools such as Voltage (MicroFocus or OpenText), Protegrity, and Secupi.Architect and develop data protection solutions, providing hands-on support to...

  • Data Engineer

    1 month ago


    chicago, United States Robert Half Full time

    Data Ingestion and Integration: You may need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, you could use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.Data Transformation and...