Sr. Data Engineer

1 month ago


Chicago, United States Saxon Global Full time
CAPITAL ONE
CHICAGO IL (onsite 3 days week)


REQ ID 73155-1Sr Data Engineer

We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, there's a plan to migrate the existing AWS EMR application to AWS Glue.

The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.

Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints. If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.

Skill Set:

AWS Cloud Technologies:
  • Strong command of Apache Spark (3-5 years)
  • AWS EMR proficiency (3-5 years)
  • AWS Glue expertise (1-5 years)
PySpark Application Development:
  • Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications
  • Proven track record in processing and handling large datasets
Performance Tuning:
  • Hands-on experience in performance tuning Spark applications
  • Skills to optimize Spark code for scalability, performance, and maintainability
Microservices Development:
  • Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years)
  • Code Management:
  • Strong proficiency in using GitHub for efficient code management and sharing
Nice to have:
  • Experience in the node.js, vue.js.
  • Experience in Databricks

Required Skills : AWS EMR AWS Glue AWS Lambda AWS SNS DynamoDB Apache Spark PySpark / Python CodingNo Tenure Limit Policy
Background Check :Yes
Notes :
Selling points for candidate :No Tenure Limit Policy
Project Verification Info :"The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management. MSA: Blanket Approval Received Client Letter: Will Provide"
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :
Master Job Title :
Branch Code :
  • Sr. Data Engineer

    1 month ago


    Chicago, United States SysMind Tech Full time

    1 Job Title Sr. Data Engineer Relevant Experience 10+ Yrs Technical/Functional Skills • Productivity - G-Suite, Lucid Chart, Jira, Confluence, Slack • GCP - Artifact Registry, Container Registry, Cloud Composer, Cloud Functions, Cloud Run, Data Proc, • Languages - Python, SQL, MQL, Docker • Kubernetes Engine, PubSub, Secret Manager,...

  • Sr. ETL/Data Engineer

    6 months ago


    Chicago, United States Saxon Global Full time

    CIBC BankChicago IL (hybrid onsite, 2-days per week) Sr ETL/Data Engineer (Talend/SQL) What You'll Be Doing By joining company's Capital Markets Enterprise Solutions Group, you'll be at the heart of a team bringing innovative technology to life as part of our digital transformation. As a Senior Data Engineer/ETL Developer, you'll contribute to the technical...

  • Sr. Solution Engineer

    4 weeks ago


    Chicago, United States ShiftCode Analytics Full time

    Title: Sr. Solution Engineer Visa: Any except H1B, OPT, CPT Duration: 6 Months Client: Hyatt Mode Of Interview: Video Call Need Local Candidates Must have LinkedIn I'd MUST HAVE: this person is a Sr. solution engineer with expertise in GCP and AWS DO NOT SUBMIT if candidate does not have GCP MUST HAVE: GCP (3-5 YRS. hands on EXP) + Supporting data science...


  • Chicago, United States Wavicle Data Solutions Full time

    About the Role We are looking for a Data Engineer who will provide support to the Data and Application Integration Team by developing and communicating middleware-based integration architecture, strategies, guidelines, standards, and leading practices. The ideal candidate will also be expected to provide support on technical and architectural direction,...


  • Chicago, United States Aquent Full time

    Position Overview: Sr. Specialist, Marketing Data & Analytics The Sr. Specialist, Marketing Data & Analytics will play a key role in advancing our client’s data-driven marketing strategy by delivering in-depth analyses and actionable insights to support student growth. This role requires a highly analytical thinker who can draw insights from diverse data...

  • Sr. Software Engineer

    2 months ago


    Chicago, United States DTI Full time

    WHO WE ARE: Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop. WHAT WE DO: We focus on providing delivery, staffing, and supported services such as enterprise integration/implementations including, but not limited to, CRM, EAM, ERP, PMO, and QA. We service clients in...


  • Chicago, Illinois, United States STS Technical Services Full time

    About the OpportunityAs a Sr. System Engineer at STS Technical Services, you will play a critical role in developing and optimizing powertrain and chassis systems for motorcycles.Key Responsibilities:Collaborate with cross-functional teams to develop and analyze CAE models for powertrain and chassis systems.Develop and implement optimization strategies to...

  • Sr. Data Entry Clerk

    1 month ago


    Chicago, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract for a Sr. Data Entry Clerk position in the heart of Chicago, Illinois. This role involves a high level of data management and office administration, providing critical support to our team. The workplace is a hybrid model, with a schedule of 3 to 4 days a week.Responsibilities: • Accurately entering...

  • Sr. Platform Engineer

    1 month ago


    Chicago, United States Saxon Global Full time

    Sr. Platform Engineer Apex Systems is seeking a Sr. Platform Engineer to support our Education Organization client. The Sr. Platform Engineer will be responsible for implementing cloud platforms and DevOps tooling to improve the developer experience. The ideal candidate will have a foundational knowledge of containerization, CI/CD patterns, scriptwriting,...


  • Chicago, United States CNA Insurance Full time

    You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential.To be considered for an interview, please make sure your application is...

  • Sr. Data Engineer-GCP

    1 month ago


    Chicago, United States CNA Full time

    You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. CNA seeks to offer a comprehensive and competitive benefits package to...


  • Chicago, United States 1872 Consulting Full time

    Sr Legal Applications Engineer Onsite 1 day/week in either Chicago, Austin, San Francisco, Boston, NYC, Houston, Dallas, Miami, Washington D.C. or Salt Lake City Summary The Senior Legal Applications Engineer role sits on the Litigation Practice Delivery team, and builds, optimizes, deploys and maintains legal applications for the litigation team consisting...


  • Chicago, United States Aquent Full time

    Job DescriptionPosition Overview: Sr. Specialist, Marketing Data & AnalyticsThe Sr. Specialist, Marketing Data & Analytics will play a key role in advancing our client’s data-driven marketing strategy by delivering in-depth analyses and actionable insights to support student growth. This role requires a highly analytical thinker who can draw insights from...

  • Sr System Engineer

    4 days ago


    Chicago, United States CoSourcing Partners - Enterprise-AI and IT Services Company Full time

    Sr Systems Engineer - Kubernetes/Cloud Administrator (AWS/GCP) Location: Downtown Chicago (On-site)Employment Type: Contract to Hire (W2 required)Citizenship Status: U.S. Citizen, EAD, or Green Card requiredAbout the Company:Join a leading Consumer Retail business based in downtown Chicago, focused on digital transformation and innovation. We are looking for...

  • Sr System Engineer

    2 weeks ago


    Chicago, United States CoSourcing Partners - Enterprise-AI and IT Services Company Full time

    Sr Systems Engineer - Kubernetes/Cloud Administrator (AWS/GCP) Location: Downtown Chicago (On-site)Employment Type: Contract to Hire (W2 required)Citizenship Status: U.S. Citizen, EAD, or Green Card requiredAbout the Company:Join a leading Consumer Retail business based in downtown Chicago, focused on digital transformation and innovation. We are looking for...

  • Sr Data Analyst

    4 weeks ago


    Chicago, United States CNA Insurance Full time

    You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. All the relevant skills, qualifications and experience that a...

  • Sr Data Analyst

    4 weeks ago


    Chicago, United States CNA Insurance Full time

    You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential.All the relevant skills, qualifications and experience that a successful...


  • Chicago, IL, United States Wavicle Data Solutions Full time

    About the Role We are looking for a Data Engineer who will provide support to the Data and Application Integration Team by developing and communicating middleware-based integration architecture, strategies, guidelines, standards, and leading practices. The ideal candidate will also be expected to provide support on technical and architectural direction,...

  • Sr Systems Engineer

    1 month ago


    Chicago, United States Rush University Full time

    Job Description Location: Chicago, IL Hospital: RUSH University Medical Center Department: IT Infrastructure Work Type: Full Time (Total FTE between 0.9 and 1.0) Shift: Shift 1 Work Schedule: 8 Hr (8:00:00 AM - 5:00:00 PM) Summary: This position is for a full-time Sr Systems Engineer that supports the following technologies: Enterprise Windows...


  • Chicago, United States Prairie Consulting Services Full time

    SR CyberArk Engineer needed for immediate LONG term contract engagement with highly known and desired financial services company. This is a Remote opportunity.SR CyberArk Engineer we are seeking MUST have MINIMUM 12+ years IT experience with last 5+ years concentration in implementation of Privileged Identity Management using CyberArk for enterprise...