AWS Lead Data Engineer

3 days ago

Chicago, IL, United States Brillio Full time
About Brillio:

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Senior Data Specialist

Primary Skills
    • Must have: Python, SQL/PLSQL, AWS, Postgresql, S3, Glue
    • Good to have: CDK, GitHub
Job requirements
    • Lead Data Engineer - AWS (Data Lake, Redshift, Aurora Integration)
    • Location: [Chicago]
    • Experience: 8-12 years
    • About the Role
    • We are seeking a Lead Data Engineer to design and implement scalable, secure, and high-performance data platforms on AWS. The role focuses on building data pipelines, managing data lakes and databases (Redshift, Lake Formation, Aurora), and exposing curated data for React-based dashboards and analytical applications.
    • Key Responsibilities
    • Data Engineering & Architecture
    • Design, build, and optimize data pipelines using AWS Glue, Lambda, and Step Functions for ingestion, transformation, and curation.
    • Develop and maintain data lakes (S3 + Lake Formation) and data warehouses (Redshift) to support analytics and visualization.
    • Integrate Aurora (PostgreSQL/MySQL) as a serving layer for APIs and dashboards.
    • Design APIs or direct query interfaces that expose curated datasets for React-based dashboards and web applications.
    • Define and implement data models, partitioning strategies, and schema evolution best practices for performance and scalability.
    • Security, Governance & Compliance
    • Implement data security policies, encryption, and role-based access controls using AWS IAM, KMS, Lake Formation, and Secrets Manager.
    • Ensure compliance with organizational data governance and privacy standards.
    • Maintain data cataloging, lineage, and access tracking within AWS Glue Data Catalog and Lake Formation.
    • Implement CI/CD pipelines for data workflows in collaboration with DevOps teams.
    • Required Skills & Qualifications
    • 7+ years of experience in data engineering and AWS data architecture.


$93,100 - $133,000 a year

Know what it's like to work and grow at Brillio: Click here

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

  • Lead Data Engineer

    2 weeks ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer (Python, GoLang, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real...

  • Lead Data Engineer

    2 weeks ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer (Python, GoLang, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real...

  • Lead Data Engineering Expert

    2 days ago

    Chicago, IL, United States Capital One Full time

    Join our innovative team at Capital One as a Lead Data Engineering Expert. In this vital role, you will be an individual contributor focused on diverse thought processes that help visualize and solve complex problems. We value diverse perspectives, as they enhance our capabilities to influence, collaborate, and deliver innovative solutions across various...

  • Lead Data Engineering Expert

    2 days ago

    Chicago, IL, United States Capital One Full time

    Join our innovative team at Capital One as a Lead Data Engineering Expert. In this vital role, you will be an individual contributor focused on diverse thought processes that help visualize and solve complex problems. We value diverse perspectives, as they enhance our capabilities to influence, collaborate, and deliver innovative solutions across various...

  • Lead Data Engineer

    2 days ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are...

  • Lead Data Engineer

    2 days ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are...

  • Lead Software Engineer

    2 weeks ago

    Chicago, IL, United States Capital One Full time

    Lead Software Engineer (Java, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real...

  • Lead Software Engineer

    6 days ago

    Chicago, IL, United States Capital One Full time

    Lead Software Engineer (Java, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real...

  • Lead Software Engineer

    6 days ago

    Chicago, IL, United States Capital One Full time

    Lead Software Engineer (Java, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real...

  • Lead Software Engineer

    2 weeks ago

    Chicago, IL, United States Capital One Full time

    Lead Software Engineer (Java, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real...