Lead Data Engineer

2 weeks ago

Chicago, IL, United States Omni Inclusive Full time
Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT

Job Description:
Required Skills:
6-8 years+ experience on Snowflake SQL - advanced SQL expertise
6-8 years+ experience on data warehouse experiences - hands on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization / denormalization, dimensions, aggregations etc.,
6-8 years+ experience working in reporting and analytics environments - development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.,
6 years+ on Python - advanced Python expertise
6 years+ on any cloud platform - AWS preferred
Hands on experience on AWS on Lambda, S3, SNS / SQS, EC2 is a bare minimum,
6 years+ on any ETL / ELT tool - Informatica, Fivetran, DBT, Airflow etc. - Must
6 years+ with developing functional metrics in any specific business

Responsibilities:
• Lead data warehouse development activities for a team, leading more than one project in parallel.
• Assign data warehouse development tasks to team of 1-6 developers (Onsite/Offshore).
• Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function.
• Work with minimal supervision and provide status updates and escalation to leadership as appropriate.
• Provides application support as part of an on-call rotation to work on resolving outages and user questions.
• Review project objectives and determine best technology to apply.
• Design and build large scale datasets for a wide range of consumer needs.
• Build, test and implement highly efficient data pipelines using a variety of technologies.
• Develop best practice standards for solution design and data structures.
• Analyze new data sources to understand quality, availability, and content.
• Write technical design documentation.
• Conducts peer code reviews.
• Create and executes unit tests.
• Supports QA team during testing.
• Mentor less experienced members of the development team.

  • Lead Data Engineer

    4 days ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are...

  • Lead Data Engineer

    4 days ago

    Chicago, IL, United States Capital One Full time

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are...

  • Lead Data Engineer

    3 days ago

    Chicago, IL, United States Optiver Full time

    Optiver Chicago is seeking a seasoned Data Engineer to support and advance the data capabilities of our local research team and contribute to our broader Lakehouse architecture vision. In this role, you'll work with cutting-edge tools like Databricks, Apache Spark, and Delta Lake, translating experimental research workflows into scalable, production-grade...

  • Lead Data Engineer

    1 day ago

    Chicago, IL, United States Optiver Full time

    Optiver Chicago is seeking a seasoned Data Engineer to support and advance the data capabilities of our local research team and contribute to our broader Lakehouse architecture vision. In this role, you'll work with cutting-edge tools like Databricks, Apache Spark, and Delta Lake, translating experimental research workflows into scalable, production-grade...

  • Lead Data Scientist/Engineer

    3 days ago

    Chicago, IL, United States Insight Global Full time

    The Lead Data Scientist/Engineer plays a pivotal role in supporting the Medicare Clinical Stars program by providing technical expertise in data engineering, particularly focusing on Google Cloud Platform (GCP) and Hadoop ecosystems. This role involves working within a team of data engineers, acting as a liaison between the Data Intelligence group and the...

  • Lead Data Scientist/Engineer

    2 weeks ago

    Chicago, IL, United States Insight Global Full time

    The Lead Data Scientist/Engineer plays a pivotal role in supporting the Medicare Clinical Stars program by providing technical expertise in data engineering, particularly focusing on Google Cloud Platform (GCP) and Hadoop ecosystems. This role involves working within a team of data engineers, acting as a liaison between the Data Intelligence group and the...

  • Lead Data Engineering Expert

    4 days ago

    Chicago, IL, United States Capital One Full time

    Join our innovative team at Capital One as a Lead Data Engineering Expert. In this vital role, you will be an individual contributor focused on diverse thought processes that help visualize and solve complex problems. We value diverse perspectives, as they enhance our capabilities to influence, collaborate, and deliver innovative solutions across various...

  • Lead Data Engineering Expert

    3 days ago

    Chicago, IL, United States Capital One Full time

    Join our innovative team at Capital One as a Lead Data Engineering Expert. In this vital role, you will be an individual contributor focused on diverse thought processes that help visualize and solve complex problems. We value diverse perspectives, as they enhance our capabilities to influence, collaborate, and deliver innovative solutions across various...

  • Lead Data Engineering Expert

    1 day ago

    Chicago, IL, United States Capital One Full time

    Join our innovative team at Capital One as a Lead Data Engineering Expert. In this vital role, you will be an individual contributor focused on diverse thought processes that help visualize and solve complex problems. We value diverse perspectives, as they enhance our capabilities to influence, collaborate, and deliver innovative solutions across various...

  • Senior Lead Data Engineer

    1 day ago

    Chicago, IL, United States Capital One Full time

    Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We...