Data Architect

4 days ago

Chicago, IL, United States 1872 Consulting Full time
Data Architect
Chicago, IL - hybrid WFH: 3 days onsite in the loop, 2 days work from home

Summary
We're looking for a Data Architect with a background in Azure, Databricks, Snowflake and Python, which is our primary tech stack for designing, building, and optimizing data pipelines. This role is foundational for our organization to deliver best in class AI models, Machine Learning, Analytics and BI - where we have an industry leading real estate data platform, to power critical business decisions in our space.

What you'll be doing
  • Design, develop, and maintain robust data pipelines using Databricks to process and transform large-scale datasets.
  • Write efficient, reusable, and scalable SQL and/or Python code for data ingestion, transformation, and integration.
  • Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments.
  • Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.
  • Implement data governance, security, and compliance best practices within data pipelines.
  • Monitor and troubleshoot data pipeline issues, ensuring high availability and data integrity.
  • Leverage Databricks for advanced analytics, machine learning workflows, and real-time data processing.
  • Integrate data from various sources (APIs, databases, blob, SFTP, streams) into Datalake for centralized storage and querying.
  • Mentor junior data engineers and contribute to team knowledge sharing.
  • Stay updated on emerging data technologies and recommend improvements to existing systems.
  • Performance Tuning and Optimization of all Data Ingestion and Data Integration processes, including the Data Platform and databases

Skills we're seeking
  • 7+ years of experience with Data Architecture / Data Engineering
    • Must have strong experience designing, building and optimizing data pipelines
  • 2+ years of Data Architect experience specifically
  • Must have strong experience with Azure
  • Must have strong experience with Databricks
  • Must have strong experience with Snowflake
  • Must have advanced proficiency with SQL
  • Must have data modeling experience
    • Understanding of data schema modeling (dimensions, measures, slowly changing dimensions)
    • Inmon vs Kimball (Star-Schema vs 3NF)
  • Must have excellent communication skills

Nice to haves (in this order)
  • Strong Python experience, or other programming experience (Python highly preferred) for data processing, scripting, and automation
  • Bachelor's or Master's Degree in Computer Science or related IT or Data field
  • Experience with Azure Durable Functions
  • Experience with Spark
  • Experience with Azure Durable Functions
  • Experience with DuckDB
  • Experience with Parquet, Delta Lake, and/or Iceberg formats
  • Experience with ELT and/or Bronze, Silver, Gold transformation layers
  • Experience with data governance

  • Data Architect

    5 days ago

    Chicago, IL, United States Access to Future Inc Full time

    About the job Data Architect Job Description Northern Trust - Data Architect (IBM MDM)Chicago IL or REMOTE24-Months Will be responsible for Architecting/Designing/Developing MDM data management. MDM Data is a collection of Northern Parties and contains large volume of data. Will also provide a standard common business vocabulary, expresses strategic...

  • Senior Data Architect

    5 days ago

    Chicago, IL, United States Marsh & McLennan Full time

    Senior Data Architect Award-winning, inclusive, top workplace culture doesn't happen overnight. It's a result of hard work by extraordinary people. More than 11,000 of the industry's brightest talent drive our efforts to deliver purposeful work and meaningful impact every day. Learn more about what makes us different and how you can thrive as a Senior Data...

  • Data Architect/Lead

    2 weeks ago

    Chicago, IL, United States Staffing the Universe Full time

    Data Architect Location: Remote/Memphis TN (Preferred), Somerset NJ, Austin TX (Preferred), St. Louis MO, Morristown NJ What You Will Do: Data Architect will take the lead to design enterprise information architecture solutions in compliance with firm wide data management principles and security controls. Analyze across multiple data domains and define...

  • Azure Data Architect

    7 days ago

    Chicago, IL, United States Diverse Lynx Full time

    Role: Azure Data Architect Description: "• Experience of setting up Data Governance, catalogue and self-service in Data Lakehouse • Influence leaders in development, client operations, and IT infrastructure areas to plan and prioritize work and ensure delivery of business application support. • Partner with project and product teams to embrace emerging...

  • Azure Data Architect

    2 weeks ago

    Chicago, IL, United States Diverse Lynx Full time

    Role: Azure Data Architect Description: "• Experience of setting up Data Governance, catalogue and self-service in Data Lakehouse • Influence leaders in development, client operations, and IT infrastructure areas to plan and prioritize work and ensure delivery of business application support. • Partner with project and product teams to embrace emerging...

  • Azure Data Architect

    2 weeks ago

    Chicago, IL, United States Diverse Lynx Full time

    Role: Azure Data Architect Description: "• Experience of setting up Data Governance, catalogue and self-service in Data Lakehouse • Influence leaders in development, client operations, and IT infrastructure areas to plan and prioritize work and ensure delivery of business application support. • Partner with project and product teams to embrace emerging...

  • Azure Data Architect

    3 days ago

    Chicago, IL, United States Diverse Lynx Full time

    Role: Azure Data Architect Description: "• Experience of setting up Data Governance, catalogue and self-service in Data Lakehouse • Influence leaders in development, client operations, and IT infrastructure areas to plan and prioritize work and ensure delivery of business application support. • Partner with project and product teams to embrace emerging...

  • Big Data Architect

    7 days ago

    Chicago, IL, United States Staffing the Universe Full time

    Big Data Architect Location: Chicago, IL Duration: Full Time Skills Required: At least 12+ years of work experience Strong background in statistical concepts and calculations Use machine learning, data mining, predictive modelling & statistical techniques to create new scalable models for business requirement Need to have good understanding & working...

  • Big Data Architect

    2 weeks ago

    Chicago, IL, United States Staffing the Universe Full time

    Big Data Architect Location: Chicago, IL Duration: Full Time Skills Required: At least 12+ years of work experience Strong background in statistical concepts and calculations Use machine learning, data mining, predictive modelling & statistical techniques to create new scalable models for business requirement Need to have good understanding & working...

  • Big Data Architect

    1 week ago

    Chicago, IL, United States Staffing the Universe Full time

    Big Data Architect Location: Chicago, IL Duration: Full Time Skills Required: At least 12+ years of work experience Strong background in statistical concepts and calculations Use machine learning, data mining, predictive modelling & statistical techniques to create new scalable models for business requirement Need to have good understanding & working...