Lead Azure Data Warehouse Architect

2 weeks ago

Minneapolis, United States Saxon Global Full time

Must Have Skills :

Azure Data Lake design and implementation experienceExperience modeling and building out star schema on Cloud Data Lake for BI use cases.Databricks Data Lake experienceSparkSQLTeam Coaching skills.Strong architect who can hold their own and suggest solutions.AWS/Azure or GCP data lake experienceStreaming data pipelines with kafka for real time needsPolished consulting skills

Callie Dump Notes From Call:

They have teams that currently work with Azure and data so not completely in the dark here.

The place they need help with is with a data warehouse that is pulling data from a lot of different areas across the organization. 5-6 different analytics pipeline. Feed these to one data warehouse that will be used as a single source of truth.

Data analytics that will have to be aligned.

How will members align in different data pipelines and then transfer to data warehouse.

Azure type structure. Not relational. Utilize star scheema to do rollup queries.

Need help on Data warehousing approach on azure then drive maintenance of star scheema in that environment.

Doing lots of fits and starts and going down false trails. Lots of trial and error.

Wants someone with previous experience in this area. Need super strong resource.

Using looking at synaps on azure or possibly something else.

Medallion type architecture. Gold/silver/bronze.

Not looking at using sql clusters in synapse. This doesn't work for them.

Using spark based ETL. Serverless compute running against deltalake.

Databricks?? TBD they are looking into this. Would love someone to be able to recommend yes or no.

Need someone with strong data warehouse background.

How does everything fit into reporting and data warehouse structure. Wants to collaborate with this person to help decide someo of these things.

Needs someone to speak up and figure out problems and suggest path forward. Be able to explain why and why not.

Data is coming in as parka... some coming in from MicroStrategy. Need landing zone somehow.

Microservice oriented architecture. Reports need to be real team. Publishing out to kafka from microservices that will feed into datawarehouse. Daily basis of this. Not all file based or parka.

Clinical encounters are going to be very important to react to quickly.

They already have kafka but they would like to help ramp this up. Need help with how the kafka is used with datawarehouse. Make sure it lands in warehosue without losing it.

How much data is historic vs day to day? Some monthly some daily. Gigabites of data.

250 terabytes of data by the time this is done. It will be expanding in scope as well.

100 million members in data store.

Updates?? Everything is pretty much new updates. For the most part they do the data work in the intake process and what is a delta?

There will be a silver layer in the warehouse where there will not be any differentiators. Historical data at this level.

Bronze:

Some tracking of history but wants to expand this to be able to do snapshots over time.

Lots of reporting is tableau based but its very manual so they want to move towards powerbi here. They will likely use both for reporting engines.

Data that needs to be isolated by payer as much as possible. Need to be able to show this data trail. Cant have payer data crossover. 100's of payers. They focus mainly on large payers now and then into midsized.

3-4 million providers. 80 million total though. Trying to narrow this down.

Healthcare experience and star scheema experience is really important. Need help with process and strategy.

Data engineering SME that can build out work.

Will start with proof of concept.

Required Skills : 1. Azure Data Lake design and implementation experience 2. Experience modeling and building out star schema on Cloud Data Lake for BI use cases. 3. Databricks Data Lake experience 4. Spark 5. SQL 6. Team Coaching skills. 7. Strong architect who can hold their own and suggest solutions. 8. AWS/Azure or GCP data lake experience 9. Streaming data pipelines with kafka for real time needs 10. Polished consulting skillsBasic Qualification :Additional Skills :Background Check :YesDrug Screen :YesNotes :Selling points for candidate :Project Verification Info :Candidate must be your W2 Employee :YesExclusive to Apex :NoFace to face interview required :NoCandidate must be local :NoCandidate must be authorized to work without sponsorship ::NoInterview times set : :NoType of project :Architecture/DesignMaster Job Title :Architect: Apps (Other)Branch Code :Minneapolis #J-18808-Ljbffr

  • Lead Azure Data Warehouse Architect

    5 days ago

    Minneapolis, United States Saxon Global Full time

    Must Have Skills : Azure Data Lake design and implementation experience Experience modeling and building out star schema on Cloud Data Lake for BI use cases. Databricks Data Lake experience Spark SQL Team Coaching skills. Strong architect who can hold their own and suggest solutions. AWS/Azure or GCP data lake experience Streaming data pipelines...

  • Azure Data Architect

    2 days ago

    Minneapolis, United States Cliecon Solutions Inc Full time

    Job DescriptionJob DescriptionRole: Azure Data ArchitectLocation: Minneapolis, MNDuration: Long term (contract 2 hire) Data Architecture Design: Lead the design and development of scalable, reliable, and high-performance data architectures on the Microsoft Azure platform. This includes defining data models, schemas, and structures to support business needs...

  • Data Architect

    3 days ago

    Minneapolis, United States Diverse Lynx Full time

    Job Title: Sr Data Architect Job Type: Full Time/ Permanent Location: Minneapolis, MN Job Details: Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. Should be hands on engineer with experience in multiple data engineering technologies (Spark/Kafka/ADF/Databricks) as well as the...

  • Sr Data Architect

    4 days ago

    Minneapolis, United States Diverse Lynx Full time

    Role: Sr Data Architect Location: Minneapolis, MN Onsite Type: Fulltime / permanent Skill Data Architecture and Modeling Minimum Experience 8 - 10 Years Job description: Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. Should be hands on engineer with experience in multiple...

  • Sr Data Architect

    3 weeks ago

    Minneapolis, United States Diverse Lynx Full time

    Role: Sr Data Architect Location: Minneapolis, MN - Onsite Type: Fulltime / permanentSkill Data Architecture and Modeling Minimum Experience 8 - 10 Years Job description: Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. Should be hands on engineer with experience in multiple data...

  • Data Architect

    6 days ago

    Minneapolis, Minnesota, United States Apogee Enterprises Inc Full time

    Apogee Services Inc.Position SummaryIn this highly visible role, this individual will provide key leadership on all aspects of the company's data platform. The Data Architect will implement architectural standards and frameworks across software, quality, and infrastructure teams as technology emerges and as the business requires. ResponsibilitiesProvide...

  • Data Architect

    2 days ago

    Minneapolis, United States Ranger Technical Resources Full time

    Data Architect #2345Position Summary:Our partner, a dynamic insurance and financial service provider, who has pioneered a diverse range of solutions is seeking a highly skilled Data Architect to join their team. In this role, you will be responsible for developing data designs, architecture and implementation plans from PoC to completion/deployment. You will...

  • Data Architect

    2 days ago

    Minneapolis, United States Ranger Technical Resources Full time

    Data Architect #2345Position Summary:Our partner, a dynamic insurance and financial service provider, who has pioneered a diverse range of solutions is seeking a highly skilled Data Architect to join their team. In this role, you will be responsible for developing data designs, architecture and implementation plans from PoC to completion/deployment. You will...

  • Data Architect

    5 days ago

    Minneapolis, United States Apogee Enterprises Inc Full time

    Apogee Services Inc. Position Summary In this highly visible role, this individual will provide key leadership on all aspects of the company's data platform. The Data Architect will implement architectural standards and frameworks across software, quality, and infrastructure teams as technology emerges and as the business requires....

  • Senior Health Data Architect

    5 days ago

    Minneapolis, United States Compunnel Full time

    Description: Project: Client is currently seeking a hands-on Senior Health Data Architect to support our AL EDW within the Enterprise Datawarehouse and Analytics group. The Data Architect will work with large healthcare datasets and will translate client's business requirements into enterprise systems, applications, or process designs for large complex...

  • Senior Health Data Architect

    7 days ago

    Minneapolis, United States JobRialto Full time

    Description: Project: Client is currently seeking a hands-on Senior Health Data Architect to support our AL EDW within the Enterprise Datawarehouse and Analytics group. The Data Architect will work with large healthcare datasets and will translate client's business requirements into enterprise systems, applications, or process designs for large complex...

  • Data warehouse Architect

    2 weeks ago

    Minneapolis, United States Select Source International Full time

    Job Title: Data Warehouse ArchitectLocation: 1800 Larimer Street Denver Colorado 80202 / Minneapolis, MN (3 days onsite 2 days remote)Duration: CTH , initially 3 Months contract (will convert Full time after 3 months) As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS...

  • Health Data Architect

    5 days ago

    Minneapolis, United States Randstad USA Full time

    job summary: Ideal Background: strong Healthcare background with Data Modeling and Analysis skills TOP REQUIREMENTS: Expertise in Data Architecture, Data Strategy and Roadmap for large and complex health entity and systems and implemented large scale end-to-end Data Management & Analytics solutions for more than one large client.strong knowledge of...

  • Health data architect

    6 days ago

    Minneapolis, United States Randstad Full time

    job summary: Ideal Background: strong Healthcare background with Data Modeling and Analysis skills TOP REQUIREMENTS: Expertise in Data Architecture, Data Strategy and Roadmap for large and complex health entity and systems and implemented large scale end-to-end Data Management & Analytics solutions for more than one large client. strong knowledge of...

  • Azure Data Lake Analytics

    2 weeks ago

    Minneapolis, United States The Dignify Solutions LLC Full time

    8-9 years experience in architecture, solutioning of data warehousing/data lake projects in Azure. Architect and design Azure Data Lake solution based on business requirements provided by BA. Recommend standards to be followed for Azure development Prioritize, estimate, and guide development effort. Conduct research and report on feasibility and impacts...

  • Data Engineer

    3 weeks ago

    Minneapolis, United States Marvel Technologies Inc Full time

    Job DescriptionJob DescriptionLocation: Minneapolis, MN (Hybrid Role)Rate: Open - best possible rateDuration: Long Term.Start Date: 05.27.2024Core skills required Azure Cloud Azure Data Factory Databricks Azure SQL Python or same/similar scripting for automation A few things that he did mention that he would like on the "Wish List": Azure Services/Azure...

  • Azure Cloud Security Architect

    5 days ago

    Minneapolis, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Azure Cloud Security Architect

    6 days ago

    Minneapolis, Minnesota, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Data Warehouse Architect

    7 days ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support...

  • Data Warehouse Architect

    8 hours ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to...