Senior Data Architect

1 week ago

Louisville, Kentucky, United States Cays Inc Full time
Job Description

We are seeking a highly skilled Data Architect to lead the design and implementation of scalable, cloud-based data architectures leveraging Azure Data Lakehouse and Medallion Architecture principles.

Key Responsibilities:

  • Design and Implement Data Architecture: Lead the design and development of cloud-based data architectures, ensuring seamless integration with Azure Data Lakehouse and Medallion Architecture.
  • Azure Databricks and Delta Lake: Architect and implement data pipelines and ETL processes using Azure Databricks, ensuring ACID transactions, time travel, and optimized data storage.
  • Medallion Architecture: Implement the Medallion Architecture pattern, building Bronze, Silver, and Gold layers for efficient data processing, aggregation, and enrichment.
  • Customer Data Platform (CDP) Integration: Design and manage the data architecture to effectively handle customer data, integrating the Customer Data Platform (CDP) with the Azure data ecosystem.
  • Data Lakehouse Management: Lead the implementation and optimization of Azure Data Lake Storage (ADLS) for structured, semi-structured, and unstructured data storage, ensuring efficient querying and data retrieval.
  • Data Governance and Security: Define and implement robust data governance, security, and compliance practices using Azure tools like Data Catalog, Purview, and Key Vault.
  • Performance Optimization: Optimize data pipelines for performance, scalability, and cost-efficiency, ensuring data is processed efficiently and meets SLAs for downstream analytics and reporting systems.
  • Collaboration with Data Engineers and Analysts: Work closely with data engineers, business analysts, and data scientists to define data requirements, ensuring data pipelines meet business needs.
  • Real-Time Data Integration: Architect real-time data ingestion pipelines, integrating with various data sources and streamlining real-time analytics using Azure Databricks and Delta Lake.
  • Documentation and Best Practices: Establish best practices for data architecture, provide documentation for data pipelines and architecture, and ensure knowledge sharing across the organization.

Required Qualifications:

  • 5+ years of experience in data architecture and engineering, with expertise in Azure Databricks, Azure Data Lakehouse, and Delta Lake.
  • Hands-on experience implementing Medallion Architecture, building and managing Bronze, Silver, and Gold data layers.
  • Strong experience with Azure Data Lake Storage (ADLS) and integration with Delta Lake for efficient data storage and querying.
  • Customer Data Platform (CDP) experience, with the ability to design and integrate customer-centric data architectures that drive personalized analytics.
  • Experience in data governance, security, and compliance using Azure tools like Purview, Data Catalog, and Key Vault.
  • Proven experience in ETL/ELT development and real-time data ingestion pipelines, working with large-scale datasets.
  • Strong knowledge of SQL, Python, and Spark for data processing, analysis, and pipeline development.
  • Familiarity with data modeling techniques, big data technologies, and data warehousing in a cloud environment.
  • Excellent communication and collaboration skills, with the ability to work cross-functionally and lead data-driven initiatives.
  • Preferred Qualifications:
  • Experience with machine learning and advanced analytics workflows using Azure Databricks.
  • Familiarity with API integration and real-time data streaming solutions like Azure Event Hubs or Azure Stream Analytics.
  • Knowledge of DevOps for data, including automated CI/CD pipelines for data deployments.

Education:

  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.

  • Senior Enterprise Architect

    5 days ago

    Louisville, Kentucky, United States NTT DATA Group Corporation Full time

    About this role:The Applications Architect plays a crucial part in shaping the development and implementation of Information Technology (I.T.) strategy, initiatives, and governing policies. They conduct comprehensive reviews of the enterprise, document capabilities, and devise approaches to align technical solutions with business needs. This role assists in...

  • Senior Cloud Architect

    2 weeks ago

    Louisville, Kentucky, United States Datamtx LLC Full time

    ROLE:Senior Cloud Architect (Integrated Health)SUMMARY:You have the opportunity to join our technology team and help enable seamless delivery of health and care services to customers across their journey through the ecosystem.Integrated Health will continue to bring the CenterWell assets closer together, leveraging patient experience initiatives as a core...

  • Data Architect

    2 weeks ago

    Louisville, Kentucky, United States Rishabh RPO Full time

    Job OverviewRishabh RPO is seeking a highly skilled Data Architect to lead and support software developers, database architects, data analysts, and data scientists on data initiatives. The ideal candidate will ensure optimal data delivery architecture is consistent throughout ongoing projects.Key ResponsibilitiesProactively lead and support cross-functional...

  • Data Architect

    2 weeks ago

    Louisville, Kentucky, United States Rishabh Software Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Rishabh Software. As a Data Architect, you will be responsible for designing and implementing data architectures that meet the needs of our clients in the pharmacy industry.Key Responsibilities:Design and implement data architectures that meet the needs of our...

  • Senior Enterprise Solutions Architect

    5 days ago

    Louisville, Kentucky, United States KiZAN Technologies Full time

    KiZAN Technologies is seeking a highly skilled Data and AI Solutions Architect to support complex sales initiatives and customer projects.Key Responsibilities:Support sales initiatives focused on key strategic accounts and opportunities over specific financial thresholds.Plan and design phases for customer projects, enabling other team members for broad...

  • Data Solutions Architect

    2 weeks ago

    Louisville, Kentucky, United States Emids Full time

    Job Title: Data Solutions ArchitectEmids is seeking a highly skilled Data Solutions Architect to join our team in Louisville, KY. As a Data Solutions Architect, you will be responsible for designing and implementing data solutions that meet the business needs of our clients in the Healthcare & LifeSciences space.Key Responsibilities:Design and implement data...

  • Data Architect Position

    4 days ago

    Louisville, Kentucky, United States Walker Healthforce Full time

    Job Title: Data ArchitectAbout the Role:Walker Healthforce is seeking a skilled Data Architect to lead the migration of the Cancer Center unit's data warehouse to Google Cloud Platform (GCP).Key Responsibilities:• Work with the research section to design and implement robust data solutions.• Collaborate with Data Engineers to develop and implement system...

  • Data Solutions Architect

    5 days ago

    Louisville, Kentucky, United States emids Full time

    Job Title: Data Solutions ArchitectAbout the Role:The Data Solutions Architect will play a key role in leading and supporting software developers, database architects, data analysts, and data scientists on data initiatives. This includes ensuring optimal data delivery architecture is consistent throughout ongoing projects.Key Responsibilities:- Expand and...

  • Data Architect

    1 week ago

    Louisville, Kentucky, United States Rishabh Software Full time

    Job DescriptionAs a Data Architect at Rishabh Software, you will play a key role in designing and implementing data delivery architecture that is consistent throughout ongoing projects. Your expertise in Azure services, continuous integration and deployment, and Azure monitoring tools will be instrumental in ensuring the health and scalability of our cloud...

  • Senior Project Architect

    2 weeks ago

    Louisville, Kentucky, United States Theoris Full time

    Senior Project ArchitectJob Title: Senior Project ArchitectLocation: Louisville, KYIndustry: Design & ConstructionJob Description:Theoris is seeking a highly skilled Senior Project Architect to join their team on a direct hire basis. The ideal candidate will be responsible for the tactical implementation of projects, achieving project objectives, financial...

  • Senior Project Architect

    2 weeks ago

    Louisville, Kentucky, United States Jobs for Humanity Full time

    Job Title: Senior Project ArchitectJob Summary:Theoris is assisting their client in finding a Senior Project Architect to join their team on a direct hire basis. The Sr. Project Architect will be responsible for the tactical implementation of projects, achieving project objectives, financial profit, and establishing relationships that enable repeat projects...

  • Data Solutions Architect

    1 week ago

    Louisville, Kentucky, United States Farm Credit Mid-America Full time

    Farm Credit Mid-America is a financial services cooperative serving the financial needs of farmers and rural residents in several states.We are passionate about serving the needs of our rural communities and creating positive customer experiences.This role will work closely with our application delivery teams to design transactional data models, process and...

  • Data Ingestion Architect

    1 month ago

    Louisville, Kentucky, United States Compunnel Full time

    Job Opportunity:Compunnel is seeking a highly skilled Data Ingestion Architect to design and implement high-performance data ingestion pipelines from multiple sources using Azure Databricks.Key Responsibilities:• Develop scalable and reusable frameworks for ingesting varied data sets and formats.• Collaborate with cross-functional teams to ensure...

  • Data Architect

    4 days ago

    Louisville, Kentucky, United States Nuware Technologies Full time

    Job Title: Data Architect - Healthcare Domain ExpertAbout the Role:We are seeking an experienced Data Architect to join our team at Nuware Technologies. As a Data Architect, you will be responsible for designing and implementing scalable and efficient data architectures that support advanced analytics, reporting, and machine learning applications in the...

  • Senior Solutions Architect

    2 weeks ago

    Louisville, Kentucky, United States Humana Full time

    Job SummaryHumana, Inc. is seeking a highly skilled Senior Solutions Architect to lead the design and implementation of technical solutions that meet business needs.The ideal candidate will have a strong background in architecture, engineering, and information security, with experience in designing and building APIs, integrating multiple platforms, and...

  • Senior Project Architect Position

    4 days ago

    Louisville, Kentucky, United States Jobs for Humanity Full time

    Jobs for Humanity is collaborating with Upwardly Global and Theoris Group to build an inclusive employment ecosystem.We support individuals from diverse backgrounds.Job Title: Senior Project ArchitectJob Type: Direct PlacementIndustry: Design & ConstructionThe Senior Project Architect will be responsible for implementing projects, achieving objectives, and...

  • Lead Application Architect

    2 weeks ago

    Louisville, Kentucky, United States CenterWell Home Health Full time

    Lead Application ArchitectAt CenterWell Home Health, we're committed to putting health first for our customers and our team members. As a Lead Application Architect, you'll play a critical role in designing and developing IT applications architecture solutions to business problems in alignment with our enterprise architecture direction and standards.Key...

  • Senior Software Architect

    1 week ago

    Louisville, Kentucky, United States Wipro Full time

    About Wipro:We are a leading technology services and consulting company that helps clients transform their businesses through innovative solutions.Our comprehensive portfolio of services includes consulting, design, engineering, operations, and emerging technologies.We have over 250,000 dedicated employees serving clients across 66 countries.We deliver on...

  • Senior Project Architect

    1 month ago

    Louisville, Kentucky, United States Insight Global Full time

    About the RoleWe are seeking a highly skilled Project Architect to join our team at Insight Global. As a key member of our architectural design company, you will be responsible for providing design and technical development, project coordination, and quality control for all aspects of a project.Key ResponsibilitiesContribute to the preparation of quality...

  • Data Architect Lead

    1 month ago

    Louisville, Kentucky, United States CLOUDRAY Full time

    Job Title: Senior Technical Lead - DataJob Summary:Cloudray is seeking a highly skilled Senior Technical Lead - Data to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data architecture solutions that meet business requirements and technical constraints.Key Responsibilities:Design and...