Current jobs related to Databricks Architect Sr - Taylor, Texas - United Global Technologies


  • Taylor, Texas, United States United Global Technologies Full time

    JOB DESCRIPTION Job Description Seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of our enterprise-wide data platform. The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business intelligence...


  • Taylor, Texas, United States Mindlance Full time

    PR:$81.25/hr Job Description *** is seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of our enterprise-wide data platform. The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business...


  • Taylor, Texas, United States Compunnel Full time

    About the Role: We are looking for an experienced Cloud Databricks Engineer Manager who can lead the design, implementation, and optimization of our enterprise-wide data platform.Responsibilities:This role involves designing and architecting comprehensive data solutions using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data...

  • Data Architect Lead

    7 days ago


    Taylor, Texas, United States Compunnel Full time

    Job Overview: We are seeking an experienced Data Architect Lead to lead the design, implementation, and optimization of our enterprise-wide data platform.Key Responsibilities:Design and architect comprehensive data solutions using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data services.Develop and implement data Lakehouse...


  • Taylor, Texas, United States Compunnel Full time

    Client is seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of our enterprise-wide data platform. The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business intelligence capabilities. The role...


  • Taylor, Texas, United States United Global Technologies Full time

    Join us at United Global Technologies as a highly skilled Data Engineering Director to drive the development of our enterprise-wide data platform.The successful candidate will be responsible for designing and implementing comprehensive data solutions using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data services. This includes...


  • Taylor, Texas, United States United Global Technologies Full time

    United Global Technologies seeks an accomplished Big Data Solutions Architect to drive the development of our enterprise-wide data platform.The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business intelligence capabilities. This includes...


  • Taylor, Texas, United States United Global Technologies Full time

    At United Global Technologies, we are seeking an experienced Data Engineer to lead the design, implementation, and optimization of our enterprise-wide data platform.The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business intelligence...


  • Taylor, Texas, United States Compunnel Full time

    About Us: Compunnel is seeking an Azure Data Platform Leader to lead the design, implementation, and optimization of our enterprise-wide data platform.Responsibilities:The ideal candidate will have expertise in designing and architecting comprehensive data solutions using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data...


  • Taylor, Texas, United States ERCOT Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States Ercot Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States Ercot Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States The Electric Reliability Council of Texas (ERCOT) Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States Ercot Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States The Electric Reliability Council of Texas (ERCOT) Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Texas, United States The Electric Reliability Council of Texas (ERCOT) Full time

    At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's energy challenges...


  • Taylor, Michigan, United States Electric Reliability Council of Texas Full time

    Job Description At ERCOT, our diverse and dynamic work environment provides a platform on which employees can work together to build the future of the Texas power grid and wholesale market utilizing the latest technologies and resources. We encourage you to join our talented, dedicated workforce to develop world-class solutions for today and tomorrow's...

Databricks Architect Sr

1 week ago


Taylor, Texas, United States United Global Technologies Full time
Job Description Job Description

JOB DESCRIPTION

Job Description

Seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of our enterprise-wide data platform. The ideal candidate will be responsible for creating a scalable, secure, and high-performance data ecosystem that enables advanced analytics, machine learning, and business intelligence capabilities. Aligns solutions following operating procedures and Architecture principles and works closely with internal technical teams. Performs proof of concepts to evaluate and prove out non-functional requirements and options. Uses toolsets that adhere to the frameworks of the technical stack complying with the organization's standards. Provides mentorship and technical guidance to transition work to other operational teams.

JOB DUTIES

Design and architect comprehensive data solutions using Azure Databricks, Azure Data Lake, Azure Event Hub, and related Azure data services

Develop and implement data Lakehouse architecture patterns that support both batch and real-time data processing

Create robust data ingestion pipelines leveraging Azure Databricks, Azure Data Factory, and other ETL technologies.

Establish best practices for data governance, security, and compliance across the data platform.

Design and implement advanced analytics and machine learning workflows using Databricks.

Develop performance optimization strategies for large-scale data processing.

Create and maintain infrastructure-as-code (IaC) templates for reproducible and scalable data platform deployments.

Provide architectural guidance and mentorship to data engineering and analytics teams.

Ensure alignment of data platform architecture with overall enterprise architecture and business objectives

Develops prototypes to prove out designs and delivery patterns.

Fosters collaboration with cross-functional teams including Development, Operations, Compliance, Security, etc.

Understands and applies principles, theories and concepts related to the profession and culture.

Provides mentoring and guidance to other team members.

ADDITIONAL JOB DUTIES

Conveys team goals effectively through strong written and verbal communication skills

Ability to execute end-to-end testing for various non-functional requirements

Has the ability to resolve design and development issues in creative and effective ways

Researches, evaluates, and incorporates new technology and tools to enhance the product development and platform operations

Gives advice and recommendations to management based on experience

Expands technical proficiency in key technical areas

EXPERIENCE

Requires minimum 5 years related work experience in excess of degree requirements

Desired Skills

Advanced proficiency with Azure Databricks and ability to provide best practices for a large organization.

Expert-level knowledge of:

Python

SQL

Spark (PySpark) and Delta Lake

Azure Data Lake Storage

Azure Databricks

Strong understanding of data Lakehouse architecture principles, and cloud-native data processing and analytics solutions

Proficiency in infrastructure-as-code tools (Terraform, Github Actions) and integration with Github Enterprise for Code and Infrastructure deployments.

Advanced knowledge of data modeling, performance tuning, and optimization techniques

Experience with securing Azure Databricks, especially for regulated industries.

Design and validate best practices for creating separate workspaces, catalogs, schemas, workflows.

Experience with design and implementation of ETL pipelines with Azure Databricks

Experience with design of Observability and Cost Management for the platform.

Experience with design and implementation of Batch and Real time streaming data pipelines.

Experience with design and implementation of MLOps patterns for machine learning use cases.

Experience with integration of Databricks with external Governance tools like Purview.

Experience migrating data and code to use the new architecture and operationalizing the platform.

Experience with design and implementation of DR strategy for Databricks across multiple regions.

EDUCATION

Bachelor's Degree: Computer Science or related field (Required)

or a combination of education and experience that provides equivalent knowledge to a major in such fields is required