Data Architect

5 days ago

Atlanta, United States Apollo ITS Full time
Job Title: Data Architect - Microsoft Fabric & Azure Databricks
Location: Atlanta, GA
Duration: 6 Months
Interview Type: Either Web Cam or In Person
Work Arrangement: Hybrid
Job Description:
The client is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.
Work Location & Attendance Requirements:
  • Must be physically located in Georgia
  • On-site: Tuesday to Thursday, per manager's discretion
  • Mandatory in-person meetings:
  • All Hands
  • Enterprise Applications
  • On-site meetings
  • DECAL All Staff
  • Work arrangements subject to management's decision
While the intent may be a long-term tenure, this position is subject to annual budget restrictions. The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1st.
Key Responsibilities:
Data Architecture:
  • Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.
  • Design data flows within the Microsoft Fabric environment.
  • Implement OneLake storage strategies.
  • Configure Synapse Analytics workspaces.
  • Establish Power BI integration patterns.
Integration Design:
  • Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
  • Design Delta Lake architecture for IES Gateway data.
  • Implement medallion architecture (Bronze/Silver/Gold layers).
  • Create real-time data ingestion patterns.
  • Establish data quality frameworks.
Lakehouse Architecture:
  • Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.
Data Governance:
  • Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.
Implement row-level security:
  • Configure Microsoft Purview policies.
  • Establish data masking for sensitive information.
  • Design audit logging mechanisms.
Pipeline Development:
  • Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.
Performance Optimization:
  • Implement performance tuning strategies for large-scale data processing and analytics workloads.
  • Optimize Spark configurations.
  • Implement partitioning strategies.
  • Design caching mechanisms.
  • Establish monitoring frameworks.
Security Framework:
  • Design and implement security patterns aligned with federal and state requirements for sensitive data handling.
Required Qualifications:
Education: Bachelor's degree in computer science or related field.
Experience:
  • 6+ years of experience in data architecture and engineering.
  • 2+ years hands-on experience with Azure Databricks and Spark.
  • Recent experience with Microsoft Fabric platform.
Technical Skills: Microsoft Fabric Expertise:
Data Integration: Combining and cleansing data from various sources.
Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
Data Visualization Techniques: Representing data graphically in impactful and informative ways.
Optimization and Security: Optimizing queries, improving performance, and securing data
Azure Databricks Experience:
Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools.
Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview Programming & Query Languages:
SQL: Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.
Python: Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark
Data Modeling:
  • Dimensional modeling
  • Real-time data modeling patterns
Soft Skills:
  • Strong analytical and problem-solving abilities
  • Excellent communication skills for technical and non-technical audiences
  • Experience working with government stakeholders
Preferred Experience:
  • Azure DevOps
  • Infrastructure as Code (Terraform)
  • CI/CD for data pipelines
  • Data mesh architecture
Certifications (preferred):
  • Microsoft Azure Data Engineer Associate
  • Databricks Data Engineer Professional
  • Microsoft Fabric certifications (as they become available)
Project-Specific Requirements:
  • Experience designing data architectures for grant management systems
  • Knowledge of federal/state compliance requirements for data handling
  • Understanding of financial data processing requirements
  • Experience with real-time integration patterns
This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for state-level grant management and reporting systems.
Required/Desired Skills:
  • 6+ years of experience in data architecture and engineering.
  • 2+ years hands-on experience with Azure Databricks and Spark.
  • Recent experience with Microsoft Fabric platform.
  • Azure Databricks Experience
  • Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.
  • Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark.

  • Data Architect

    5 days ago

    Atlanta, Georgia, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Data ArchitectJob Summary:Futran Tech Solutions Pvt. Ltd. is seeking a skilled Data Architect to design and implement effective database solutions and models to store and retrieve company data.Responsibilities:Design and implement database solutions and models to store and retrieve company data.Evaluate client operations, applications, and...

  • Data People Search | Analytics Architect | atlanta, ga

    2 weeks ago

    atlanta, United States Data People Search Full time

    Our client is a leading digital transformation consulting firm focused on Data, Cloud, and AI solutions. As a result of their continued success they are a proven Analytics Architect with significant experience with Adobe. LOCATION and WORKING ENVIRONMENT:Preference is Atlanta or Cleveland area with three (3) days in office.Remote candidates will be...

  • Data People Search | Analytics Architect | atlanta, ga

    2 weeks ago

    atlanta, United States Data People Search Full time

    Our client is a leading digital transformation consulting firm focused on Data, Cloud, and AI solutions. As a result of their continued success they are a proven Analytics Architect with significant experience with Adobe. LOCATION and WORKING ENVIRONMENT:Preference is Atlanta or Cleveland area with three (3) days in office.Remote candidates will be...

  • GCP data architect

    7 days ago

    Atlanta, United States Inficare Full time

    Job Description: Experience: XX-1X years of experience in data architecture, with extensive expertise in Google Cloud Platform (GCP). Strong experience with MongoDB. data setup work to support front end application. Must have Done some discovery assessment. Design, architect, and implement scalable data solutions on Google Cloud Platform (GCP) to meet the...

  • Data Architect

    3 days ago

    Atlanta, United States Charter Global Full time

    Title:: Data Architect (Microsoft Fabric & Azure Databricks) (752057)Location: 2 Martin Luther King Jr. Drive SE, 754 East Tower, Atlanta, Georgia 30334Hybrid-(Tuesday to Thursday)Primary Skills:6+ years of experience in data architecture and engineering. – Required – 6 Years2+ years hands-on experience with Azure Databricks and Spark. – Required - 2...

  • GCP Data Architect Position

    5 days ago

    Atlanta, Georgia, United States Inficare Full time

    Job Title: Data Architect on Google CloudJob Description:At Inficare, we're seeking a skilled Data Architect to design, architect, and implement scalable data solutions on Google Cloud Platform (GCP).Responsibilities:• Lead the integration of diverse data sources into a unified data platform• Design and implement data storage, processing, and analytics...

  • Data Engineering Architect

    5 days ago

    Atlanta, United States IDR Healthcare Full time

    IDR is seeking a Data Engineering Architect to join one of our top clients in Georgia. This role involves designing and implementing data architectures with Microsoft Fabric and Azure Databricks. If you are looking for an opportunity to join a large organization and work within a team-oriented culture, please apply today! Position Overview/Responsibilities...

  • Data Architect

    6 days ago

    Atlanta, United States Pyramid Consulting Full time

    Immediate need for a talented Data ArchitectThis is a 06+ months contract opportunity with long-term potential and is located in Atlanta, GA(Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID: 24-44404 Pay Range: $75 - $80/hour. Employee benefits include, but are not limited to, health insurance (medical,...

  • Data Solutions Architect

    7 days ago

    Atlanta, Georgia, United States Novalink Solutions LLC Full time

    Job OverviewNovalink Solutions LLC is seeking a seasoned Data Solutions Architect to design and implement scalable data architecture using Microsoft Fabric and Azure Databricks. This role will focus on creating seamless data flow between state-level systems and analytics platforms.Key Responsibilities:Design end-to-end data architecture leveraging Microsoft...

  • Financial Data Architect

    4 months ago

    Atlanta, United States Saxon Global Full time

    Qualifications • BS in Computer Science, Data, Analytics, Mathematics, or related degree from an accredited university required, MS + preferred • 5+ years of experience architecting, designing, and developing large scale data solutions utilizing a mixture of Big Data, Machine Learning, and Relational database platforms • Direct experience with AWS...

  • Anaplan Solution Architect

    4 days ago

    Atlanta, United States NTT DATA Full time

    Req ID: 274155 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking an Anaplan Solution Architect to remotely join our team in Atlanta, Georgia (US-GA), United States (US). This...

  • Anaplan Solution Architect

    2 weeks ago

    Atlanta, United States NTT DATA Full time

    Req ID:274155 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking anAnaplan Solution Architect to remotely join our team in Atlanta, Georgia (US-GA), United States (US). This is...

  • Anaplan Solution Architect

    7 days ago

    Atlanta, United States NTT DATA Full time

    Req ID:274155 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking anAnaplan Solution Architect to remotely join our team in Atlanta, Georgia (US-GA), United States (US). This is...

  • Data Solutions Architect

    1 day ago

    Atlanta, Georgia, United States DKMRBH Inc Full time

    Job OverviewDKMRBH Inc is seeking a highly skilled Data Solutions Architect to join our team. This role requires expertise in designing and implementing scalable data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems.Key Responsibilities:Design end-to-end data architecture leveraging Microsoft Fabric's...

  • Salesforce data cloud architect

    3 weeks ago

    atlanta, United States AdvantEdge Full time

    Position: Salesforce data cloud architectLocation: Atlanta, mason, RichmondDuration: 6 monthsJob type: contractWork type: onsitePay Rate: $65-65/hrJob Description:Overall Experience:10+ years in IT, with 7+ years in Salesforce architecture and development (Apex, Visualforce, Lightning).Data Cloud Projects: Experience architecting and designing 3-4 Data Cloud...

  • Salesforce data cloud architect

    3 weeks ago

    atlanta, United States AdvantEdge Full time

    Position: Salesforce data cloud architectLocation: Atlanta, mason, RichmondDuration: 6 monthsJob type: contractWork type: onsitePay Rate: $65-65/hrJob Description:Overall Experience:10+ years in IT, with 7+ years in Salesforce architecture and development (Apex, Visualforce, Lightning).Data Cloud Projects: Experience architecting and designing 3-4 Data Cloud...

  • Salesforce data cloud architect

    3 weeks ago

    Atlanta, United States AdvantEdge Full time

    Position: Salesforce data cloud architectLocation: Atlanta, mason, RichmondDuration: 6 monthsJob type: contractWork type: onsitePay Rate: $65-65/hrJob Description:Overall Experience:10+ years in IT, with 7+ years in Salesforce architecture and development (Apex, Visualforce, Lightning).Data Cloud Projects: Experience architecting and designing 3-4 Data Cloud...

  • Data Architect

    3 days ago

    Atlanta, United States ARK Solutions, Inc. Full time

    Data Architect (Microsoft Fabric & Azure Databricks)Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information.Seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with...

  • Data Architect for Enterprise Data Solutions

    1 day ago

    Atlanta, Georgia, United States nLeague Full time

    Job Title: Data Architect for Enterprise Data SolutionsAbout the Role:This is a critical position that requires an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data...

  • Supply Chain Architect Specialist

    5 days ago

    Atlanta, Georgia, United States NTT DATA Full time

    Job Description:We are seeking an experienced Supply Chain Architect Specialist to join our team in Atlanta, Georgia. This is a remote opportunity in the United States on the Integrated Demand and Supply Planning (IDSP) consulting team at NTT DATA.About the Role:Play a hands-on role in managing and delivering IDSP solutions to clientsConduct business and...