Data Architect

2 weeks ago

Atlanta, GA, United States InterSources Full time
Job Title: Data Architect (Microsoft Fabric & Azure Databricks)
Address: Atlanta, Georgia 30334
6 Months Contract Position

Job Description:
The Client is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.

Work Location & Attendance Requirements:
  • Must be physically located in Georgia
  • On-site: Tuesday to Thursday, per manager's discretion
  • Mandatory in-person meetings:
  • Work arrangements subject to management's decision
  • While the intent may be a long-term tenure, this position is subject to annual budget restrictions. The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1st.
Key Responsibilities:
Data Architecture:
  • Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.
  • Design data flows within the Microsoft Fabric environment.
  • Implement OneLake storage strategies.
  • Configure Synapse Analytics workspaces.
  • Establish Power BI integration patterns.
I ntegration Design:
  • rchitect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
  • Design Delta Lake architecture for IES Gateway data.
  • Implement medallion architecture (Bronze/Silver/Gold layers).
  • Create real-time data ingestion patterns.
  • Establish data quality frameworks.
Lakehouse Architecture:
  • Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.
Data Governance:
  • Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.
Implement row-level security:
  • Configure Microsoft Purview policies.
  • Establish data masking for sensitive information.
  • Design audit logging mechanisms.
Pipeline Development:
  • Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.
Performance Optimization :
  • Implement performance tuning strategies for large-scale data processing and analytics workloads.
  • Optimize Spark configurations.
  • Implement partitioning strategies.
  • Design caching mechanisms.
  • Establish monitoring frameworks.
Security Framework:
  • Design and implement security patterns aligned with federal and state requirements for sensitive data handling.

Required Qualifications:
  • Education: Bachelor's degree in computer science or related field.
  • Experience:
6+ years of experience in data architecture and engineering.
2+ years hands-on experience with Azure Databricks and Spark.
Recent experience with Microsoft Fabric platform.

Technical Skills:
Microsoft Fabric Expertise:
  • Data Integration: Combining and cleansing data from various sources.
  • Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
  • nalytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
  • Data Visualization Techniques: Representing data graphically in impactful and informative ways.
  • Optimization and Security: Optimizing queries, improving performance, and securing data
Azure Databricks Experience: Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools.
Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview
Programming & Query Languages:
SQL: Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.
Python: Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark
Data Modeling:
Dimensional modeling
Real-time data modeling patterns
Soft Skills:
Strong analytical and problem-solving abilities
Excellent communication skills for technical and non-technical audiences
Experience working with government stakeholders
Preferred Experience:
  • zure DevOps
  • Infrastructure as Code (Terraform)
  • CI/CD for data pipelines
  • Data mesh architecture
Certifications (preferred):
  • Microsoft Azure Data Engineer Associate
  • Databricks Data Engineer Professional
  • Microsoft Fabric certifications (as they become available)
Project-Specific Requirements:
  • Experience designing data architectures for grant management systems
  • Knowledge of federal/state compliance requirements for data handling
  • Understanding of financial data processing requirements
  • Experience with real-time integration patterns
  • This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for state-level grant management and reporting systems.


Skill Matrix:
Skill Required No. of Years Actual Years of Experience 6+ years of experience in data architecture and engineering. 6 Years 2+ years hands-on experience with Azure Databricks and Spark. 2 Years Recent experience with Microsoft Fabric platform. 2 Years zure Databricks Experience 2 Years Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12. 3 Years Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark 3 Years
About Us:
InterSources Inc. is a Small, Woman, and Minority-Owned Business Enterprise, ISO/IEC 27001, SOC 2 Type 2 certified company with massive 18+ years of diversified experience in providing IT Consulting Services, Artificial Intelligence, Data Analysis, Application Development, Cloud Services, Cybersecurity, Digital Marketing, ERP Management, Custom Software Development, Web Development, UI/ UX Design, System Integration, QA Support etc. We make reasonable accommodations for clients and employees, and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud and Oracle partner company.

  • Data Architect

    1 week ago

    Atlanta, GA, United States Northern Base Full time

    Job Description: Position Overview: We are seeking a highly skilled and motivated Data Architect to join our Business Intelligence (BI) team. As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the data infrastructure necessary to support our BI initiatives. Your expertise in data modeling and Extract, Transform,...

  • Data Architect

    1 day ago

    Atlanta, GA, United States Northern Base Full time

    Job Description: Position Overview: We are seeking a highly skilled and motivated Data Architect to join our Business Intelligence (BI) team. As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the data infrastructure necessary to support our BI initiatives. Your expertise in data modeling and Extract, Transform,...

  • Data Architect

    5 days ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA.Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible for...

  • Data Architect

    1 week ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA. Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible...

  • Data Architect

    3 days ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA.Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible for...

  • Data Architect

    2 weeks ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA. Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible...

  • Data Architect

    7 days ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA. Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible...

  • Data Architect

    7 days ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA. Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible...

  • Data Architect

    1 day ago

    Atlanta, GA, United States IntelliTrans Full time

    IntelliTrans, (ITL), a subsidiary of Roper Technologies, Inc. (NYSE: ROP) is seeking a Data Architect to join our team hybrid in Atlanta, GA.Job Summary: The Data Architect will lead the strategic design and implementation of data architecture for IntelliTrans' Transportation Management Systems (TMS) platform and products. This senior role is responsible for...

  • Salesforce Data Cloud Architect

    7 days ago

    Atlanta, GA, United States HCL Global Systems Full time

    OVERALL EXPERIENCE • SFDC Technical Architect: 10+ years of IT industry total experience, with Minimum 7 years specifically in hands-on Salesforce.com architecting/solutioning, and development (coding) in Apex and Visualforce and Lightning, and Experience in Data Modeling specific to Salesforce • Must have extensive experience in Data Cloud and have...