data architect microsoft fabric/azure databricks

6 days ago

Atlanta, United States Randstad Full time

data architect microsoft fabric/azure databricks.

  • atlanta , georgia

  • posted 2 days ago

job details

summary

  • $67.15 - $72.15 per hour

  • contract

  • bachelor degree

  • category computer and mathematical occupations

  • reference1073672

job details

job summary:

Our client is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems.

  • This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform.

  • The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.

  • Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information.

location: Atlanta, Georgia

job type: Contract

salary: $67.15 - 72.15 per hour

work hours: 8am to 5pm

education: Bachelors

responsibilities:

Data Architecture:

  • · Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.

  • · Design data flows within the Microsoft Fabric environment.

  • · Implement OneLake storage strategies.

  • · Configure Synapse Analytics workspaces.

  • · Establish Power BI integration patterns.

Integration Design:

  • · Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.

  • · Design Delta Lake architecture for IES Gateway data.

  • · Implement medallion architecture (Bronze/Silver/Gold layers).

  • · Create real-time data ingestion patterns.

  • · Establish data quality frameworks.

Lakehouse Architecture:

  • · Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.

Data Governance:

  • · Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.

Implement row-level security.

  • · Configure Microsoft Purview policies.

  • · Establish data masking for sensitive information.

  • · Design audit logging mechanisms.

Pipeline Development:

  • · Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.

Performance Optimization:

  • · Implement performance tuning strategies for large-scale data processing and analytics workloads.

  • · Optimize Spark configurations.

  • · Implement partitioning strategies.

  • · Design caching mechanisms.

  • · Establish monitoring frameworks.

Security Framework:

  • Design and implement security patterns aligned with federal and state requirements for sensitive data handling.

Required Qualifications:

Education:

  • Bachelor's degree in computer science or related field.

Experience:

    • 6+ years of experience in data architecture and engineering.
    • 2+ years hands-on experience with Azure Databricks and Spark.
    • Recent experience with Microsoft Fabric platform.

Technical Skills:

Microsoft Fabric Expertise:

    • Data Integration: Combining and cleansing data from various sources.
    • Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
    • Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
    • Data Visualization Techniques: Representing data graphically in impactful and informative ways.
    • Optimization and Security: Optimizing queries, improving performance, and securing data

  • Azure Databricks Experience:

    • Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
    • Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
    • Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
    • Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
    • Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
    • Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
    • Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools.
    • Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview

Programming & Query Languages:

  • SQL: Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.

  • Python: Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark

Data Modeling:

    • Dimensional modeling
    • Real-time data modeling patterns

  • Soft Skills:

    • strong analytical and problem-solving abilities
    • Excellent communication skills for technical and non-technical audiences
    • Experience working with government stakeholders

Preferred Experience:

    • Azure DevOps
    • Infrastructure as Code (Terraform)
    • CI/CD for data pipelines
    • Data mesh architecture

  • Certifications (preferred):

    • Microsoft Azure Data Engineer Associate
    • Databricks Data Engineer Professional
    • Microsoft Fabric certifications (as they become available)

Project-Specific Requirements:

    • Experience designing data architectures for grant management systems
    • Knowledge of federal/state compliance requirements for data handling
    • Understanding of financial data processing requirements
    • Experience with real-time integration patterns

This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for state-level grant management and reporting systems.

qualifications:

  • Experience level: Experienced

  • Minimum 7 years of experience

  • Education: Bachelors

skills:

  • Data Warehouse

  • Azure Functions

  • SQL Server

  • data architectEqual Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).This posting is open for thirty (30) days.

  • Data Architect

    5 days ago

    Atlanta, United States VTal Technology Solutions Full time

    Seeking a Data Architect (Microsoft Fabric & Azure Databricks) for a contract role with a State Government organization in Atlanta, GA. The organization is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems. This role will focus on...

  • Data Architect

    5 days ago

    Atlanta, United States Universal Business Solutions Full time

    Data Architect (Microsoft Fabric & Azure Databricks) 6 Month Contract (W2) Atlanta, GA (Hybrid) Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information. Job Description: Data Architect - Microsoft Fabric & Azure Databricks Seeking an experienced Data Architect to...

  • Data Architect

    6 days ago

    Atlanta, United States Integrated Resources Full time

    Job Title: Data Architect (Microsoft Fabric & Azure Databricks) Location: Atlanta, GA (Hybrid- 3 Days Onsite per week) Duration: 12+ months (High Possibility of extension) Interview Process: Either Web Cam or In PersonPosition Summary: This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The...

  • Data Architect

    5 days ago

    Atlanta, United States Apollo ITS Full time

    Job Title: Data Architect - Microsoft Fabric & Azure Databricks Location: Atlanta, GA Duration: 6 Months Interview Type: Either Web Cam or In Person Work Arrangement: Hybrid Job Description: The client is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration...

  • Data Architect

    5 days ago

    Atlanta, United States PSR Associates Full time

    PSR Associates is a consulting and talent solutions firm that connects qualified IT professionals with great opportunities. Whether you're looking for a contract or permanent position, we can help you find the right fit for your skills and experience. We have a team of experienced recruiters who know the IT industry inside and out, and we work with you every...

  • DECAL Data Architect

    6 days ago

    Atlanta, United States Expedite Technology Solutions LLC Full time

    Short Description: Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information. Complete Description: Job Description: Data Architect - Microsoft Fabric & Azure Databricks The Department of Early Care & Learning (DECAL) is seeking an experienced Data Architect to...

  • DECAL Data Architect

    4 days ago

    Atlanta, United States GSK Solutions Full time

    Job Title: Data Architect - Microsoft Fabric & Azure Databricks (Hybrid) Location: Atlanta, GA Duration: 6+ Months Job Type: Corp-Corp / 1099 / Contract W2 Rate: $75/hr. on C2C Interview Type: Either Webcam or In Person Client: State of Georgia Job Description: Supervises the coordination of design and security for computer databases to store, track, and...

  • DECAL Data Architect

    3 days ago

    Atlanta, United States Nitelines USA, Inc Full time

    DECAL Data Architect (Microsoft Fabric & Azure Databricks) (752057)Pay rate : $72.15 hrTemp ( 6 months)Hybrid Job location :2 Martin Luther King Jr. Drive SE, 754 East Tower Atlanta, Georgia 30334Hours: 8 hours daily/5 days weeklySupervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical...

  • DECAL Data Architect

    7 days ago

    Atlanta, United States Nitelines USA, Inc Full time

    DECAL Data Architect (Microsoft Fabric & Azure Databricks) (752057) Pay rate : $72.15 hr Temp ( 6 months) Hybrid  Job location :2 Martin Luther King Jr. Drive SE, 754 East Tower Atlanta, Georgia 30334 Hours: 8 hours daily/5 days weekly Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of...

  • Data Architect

    6 days ago

    Atlanta, Georgia, United States Nitelines USA, Inc Full time

    Nitelines USA, Inc is seeking a highly skilled Data Architect to lead the design and implementation of scalable data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems.The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake...

  • Data Architect

    6 days ago

    Atlanta, Georgia, United States Software Technology Inc Full time

    Job SummaryWe are seeking a highly skilled Data Architect to join our team at Software Technology Inc. as a Data Architect - Microsoft Expert. This is an excellent opportunity for an experienced professional to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks.About the RoleThe ideal candidate will have deep expertise...

  • Data Architect

    3 days ago

    Atlanta, United States Charter Global Full time

    Title:: Data Architect (Microsoft Fabric & Azure Databricks) (752057)Location: 2 Martin Luther King Jr. Drive SE, 754 East Tower, Atlanta, Georgia 30334Hybrid-(Tuesday to Thursday)Primary Skills:6+ years of experience in data architecture and engineering. – Required – 6 Years2+ years hands-on experience with Azure Databricks and Spark. – Required - 2...

  • Data Solutions Architect

    1 day ago

    Atlanta, Georgia, United States DKMRBH Inc Full time

    Job OverviewDKMRBH Inc is seeking a highly skilled Data Solutions Architect to join our team. This role requires expertise in designing and implementing scalable data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems.Key Responsibilities:Design end-to-end data architecture leveraging Microsoft Fabric's...

  • Azure Databricks Architect

    2 months ago

    Atlanta, United States ApTask Full time

    About Client: The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong...

  • Data Engineering Architect

    5 days ago

    Atlanta, United States IDR Healthcare Full time

    IDR is seeking a Data Engineering Architect to join one of our top clients in Georgia. This role involves designing and implementing data architectures with Microsoft Fabric and Azure Databricks. If you are looking for an opportunity to join a large organization and work within a team-oriented culture, please apply today! Position Overview/Responsibilities...

  • Data Solutions Architect

    7 days ago

    Atlanta, Georgia, United States Novalink Solutions LLC Full time

    Job OverviewNovalink Solutions LLC is seeking a seasoned Data Solutions Architect to design and implement scalable data architecture using Microsoft Fabric and Azure Databricks. This role will focus on creating seamless data flow between state-level systems and analytics platforms.Key Responsibilities:Design end-to-end data architecture leveraging Microsoft...

  • Enterprise Data Solutions Architect

    5 days ago

    Atlanta, Georgia, United States Tech Brand Staffing LLC Full time

    Job OverviewTech Brand Staffing LLC is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform.Key ResponsibilitiesData Architecture: Design...

  • Data Architect for Enterprise Data Solutions

    1 day ago

    Atlanta, Georgia, United States nLeague Full time

    Job Title: Data Architect for Enterprise Data SolutionsAbout the Role:This is a critical position that requires an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data...

  • Data Architect

    3 days ago

    Atlanta, United States ARK Solutions, Inc. Full time

    Data Architect (Microsoft Fabric & Azure Databricks)Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information.Seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with...

  • Azure Databricks Solutions Architect

    5 days ago

    Atlanta, Georgia, United States Diverse Lynx Full time

    We are seeking a highly skilled Azure Databricks Solutions Architect to join our team at Diverse Lynx LLC. This role is responsible for designing and implementing scalable, secure, and efficient data processing solutions on Azure Databricks.Job Description:In this role, you will work closely with our cross-functional teams to propose and implement optimized...