Senior Data Solutions Architect

1 week ago

San Francisco, CA, United States Search Pros Inc Full time
Job Overview: Hybrid - 3 days onsite and 2 days remote
Case Management Platform Modernization (AI-Ready Focus)
Duration: Project until approx. June 2026

We are seeking a highly skilled and experienced Senior Data Solutions Architect & Lead Engineer to spearhead the modernization of our enterprise case management data platform. This pivotal role requires a hybrid professional capable of defining the strategic architecture while simultaneously leading the hands-on engineering effort to migrate legacy data systems to a cutting-edge, AI-ready Azure Data Fabric environment.
The ideal candidate will bridge the gap between enterprise data strategy and tactical implementation, ensuring data is modeled correctly, migrated efficiently from legacy sources (including COBOL and Oracle), and made available for high-impact analytical insights, operational reporting, and future Artificial Intelligence/Machine Learning (AI/ML) initiatives.
Key Responsibilities
  • Strategic Architecture Definition: Design the comprehensive, end-to-end data architecture for the new Azure Data Fabric platform (including Data Lakehouse, Data Factory, Synapse, and Power BI integration), ensuring alignment with business objectives for case management operations and future AI needs.
  • Advanced Data Modeling & Governance: Develop robust conceptual, logical, and physical data models for complex case management workflows. Establish and enforce comprehensive data governance, quality standards, and security protocols in alignment with regulatory requirements (e.g., GDPR, PII handling).
  • Legacy Migration Leadership & Execution: Own the strategy and execution of all data migration activities from existing legacy systems, including data extraction from active COBOL systems and Oracle databases. Define data mapping specifications, validate data integrity, and manage migration risks.
  • Hands-On Pipeline Engineering: Design, build, and optimize scalable ELT/ETL data pipelines using Azure Data Factory and PySpark in Databricks/Fabric notebooks to ingest, process, and structure raw case management data into clean, curated data assets (Medallion Architecture).
  • AI Readiness & Platform Optimization: Implement data storage solutions within Azure OneLake, optimize data structures for performance and cost, and ensure data accessibility and structure supports efficient consumption by data science and AI/ML workloads. Automate operational processes for monitoring, alerting, and CI/CD pipelines.
  • Technical Leadership & Collaboration: Act as the primary technical liaison among business stakeholders, infrastructure teams, and data consumers. Provide mentorship and establish best practices for data engineering teams.
  • Collaboration on experimental Generative AI Initiatives - Partner with cross functional teams to contribute technical expertise for experimental large language model projects, ensuring data readiness, scalable architecture, and alignment with modern AI engineering practices.
Required Skills & Qualifications
  • Experience: Minimum of 8+ years of progressive experience in data architecture, data engineering, or a related discipline, with demonstrated experience leading large-scale data modernization projects.
  • Legacy Systems Integration: Direct, hands-on experience extracting and interpreting data from legacy environments, specifically working with active COBOL systems and enterprise Oracle databases.
  • Azure Fabric Expertise: Deep, hands-on expertise with the full Microsoft Azure data stack, specifically Microsoft Fabric, Azure Data Lake Storage Gen2 (OneLake), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Databricks.
  • Technical Proficiency: Expert-level proficiency in SQL and advanced programming skills in Python or PySpark. Experience with data modeling tools and methodologies is essential.
  • AI/ML Familiarity: Understanding of data preparation requirements for analytical and machine learning use cases and experience enabling data science teams.
  • Generative AI Familiarity: Strong foundational understanding of generative AI concepts and modern AI engineering patterns, such as grounding, retrieval augmented generation (RAG), vector indexing, prompt engineering, and dependency aware copilot design. Experience building or supporting AI copilots or related intelligent automation systems is a plus.
  • Certifications (Preferred): Relevant Microsoft Azure Data certifications, such as the Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) or legacy Azure Data Engineer/Architect certifications.


bility to pass Background, Drug Screen and if applicable Medical Screenings (i.e. Vision, Hearing, or Physical) if Required by Client.
Medical, dental, vision, ancillary coverage and 401k benefits are available.

  • Senior Data Architect

    6 days ago

    San Francisco, CA, United States Autodesk Full time

    Job Requisition ID # 25WD91598 We are seeking a Senior Data Architect to lead data architecture and design across real-time streaming and enterprise batch systems . You will be the principal authority for data modeling, integration, and architecture patterns that enable Sales, Marketing, Customer Success, and Finance use cases. This role is more than...

  • Senior Data Architect

    2 weeks ago

    San Francisco, CA, United States Autodesk Full time

    Job Requisition ID # 25WD91598 We are seeking a Senior Data Architect to lead data architecture and design across real-time streaming and enterprise batch systems . You will be the principal authority for data modeling, integration, and architecture patterns that enable Sales, Marketing, Customer Success, and Finance use cases. This role is more than...

  • Senior Data Architect

    1 week ago

    San Francisco, CA, United States Autodesk Full time

    Job Requisition ID # 25WD91598 We are seeking a Senior Data Architect to lead data architecture and design across real-time streaming and enterprise batch systems . You will be the principal authority for data modeling, integration, and architecture patterns that enable Sales, Marketing, Customer Success, and Finance use cases. This role is more than...

  • Sr. Data Solutions Architect

    6 days ago

    San Francisco, CA, United States Akraya Full time

    Primary Skills: Databricks (Expert), Immuta (Advanced), Starburst (Advanced), AWS (Expert), Data Governance (Advanced) Contract Type: W2 Only Duration: 12+ Months Location: Remote (occasional visits to a Federal Reserve location) Pay Range: $100 – $110 per hour on W2 Job Summary: The Solution Architect will lead the design and implementation of a Common...

  • Sr. Data Solutions Architect

    2 weeks ago

    San Francisco, CA, United States Akraya Full time

    Primary Skills: Databricks (Expert), Immuta (Advanced), Starburst (Advanced), AWS (Expert), Data Governance (Advanced) Contract Type: W2 Only Duration: 12+ Months Location: Remote (occasional visits to a Federal Reserve location) Pay Range: $100 – $110 per hour on W2 Job Summary: The Solution Architect will lead the design and implementation of a Common...

  • Solution Architect

    2 weeks ago

    San Francisco, CA, United States Info Way Solutions Full time

    Role : Sr Solution Architect Sr Solution Architect - Customer Facing Applications Preferred Location : Onsite (SF Bay Area is preferred/Austin will work) REST APIs ,Spring Boot Technical Writing,Web/Application Server architectureAmazon Web Services (AWS) ,Design Thinking Enterprise Architecture ,Nice To HaveCommunication SkillsWritten Communication...

  • Solution Architect

    2 weeks ago

    San Francisco, CA, United States Info Way Solutions Full time

    Role : Sr Solution Architect Sr Solution Architect - Customer Facing Applications Preferred Location : Onsite (SF Bay Area is preferred/Austin will work) REST APIs ,Spring Boot Technical Writing,Web/Application Server architectureAmazon Web Services (AWS) ,Design Thinking Enterprise Architecture ,Nice To HaveCommunication SkillsWritten Communication...

  • Solution Architect

    2 weeks ago

    San Francisco, CA, United States TEPHRA Full time

    Description: Role: Solution Architect - Data - Consumer Business Group Location: San Francisco, CA (other US Locations can be considered - compensation mentioned is for Bay Area location) Responsibilities: -Build and optimize machine learning models using frameworks like TensorFlow, PyTorch, or Scikit-learn. -Architect and implement end-to-end MLOps...

  • Solution Architect

    2 weeks ago

    San Francisco, CA, United States TEPHRA Full time

    Description: Role: Solution Architect - Data - Consumer Business Group Location: San Francisco, CA (other US Locations can be considered - compensation mentioned is for Bay Area location) Responsibilities: -Build and optimize machine learning models using frameworks like TensorFlow, PyTorch, or Scikit-learn. -Architect and implement end-to-end MLOps...

  • Senior AWS Data Solutions Architect

    5 days ago

    San Mateo, CA, United States Fractal, Inc. Full time

    Fractal is a strategic AI partner to Fortune 500 companies, committed to empowering every human decision in the enterprise. We envision a world where individual choices, freedom, and diversity are paramount; an ecosystem that places human imagination at the core of every decision. We believe that a true Fractalite is someone who enhances imagination with...