Databricks Architect

4 days ago

Remote, Oregon, United States Hudson Healthcare Solutions Full time $160,000 - $320,000 per year

Key Responsibilities

  • Lead the identification and categorization of existing Hadoop workloads (ETL, batch, streaming) and data sources for migration to Databricks.
  • Design and implement scalable, repeatable migration use cases, focusing on MVP (Minimum Viable Product) approaches to accelerate value delivery.
  • Provision and architect Databricks environments, including sandbox workspaces with Lakehouse architecture and federation capabilities.
  • Enable seamless connectivity to external data sources (e.g., Hive) and oversee pilot migrations using tools such as Databricks Migration Accelerator or third-party partner solutions.
  • Validate migrated workloads for performance, cost efficiency, and data integrity, leveraging features like Z-ordering, Liquid Clustering, Lakehouse AI monitoring, and Serverless warehouse capabilities.
  • Monitor query performance, storage efficiency, and pipeline health using advanced Databricks features and best practices.
  • Collaborate cross-functionally with data engineering, analytics, and governance teams to validate outcomes and incorporate feedback.
  • Document learnings, blockers, and feature gaps to inform broader rollout and continuous improvement efforts.
  • Define and track success metrics such as migration time, query latency, cost savings, and feature adoption.
  • Develop a phased roadmap for full-scale migration, advanced feature adoption, and future platform optimizations.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 10+ years of experience in data architecture, with significant hands-on experience in Hadoop and Databricks environments.
  • Proven expertise in cloud data platforms (Azure), data engineering, and ETL processes.
  • Strong understanding of Lakehouse architecture, data federation, and modern data governance frameworks (e.g., Unity Catalog).
  • Experience leading large-scale migration projects, including MVP definition and iterative delivery.
  • Advanced proficiency with Databricks features such as Delta Lake, Liquid Clustering, AI monitoring, and serverless compute.
  • Excellent communication, leadership, and stakeholder management skills.
  • Ability to mentor and guide cross-functional teams in adopting best practices and innovative data solutions.

Preferred Skills

  • Experience with Databricks Migration Accelerator or similar migration tools.
  • Hands-on expertise in testing advanced features (dynamic clustering, Lakehouse Federation, Unity Catalog).
  • Knowledge of data security, access controls, and compliance in cloud environments.
  • Experience generating synthetic data and ensuring data governance in migration scenarios

Job Type: Contract

Pay: $ $80.00 per hour

Expected hours: 40 per week

Benefits:

  • 401(k)
  • Dental insurance
  • Flexible schedule
  • Paid time off
  • Tuition reimbursement
  • Vision insurance

Work Location: Remote

  • Databricks Data Architect

    4 days ago

    Remote, Oregon, United States DataLuminate Full time $126,000 - $175,000 per year

    QualificationsUS Citizenship Required•Experience implementing data solutions on the Databricks Data Intelligence platform, to include Delta Lakes•Experience with SQL and Python•Experience leading workstreams or small teams, within complex technology engagements with resources in multiple locationsMicrosoft Certificates highly preferredStrong knowledge...

  • Azure Databricks Engineer

    2 days ago

    Remote, Oregon, United States NuAxis Innovations Full time

    We are a federal IT company on a mission to make customer experience (CX) the center of every government solution.Technology is our Passion. People are our Purpose.We know tech, but we love people. NuAxis is home to thinkers and feelers, engineers and artists. We work hard and support each other along the way. Teamwork is more than just a buzzword for us,...

  • Resident Solutions Architect

    4 days ago

    Remote, Oregon, United States OST Inc Full time

    Seeking a Resident Solutions Architect specializing in data and AI solutions.This remote U.S.-based role requires a candidate with strong expertise in modern data architectures, AI/ML frameworks, and governance to design and implement scalable, secure, and innovative solutions.The ideal candidate will be a trusted technical advisor capable of translating...

  • SAP BDC/Datasphere, Databricks Engineer

    2 weeks ago

    Remote, Oregon, United States The Cigna Group Full time $135,000 - $200,000 per year

    Position Overview:CuraScript SD a wholesale pharmaceutical distributor that provides customized business solutions and access to specialty drugs to community physicians, specialty pharmacies, and health systems; it is a wholly owned subsidiary of Express Scripts, Inc. – a Cigna Company.We are seeking an experienced and highly motivated Databricks SME with...

  • Solution Architect, AI

    5 hours ago

    Remote, Oregon, United States Brown & Brown Insurance Full time $130,000 - $150,000 per year

    Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers.Brown & Brown is Seeking a Solutions Architect, AI - Data to join our growing team.The Solution Architect – AI / Data is responsible for designing and delivering enterprise-grade architectures that integrate artificial...

  • AI Strategy Architect

    4 days ago

    Remote, Oregon, United States Altak Group Full time $150,000 - $250,000 per year

    Job Title: AI Strategy ArchitectWe're looking for an AI Architect to lead the design and delivery of end-to-end AI solutions—ranging from problem framing and model selection (LLMs and classical ML) to environment architecture, security, and cost optimization. In this role, you'll work closely with a Solution Architect (focused on broader system and...

  • AI Solutions Architect

    4 days ago

    Remote, Oregon, United States Altak Group Full time $140,000 - $250,000 per year

    Job Title: AI ArchitectWe're looking for an AI Architect to lead the design and delivery of end-to-end AI solutions—ranging from problem framing and model selection (LLMs and classical ML) to environment architecture, security, and cost optimization. In this role, you'll work closely with a Solution Architect (focused on broader system and enterprise...

  • Senior AI Architect

    4 days ago

    Remote, Oregon, United States Altak Group Full time $120,000 - $250,000 per year

    Role summaryWe're hiring a AI Architect to design and guide end-to-end AI solutions—from problem framing and model selection (LLMs/classical ML) to environment architecture, security, and cost performance. You'll collaborate closely with a Solution Architect (overall system design/enterprise fit), while you own the AI architecture: which models, which...

  • Azure Data Engineer

    4 days ago

    Remote, Oregon, United States Justhire Technology Full time $104,000 - $162,486 per year

    Job Title: Mid Level Azure Data EngineerLocation: RemoteType: Full TimeExperience Level: 3 5 years (mid-level) in data engineering or related roleReports to: Data Engineering Lead / Data Platform ManagerAbout UsWe are a dynamic enterprise moving to cloud-native data platforms. We partner with business units globally and need strong data engineering talent to...

  • Vice President of Engineering – Cloud, Data, and AI/ML Solutions

    4 days ago

    Remote, Oregon, United States Slingshot Aerospace Full time $120,000 - $250,000 per year

    Position SummaryWe are seeking a visionary and hands-on Vice President of Engineering to lead the design, development, and delivery of enterprise-scale, cloud-native, data-intensive platforms. This role requires a dynamic leader with a proven track record in cloud engineering, big data, and modern software development practices, with a strong emphasis on...