Databricks Architect

2 months ago


Jersey City, United States Inizio Partners Corp Full time
Job DescriptionJob Description

Role & Responsibilities Overview:

  • Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
  • Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
  • Continuously improve systems through performance enhancements and cost reductions in compute and storage
  • Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
  • Integrate data across different systems and platforms
  • Strong verbal and written communication skills to manage client discussions

Candidate Profile:

  • 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
  • Based out of US
  • Some experience in insurance domain/ data is must
  • Programming Languages SQL, Python
  • Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
    • Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands


  • Jersey City, United States BSL consulting LLC Full time

    **Job Role: Databricks Architect** **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** **Job Type: Full Time(Permanent)** **Skillsets/knowledge required**: - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud - Based out of US - Some experience in insurance domain/ data is must -...


  • Jersey City, United States Inizio Partners Full time

    About the job Databricks Architect Role & Responsibilities Overview: Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...

  • Databricks Architect

    3 weeks ago


    Jersey City, United States Zortech Solutions Full time

    Job DescriptionJob DescriptionRole: Databricks ArchitectLocation: NJ, New yorkExperience: 8 to 15Must Have:Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake StorageNice to Have: Airflow, Splunk, Kubernetes, PowerBI, Git, Azure Dev Ops

  • Databricks Architect

    3 weeks ago


    Jersey City, United States ishare Inc Full time

    Hiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...


  • Texas City, United States eTeam Full time

    Job Title: Databricks Architect (Unity Catalog (Databricks) Implementation Specialist Requirements: Proven experience in implementing and optimizing Unity Catalog using Databricks. Mandatory requirement.Strong knowledge of data cataloging, metadata management, and data governance principles.Proficiency in SQL, Python, and other relevant data...

  • Adoption Architect

    4 weeks ago


    Charles City, United States Databricks Full time

    The Product Adoption Architect for Unity Catalog will drive adoption performance and field effectiveness for Databricks Unity Catalog. They will work closely with cross-functional teams to lay out the requirements to execute on product priorities. They will also partner with the Product Program Manager to set the requirements and vision for scalable Plays...


  • Kansas City, United States ClifyX Full time

    RR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...


  • Charles City, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You...


  • Oklahoma City, United States Databricks Full time

    While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Staff/Sr. Staff Learning Architect at Databricks, you will apply your experience and expertise in technical enablement to architect Databricks learning offerings, including the ownership of the curriculum and certification roadmap,...

  • Databricks Engineer

    2 months ago


    Jersey City, United States CHUBB Full time

    Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...

  • Databricks Architect

    4 weeks ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Charles City, United States Databricks Full time

    Director of Field Engineering, Financial Services, US Location: NYC or East Coast We seek a seasoned leader for the Director of Field Engineering position within the Financial Services vertical. In this role, you will lead first-line Managers and teams of pre-sales Solutions Architects focusing on complex accounts across banking, capital markets,...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...


  • Jersey City, United States Edge Global Full time

    Job DescriptionJob DescriptionRole:- Sr. Solution Architect Data & Analytics / Must have Azure / Data Fabric / Data BricksLocation:- New Jersey, US(On Site)Job type: Full TimeRequired SkillsCloud Data Analytics Architect MedTech Key Responsibilities:Technical Advisory:Serve as a trusted advisor to clients, providing strategic guidance on leveraging data...

  • Technical Architect

    2 months ago


    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • Technical Architect

    2 months ago


    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market...