Databricks Architect

4 weeks ago


Jersey City, United States Inizio Partners Full time

About the job Databricks Architect

Role & Responsibilities Overview:

Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoringContinuously improve systems through performance enhancements and cost reductions in compute and storageData Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIsLead Data Engineering Projects to manage and implement data-driven communication systemsExperienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalationsIntegrate data across different systems and platformsStrong verbal and written communication skills to manage client discussionsCandidate Profile:

8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloudBased out of USSome experience in insurance domain/ data is mustProgramming Languages SQL, PythonTechnologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).

Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps

Project Management using Agile, ScrumB.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.Excellent communication & leadership skills, with the ability to lead and motivate team membersAbility to work independently with some level of ambiguity and juggle multiple demands

#J-18808-Ljbffr


  • Databricks Architect

    3 weeks ago


    Jersey City, United States BSL consulting LLC Full time

    **Job Role: Databricks Architect** **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** **Job Type: Full Time(Permanent)** **Skillsets/knowledge required**: - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud - Based out of US - Some experience in insurance domain/ data is must -...

  • Databricks Architect

    4 weeks ago


    Texas City, United States eTeam Full time

    Job Title: Databricks Architect (Unity Catalog (Databricks) Implementation Specialist Requirements: Proven experience in implementing and optimizing Unity Catalog using Databricks. Mandatory requirement.Strong knowledge of data cataloging, metadata management, and data governance principles.Proficiency in SQL, Python, and other relevant data...


  • Charles City, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You...


  • Oklahoma City, United States Databricks Full time

    While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Staff/Sr. Staff Learning Architect at Databricks, you will apply your experience and expertise in technical enablement to architect Databricks learning offerings, including the ownership of the curriculum and certification roadmap,...

  • Databricks Engineer

    2 months ago


    Jersey City, United States CHUBB Full time

    Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...

  • Databricks Architect

    2 months ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...

  • Databricks Architect

    1 month ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...

  • Databricks Architect

    3 weeks ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Kansas City, United States Sogeti Full time

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings...


  • Charles City, United States Databricks Full time

    Director of Field Engineering, Financial Services, US Location: NYC or East Coast We seek a seasoned leader for the Director of Field Engineering position within the Financial Services vertical. In this role, you will lead first-line Managers and teams of pre-sales Solutions Architects focusing on complex accounts across banking, capital markets,...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...

  • Azure Data Architect

    2 weeks ago


    Jersey City, United States Artmac Soft LLC Full time

    Job DescriptionJob DescriptionWho we areArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.Job Description: Job Title : Azure Data ArchitectJob Type : C2C/1099Experience : 15-18 Years Location : New JerseyWe are looking for an Azure Data Architect who will be...


  • Jersey City, United States Edge Global Full time

    Job DescriptionJob DescriptionRole:- Sr. Solution Architect Data & Analytics / Must have Azure / Data Fabric / Data BricksLocation:- New Jersey, US(On Site)Job type: Full TimeRequired SkillsCloud Data Analytics Architect MedTech Key Responsibilities:Technical Advisory:Serve as a trusted advisor to clients, providing strategic guidance on leveraging data...


  • Jersey City, United States CareerBuilder Full time

    MS Azure platform, Azure Databricks, Oracle MDM, Business Process-Medical Devices, SQL Server MS Azure platform, Data Bricks Solution Architect Keywords MS Azure platform, Data Bricks Roles and Responsibilities Solutions Architect for a Supplier Master Data Management system built on the APEX platform. The candidate must have At least 10+ years of experience...


  • Jersey City, United States PSRTEK Full time

    Job DescriptionJob DescriptionRole: Sr. Solution Architect Cloud Data & Analytics- Must have Azure / Data Fabric / Data BricksLocation: New Jersey- OnsiteMode of Hire: Full TimeJob Description: Cloud Data Analytics Architect MedTech As the Cloud Data Analytics Architect, you will play a pivotal role in leading our data analytics initiatives, providing...


  • Jersey City, United States PSRTEK Full time

    Job DescriptionJob DescriptionRole: Sr. Solution Architect Cloud Data & Analytics- Must have Azure / Data Fabric / Data BricksLocation: New Jersey- OnsiteMode of Hire: Full TimeJob Description: Cloud Data Analytics Architect MedTech As the Cloud Data Analytics Architect, you will play a pivotal role in leading our data analytics initiatives, providing...


  • Texas City, United States CareerBuilder Full time

    An application architect with 13+ years of hands on experience and can solve complex problems. The resource shall have working knowledge of untangling legacy architecture into modernized architecture. Primary skillset is Java, Azure & Databricks. OK to look at equivalent of Databricks experience as well. Retail experience is a must since candidates without...