Databricks Architect
1 month ago
Role & Responsibilities Overview:
- Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
- Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
- Continuously improve systems through performance enhancements and cost reductions in compute and storage
- Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
- Lead Data Engineering Projects to manage and implement data-driven communication systems
- Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
- Integrate data across different systems and platforms
- Strong verbal and written communication skills to manage client discussions
Candidate Profile:
- 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
- Based out of US
- Some experience in insurance domain/ data is must
- Programming Languages SQL, Python
- Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
- Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
- Project Management using Agile, Scrum
- B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
- Excellent communication & leadership skills, with the ability to lead and motivate team members
- Ability to work independently with some level of ambiguity and juggle multiple demands
-
Databricks Architect
2 weeks ago
Jersey City, United States BSL consulting LLC Full time**Job Role: Databricks Architect** **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** **Job Type: Full Time(Permanent)** **Skillsets/knowledge required**: - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud - Based out of US - Some experience in insurance domain/ data is must -...
-
Databricks Architect
3 weeks ago
Jersey City, United States Inizio Partners Full timeAbout the job Databricks Architect Role & Responsibilities Overview: Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Architect
1 month ago
Jersey City, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Databricks ArchitectLocation: NJ, New yorkExperience: 8 to 15Must Have:Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake StorageNice to Have: Airflow, Splunk, Kubernetes, PowerBI, Git, Azure Dev Ops
-
Databricks Architect
4 weeks ago
Jersey City, United States ishare Inc Full timeHiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...
-
Adoption Architect
1 month ago
Charles City, United States Databricks Full timeThe Product Adoption Architect for Unity Catalog will drive adoption performance and field effectiveness for Databricks Unity Catalog. They will work closely with cross-functional teams to lay out the requirements to execute on product priorities. They will also partner with the Product Program Manager to set the requirements and vision for scalable Plays...
-
Databricks Architect
3 weeks ago
Texas City, United States eTeam Full timeJob Title: Databricks Architect (Unity Catalog (Databricks) Implementation Specialist Requirements: Proven experience in implementing and optimizing Unity Catalog using Databricks. Mandatory requirement.Strong knowledge of data cataloging, metadata management, and data governance principles.Proficiency in SQL, Python, and other relevant data...
-
Delivery Solutions Architect
3 weeks ago
Charles City, United States Databricks Full timeWhile candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You...
-
Azure Databricks Architect
4 weeks ago
Kansas City, United States ClifyX Full timeRR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...
-
Technical Architect, Learning
2 weeks ago
Oklahoma City, United States Databricks Full timeWhile candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Staff/Sr. Staff Learning Architect at Databricks, you will apply your experience and expertise in technical enablement to architect Databricks learning offerings, including the ownership of the curriculum and certification roadmap,...
-
Databricks Engineer
2 months ago
Jersey City, United States CHUBB Full timeJob Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...
-
Databricks Architect
2 months ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Architect
2 weeks ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Director, Field Engineering, Financial Services
3 weeks ago
Charles City, United States Databricks Full timeDirector of Field Engineering, Financial Services, US Location: NYC or East Coast We seek a seasoned leader for the Director of Field Engineering position within the Financial Services vertical. In this role, you will lead first-line Managers and teams of pre-sales Solutions Architects focusing on complex accounts across banking, capital markets,...
-
Databricks Admininstrator
4 weeks ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Databricks Admininstrator
4 weeks ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Databricks Admininstrator
2 weeks ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Databricks Admininstrator
2 weeks ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Azure Data Architect
3 days ago
Jersey City, United States Artmac Soft LLC Full timeJob DescriptionJob DescriptionWho we areArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.Job Description: Job Title : Azure Data ArchitectJob Type : C2C/1099Experience : 15-18 Years Location : New JerseyWe are looking for an Azure Data Architect who will be...
-
Sr. Solution Architect
1 week ago
Jersey City, United States Edge Global Full timeJob DescriptionJob DescriptionRole:- Sr. Solution Architect Data & Analytics / Must have Azure / Data Fabric / Data BricksLocation:- New Jersey, US(On Site)Job type: Full TimeRequired SkillsCloud Data Analytics Architect MedTech Key Responsibilities:Technical Advisory:Serve as a trusted advisor to clients, providing strategic guidance on leveraging data...
-
Azure Solution Architect
3 days ago
Jersey City, United States CareerBuilder Full timeMS Azure platform, Azure Databricks, Oracle MDM, Business Process-Medical Devices, SQL Server MS Azure platform, Data Bricks Solution Architect Keywords MS Azure platform, Data Bricks Roles and Responsibilities Solutions Architect for a Supplier Master Data Management system built on the APEX platform. The candidate must have At least 10+ years of experience...