Databricks Architect
2 months ago
Role & Responsibilities Overview:
- Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
- Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
- Continuously improve systems through performance enhancements and cost reductions in compute and storage
- Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
- Lead Data Engineering Projects to manage and implement data-driven communication systems
- Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
- Integrate data across different systems and platforms
- Strong verbal and written communication skills to manage client discussions
Candidate Profile:
- 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
- Based out of US
- Some experience in insurance domain/ data is must
- Programming Languages SQL, Python
- Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
- Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
- Project Management using Agile, Scrum
- B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
- Excellent communication & leadership skills, with the ability to lead and motivate team members
- Ability to work independently with some level of ambiguity and juggle multiple demands
-
Databricks Architect
3 days ago
Jersey City, United States BSL consulting LLC Full time**Job Role: Databricks Architect** **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** **Job Type: Full Time(Permanent)** **Skillsets/knowledge required**: - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud - Based out of US - Some experience in insurance domain/ data is must -...
-
Databricks Architect
1 week ago
Jersey City, United States Inizio Partners Full timeAbout the job Databricks Architect Role & Responsibilities Overview: Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Architect
3 weeks ago
Jersey City, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Databricks ArchitectLocation: NJ, New yorkExperience: 8 to 15Must Have:Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake StorageNice to Have: Airflow, Splunk, Kubernetes, PowerBI, Git, Azure Dev Ops
-
Databricks Architect
3 weeks ago
Jersey City, United States ishare Inc Full timeHiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...
-
Databricks Architect
1 week ago
Texas City, United States eTeam Full timeJob Title: Databricks Architect (Unity Catalog (Databricks) Implementation Specialist Requirements: Proven experience in implementing and optimizing Unity Catalog using Databricks. Mandatory requirement.Strong knowledge of data cataloging, metadata management, and data governance principles.Proficiency in SQL, Python, and other relevant data...
-
Adoption Architect
4 weeks ago
Charles City, United States Databricks Full timeThe Product Adoption Architect for Unity Catalog will drive adoption performance and field effectiveness for Databricks Unity Catalog. They will work closely with cross-functional teams to lay out the requirements to execute on product priorities. They will also partner with the Product Program Manager to set the requirements and vision for scalable Plays...
-
Azure Databricks Architect
3 weeks ago
Kansas City, United States ClifyX Full timeRR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...
-
Delivery Solutions Architect
2 weeks ago
Charles City, United States Databricks Full timeWhile candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You...
-
Technical Architect, Learning
3 days ago
Oklahoma City, United States Databricks Full timeWhile candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Staff/Sr. Staff Learning Architect at Databricks, you will apply your experience and expertise in technical enablement to architect Databricks learning offerings, including the ownership of the curriculum and certification roadmap,...
-
Databricks Engineer
2 months ago
Jersey City, United States CHUBB Full timeJob Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...
-
Databricks Architect
4 weeks ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Architect
3 days ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Director, Field Engineering, Financial Services
2 weeks ago
Charles City, United States Databricks Full timeDirector of Field Engineering, Financial Services, US Location: NYC or East Coast We seek a seasoned leader for the Director of Field Engineering position within the Financial Services vertical. In this role, you will lead first-line Managers and teams of pre-sales Solutions Architects focusing on complex accounts across banking, capital markets,...
-
Databricks Admininstrator
3 weeks ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Databricks Admininstrator
3 weeks ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Databricks Admininstrator
3 days ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Databricks Admininstrator
3 days ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Sr. Solution Architect
3 hours ago
Jersey City, United States Edge Global Full timeJob DescriptionJob DescriptionRole:- Sr. Solution Architect Data & Analytics / Must have Azure / Data Fabric / Data BricksLocation:- New Jersey, US(On Site)Job type: Full TimeRequired SkillsCloud Data Analytics Architect MedTech Key Responsibilities:Technical Advisory:Serve as a trusted advisor to clients, providing strategic guidance on leveraging data...
-
Technical Architect
2 months ago
Jersey City, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
Technical Architect
2 months ago
Jersey City, United States Tiger Analytics Full timeJob DescriptionJob DescriptionTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market...