Databricks Architect
4 weeks ago
Role & Responsibilities Overview:
- Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
- Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
- Continuously improve systems through performance enhancements and cost reductions in compute and storage
- Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
- Lead Data Engineering Projects to manage and implement data-driven communication systems
- Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
- Integrate data across different systems and platforms
- Strong verbal and written communication skills to manage client discussions
Candidate Profile:
- 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
- Experience in insurance domain/ data is must
- Programming Languages SQL, Python
- Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
- Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
- Project Management using Agile, Scrum
- B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
- Excellent communication & leadership skills, with the ability to lead and motivate team members
- Ability to work independently with some level of ambiguity and juggle multiple demands
-
Databricks Architect
6 days ago
Jersey City, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Databricks ArchitectLocation: NJ, New yorkExperience: 8 to 15Must Have:Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake StorageNice to Have: Airflow, Splunk, Kubernetes, PowerBI, Git, Azure Dev Ops
-
Databricks Architect
2 days ago
Jersey City, United States ishare Inc Full timeHiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...
-
Adoption Architect
1 week ago
Charles City, United States Databricks Full timeThe Product Adoption Architect for Unity Catalog will drive adoption performance and field effectiveness for Databricks Unity Catalog. They will work closely with cross-functional teams to lay out the requirements to execute on product priorities. They will also partner with the Product Program Manager to set the requirements and vision for scalable Plays...
-
Azure Databricks Architect
1 day ago
Kansas City, United States ClifyX Full timeRR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...
-
Databricks Engineer
4 weeks ago
Jersey City, United States CHUBB Full timeJob Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...
-
Databricks Architect
1 month ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Admininstrator
3 days ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Databricks Admininstrator
3 days ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Technical Architect
3 weeks ago
Jersey City, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
Technical Architect
1 month ago
Jersey City, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
Technical Architect
5 days ago
Jersey City, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
Technical Architect
4 weeks ago
Jersey City, United States Tiger Analytics Full timeJob DescriptionJob DescriptionTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market...
-
Technical Architect
4 weeks ago
Jersey City, New Jersey, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
Azure Cloud Architect
1 month ago
New York City, United States Donato technologies Full timeJob Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications ·Hands-on experience with Azure Data & Analytics PaaS Services Azure Data...
-
Looker Administrator
2 days ago
Foster City, United States Denken Solutions Full timeCurrently, we are looking for talented resources for one of our listed clients. If interested please reply to me with your updated resume or feel free to reach out to me for more details at Title: Databricks Administrator Location: Foster City, California, 94404Duration: 6 months Job Description: We are looking for a Databricks administrator who will be...
-
Lead Data Engineer
4 weeks ago
Jersey City, United States CHUBB Full timeA Lead Data Engineer generally works on implementing complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into insights using multiple platforms. He or she should be able to decide on the needed hardware and software design needs and act according to the decisions. The big...
-
Senior Vice President, Domain Architect
1 month ago
Jersey City, NJ, United States BNY Mellon Full timeOverview Job Title: Growth Venture Bridge Alternatives Domain Architect, Senior Vice President Location: New York, NY Hybrid role: three days per week in the office Who we are: BNY Mellon has been a pioneer in the global capital markets for nearly 240 years, providing the world's leading institutions the tools, capabilities, and services to be...
-
Director Business Intelligence
7 days ago
Texas City, United States Saxon Global Full timeTitle: Director-Business Intelligence Location: 100% Remote Duration: Fulltime ESSENTIAL JOB FUNCTIONS: To perform this job successfully, an individual must be able to satisfactorily perform each essential function listed below. Design, develop, implement, and support complex BI applications of strategic or functional importance including:...
-
Senior Software QA Engineer
2 days ago
Garden City, United States QuEST Global Full timeQuEST Global Senior Software QA Engineer Boise , Idaho Apply Now Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a...
-
Aumni - Site Reliability Engineer III - MLOPS
4 weeks ago
Salt Lake City, United States JPMorgan Chase & Co. Full timeThere’s nothing more exciting than being at the center of a rapidly growing field in technology and applying your skillsets to drive innovation and modernize the world's most complex and mission-critical systems. As a Site Reliability Engineer III at JPMorgan Chase within the Digital Private Markets /Aumni (A JP Morgan Chase Company), you will solve...