Databricks Architect

4 weeks ago


Jersey City, United States Inizio Partners Full time

Role & Responsibilities Overview:

  • Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
  • Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
  • Continuously improve systems through performance enhancements and cost reductions in compute and storage
  • Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
  • Integrate data across different systems and platforms
  • Strong verbal and written communication skills to manage client discussions


Candidate Profile:

  • 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
  • Experience in insurance domain/ data is must
  • Programming Languages SQL, Python
  • Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
  • Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands



  • Jersey City, United States Zortech Solutions Full time

    Job DescriptionJob DescriptionRole: Databricks ArchitectLocation: NJ, New yorkExperience: 8 to 15Must Have:Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake StorageNice to Have: Airflow, Splunk, Kubernetes, PowerBI, Git, Azure Dev Ops


  • Jersey City, United States ishare Inc Full time

    Hiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...

  • Adoption Architect

    1 week ago


    Charles City, United States Databricks Full time

    The Product Adoption Architect for Unity Catalog will drive adoption performance and field effectiveness for Databricks Unity Catalog. They will work closely with cross-functional teams to lay out the requirements to execute on product priorities. They will also partner with the Product Program Manager to set the requirements and vision for scalable Plays...


  • Kansas City, United States ClifyX Full time

    RR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...

  • Databricks Engineer

    4 weeks ago


    Jersey City, United States CHUBB Full time

    Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...

  • Databricks Architect

    1 month ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...

  • Technical Architect

    3 weeks ago


    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • Technical Architect

    1 month ago


    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • Technical Architect

    5 days ago


    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • Technical Architect

    4 weeks ago


    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market...

  • Technical Architect

    4 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • Azure Cloud Architect

    1 month ago


    New York City, United States Donato technologies Full time

    Job Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications ·Hands-on experience with Azure Data & Analytics PaaS Services Azure Data...


  • Foster City, United States Denken Solutions Full time

    Currently, we are looking for talented resources for one of our listed clients. If interested please reply to me with your updated resume or feel free to reach out to me for more details at Title: Databricks Administrator Location: Foster City, California, 94404Duration: 6 months Job Description: We are looking for a Databricks administrator who will be...

  • Lead Data Engineer

    4 weeks ago


    Jersey City, United States CHUBB Full time

    A Lead Data Engineer generally works on implementing complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into insights using multiple platforms. He or she should be able to decide on the needed hardware and software design needs and act according to the decisions. The big...


  • Jersey City, NJ, United States BNY Mellon Full time

    Overview Job Title: Growth Venture Bridge Alternatives Domain Architect, Senior Vice President Location: New York, NY Hybrid role: three days per week in the office Who we are: BNY Mellon has been a pioneer in the global capital markets for nearly 240 years, providing the world's leading institutions the tools, capabilities, and services to be...


  • Texas City, United States Saxon Global Full time

    Title: Director-Business Intelligence Location: 100% Remote Duration: Fulltime ESSENTIAL JOB FUNCTIONS: To perform this job successfully, an individual must be able to satisfactorily perform each essential function listed below. Design, develop, implement, and support complex BI applications of strategic or functional importance including:...


  • Garden City, United States QuEST Global Full time

    QuEST Global Senior Software QA Engineer Boise , Idaho Apply Now Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a...


  • Salt Lake City, United States JPMorgan Chase & Co. Full time

    There’s nothing more exciting than being at the center of a rapidly growing field in technology and applying your skillsets to drive innovation and modernize the world's most complex and mission-critical systems. As a Site Reliability Engineer III at JPMorgan Chase within the Digital Private Markets /Aumni (A JP Morgan Chase Company), you will solve...