Databricks Architect

7 days ago

Jersey City, NJ, United States Inizio Partners Full time

About the job Databricks Architect

  • Title: Databricks Architect
  • Key Requirements: Hands on experience in Databricks, SQL, PySpark. Must have Insurance domain experience.
  • Location: Jersey City, NJ
  • Job Type: Hybrid (2 days work from office)
  • Duration: 12+ Months
  • Start Date: Immediate
  • Number of roles: 1
Role & Responsibilities Overview:
  • Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
  • Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
  • Continuously improve systems through performance enhancements and cost reductions in compute and storage
  • Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
  • Integrate data across different systems and platforms
  • Strong verbal and written communication skills to manage client discussions
Candidate Profile:
  • 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
  • Experience in insurance domain/ data is must
  • Programming Languages SQL, Python
  • Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
  • Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands

  • AWS Java Databricks App Dev Lead

    1 week ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • AWS Java Databricks App Dev Lead

    2 weeks ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • AWS Java Databricks App Dev Lead

    2 weeks ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • Mulesoft Solution Architect-US

    1 week ago

    Jersey City, NJ, United States Zortech Solutions Full time

    Role: Mulesoft Solution Architect Location: US/Remote Duration: 6+ Months Job Description: The high-level skill set requirements: Technical Mulesoft AWS S3 Databricks Aurora Postgres Soft skills Good communication and presentation skills Able to facilitate meetings effectively with multiple groups Project Management Experience of Agile environment ...

  • Splunk Architect

    3 hours ago

    Jersey City, NJ, United States Purple Drive Full time

    Job Title: Splunk Architect Location: Onsite - New Jersey (NJ), Tampa (FL), Tempe (AZ) Experience Required: 10+ years Role Overview: The Sr Splunk Engineer/Architect will lead development and implementation of Splunk and Cribl solutions while providing architectural guidance for SIEM and SOAR initiatives. The role demands hands-on technical expertise...

  • Data Architect

    2 weeks ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Title: Data Architect Location: Jersey City, NJ (Onsite) Duration: FulltimeJob Description Must Have Technical/Functional Skills • Deep understanding of Financial Crime Risk Management (FCRM): AML, KYC, Sanctions Screening, Transaction Monitoring, Fraud Detection • Experience designing data solutions for risk scoring, suspicious activity reporting,...

  • Cloud Solution Architect

    1 week ago

    Jersey City, NJ, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • Cloud Solution Architect

    7 days ago

    Jersey City, NJ, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • Cloud Solution Architect

    2 weeks ago

    Jersey City, NJ, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • AI Solutions Architect

    2 weeks ago

    Jersey City, NJ, United States Nava Software Solutions Full time

    NAVA Software solutions is looking for a AI Solutions Architect Details: AI Solution Architect - Insurance Domain (Azure & AWS) Location: Remote Duration: 12 months Role Overview As an AI Solution Architect specializing in Azure and AWS, you will lead the design, development, and production deployment of large-scale AI/ML solutions tailored for the...