Databricks Architect

3 days ago

Jersey City, NJ, United States Inizio Partners Full time

About the job Databricks Architect

  • Title: Databricks Architect
  • Key Requirements: Hands on experience in Databricks, SQL, PySpark. Must have Insurance domain experience.
  • Location: Jersey City, NJ
  • Job Type: Hybrid (2 days work from office)
  • Duration: 12+ Months
  • Start Date: Immediate
  • Number of roles: 1
Role & Responsibilities Overview:
  • Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
  • Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
  • Continuously improve systems through performance enhancements and cost reductions in compute and storage
  • Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
  • Integrate data across different systems and platforms
  • Strong verbal and written communication skills to manage client discussions
Candidate Profile:
  • 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
  • Experience in insurance domain/ data is must
  • Programming Languages SQL, Python
  • Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
  • Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands

  • Azure Databricks Architect

    2 weeks ago

    Jersey City, NJ, United States NR Consulting Full time

    Role: zure Databricks Architect Location: Raleigh, NC/Jersey City, NJ Type: Contract Duration: Long Term Mandatory Skill zure Data Architect Experience Synapse to Databricks implement Databricks Hand's on Experience DF & Synapse Data modeling, designing strategy & data architecture concepts Cloud technologies Experience Synapse...

  • Azure Databricks Architect

    1 week ago

    Jersey City, NJ, United States NR Consulting Full time

    Role: zure Databricks Architect Location: Raleigh, NC/Jersey City, NJ Type: Contract Duration: Long Term Mandatory Skill zure Data Architect Experience Synapse to Databricks implement Databricks Hand's on Experience DF & Synapse Data modeling, designing strategy & data architecture concepts Cloud technologies Experience Synapse...

  • AWS Java Databricks App Dev Lead

    4 days ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • AWS Java Databricks App Dev Lead

    5 days ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • AWS Java Databricks App Dev Lead

    2 days ago

    Jersey City, NJ, United States Infinity Outsourcing Full time

    About the job AWS Java Databricks App Dev Lead Job title: AWS Java Databricks App Dev Lead Number of Positions: 1 VP (Developer) & 1 SVP (Lead/ Architect) Location: 545 Washington Blvd, Jersey City, NJ, 07310, US (onsite)Base Pay/Salary: $90 on W2 OR $170K Per Annum (Innover's rate from clients is around $120 Per hour) Job Description: As an AWS Java...

  • Sr. Data Lead

    2 weeks ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Tittle: Sr. Data Lead /Architect Location: Jersey City, New Jersey Duration: 12+ Months Job Type: Long Term Contract Job Description: Overall 10+ Years of experience Looking for a seasoned Sr. Data Lead /Architect to guide a team of 6 Data Engineers in designing and implementing robust data architecture solutions. This role emphasizes building a common...

  • Sr. Data Lead

    1 week ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Tittle: Sr. Data Lead /Architect Location: Jersey City, New Jersey Duration: 12+ Months Job Type: Long Term Contract Job Description: Overall 10+ Years of experience Looking for a seasoned Sr. Data Lead /Architect to guide a team of 6 Data Engineers in designing and implementing robust data architecture solutions. This role emphasizes building a common...

  • Mulesoft Solution Architect-US

    1 week ago

    Jersey City, NJ, United States Zortech Solutions Full time

    Role: Mulesoft Solution Architect Location: US/Remote Duration: 6+ Months Job Description: The high-level skill set requirements: Technical Mulesoft AWS S3 Databricks Aurora Postgres Soft skills Good communication and presentation skills Able to facilitate meetings effectively with multiple groups Project Management Experience of Agile environment ...

  • Mulesoft Solution Architect-US

    4 days ago

    Jersey City, NJ, United States Zortech Solutions Full time

    Role: Mulesoft Solution Architect Location: US/Remote Duration: 6+ Months Job Description: The high-level skill set requirements: Technical Mulesoft AWS S3 Databricks Aurora Postgres Soft skills Good communication and presentation skills Able to facilitate meetings effectively with multiple groups Project Management Experience of Agile environment ...

  • Data Architect

    2 weeks ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Title: Data Architect Location: Jersey City, NJ (Onsite) Duration: FulltimeJob Description Must Have Technical/Functional Skills • Deep understanding of Financial Crime Risk Management (FCRM): AML, KYC, Sanctions Screening, Transaction Monitoring, Fraud Detection • Experience designing data solutions for risk scoring, suspicious activity reporting,...