Databricks Engineer

4 weeks ago


Jersey City, United States CHUBB Full time

Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.

Key Responsibilities:

Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms. Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency. Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables. Utilizing knowledge of Snowflake to offer insight into data warehousing and management. Collaborate with data architects to provide Databricks solutions that align with company objectives. Work in conjunction with data science teams to implement complex statistical models. Ensuring data security and compliance in Databricks and Snowflake environments. Developing and deploying ETL job workflows with an emphasis on automation and scalability. Keeping up-to-date with industry best practices and emerging trends in Databricks technology.

Requirements:

Bachelor's degree in Computer Science, Information Technology, or a related field Solid experience in Databricks platform, data engineering, and using Delta Live Tables Experience with medallion architecture in a data lake environment Proficiency in Snowflake data warehousing platform Strong understanding of ETL workflows and data pipeline automation. Exceptional knowledge of data structures, data modeling, and database schemas Highly skilled in SQL, Python, or Scala. Experienced in performance tuning, troubleshooting, and debugging in Databricks environment Outstanding problem-solving abilities, with an innovative approach to tackling complex challenges. Exceptional communication skills with proven ability to bridge communication gaps between technical and non-technical stakeholders. Ideal candidates are proactive, collaborative, and passionate about data and Databricks technologies. If you have a desire to be at the forefront of data innovation, we would like to meet you.

  • Jersey City, United States ishare Inc Full time

    Hiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...

  • Databricks Architect

    4 weeks ago


    Jersey City, United States Inizio Partners Full time

    Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoringContinuously improve systems through...

  • Databricks Architect

    1 month ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Charles City, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations. We are looking for a creative, passionate and well-rounded leader to join the Industry Solutions marketing team at Databricks and lead our largest and fastest growing vertical, Financial Services. The right fit for this role will have a...


  • Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...


  • Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe...


  • Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...


  • Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe...


  • Jersey City, United States Kavyos Consulting Inc Full time

    What you'll do:As a Director of Data Engineering, you will be instrumental in driving innovation, ensuring data quality, and fostering collaboration across teams to harness the power of data for informed decision-makingCollaborate with the Business Intelligence team as well as Operators, Merchants, Marketers, Department heads, etc. to define use cases,...


  • Jersey City, United States Kavyos Consulting Inc Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....


  • Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....


  • Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....

  • Head of Document, Ai,

    1 month ago


    Jersey City, United States Combined Insurance Full time

    **Head of Document Ingestion & Engineering** Chubb is the world’s largest publicly traded P&C insurance company and a leading commercial lines insurer in the United States. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance,...


  • Jersey City, United States Georgia IT Inc Full time

    CRM Data Lead Location: Jersey City, NJ - Hybrid Duration: 6 months CTH Job description Roles & Responsibilities • Good knowledge on Azure SQL and Relational Database Concepts • Should have experience in working with Azure Storage Accounts, Azure Data Lake and Azure Databricks • Should have sound knowledge on DataWare house principles • Should have...

  • Software Engineer III

    3 weeks ago


    Jersey City, United States JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III at JPMorgan Chase within the Digital Document Services, Core Platform Services and AI Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a...