AWS Databricks Engineer

3 weeks ago


Jersey City, United States KTek Resourcing Full time

Responsibilities:

  • Evaluate and understand the latest features and capabilities of the Databricks platform and assess their potential impact on our organization's data ecosystem.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Databricks.
  • Help to design, develop, and implement scalable and efficient data science/data engineering solutions using Databricks and related technologies.
  • Optimize and fine-tune existing Databricks workflows to improve performance and reliability.
  • Collaborate with data scientists, data engineers, and other stakeholders to ensure seamless integration of Databricks solutions into our data ecosystem.
  • Understand the typical integrations with other Data Integration / Data Governance frameworks such as Starburst Trino, Collibra, Immuta, etc., and assess their compatibility and potential specific adoption criteria for our organization.
  • Stay up-to-date with the latest trends and advancements in Databricks and related technologies, and proactively recommend improvements and enhancements to our existing systems.
  • Strong understanding of Delta Live Tables, Medallion architecture and unity Catalog.


Requirements:

  • Proven experience as a Databricks Engineer, with a focus on Databricks-AWS implementation.
  • 5+year of experience in Python, Spark, Scala and big data with AWS platform
  • Nice to have experience in Streaming preferably Kafka and Databricks integrations.
  • Strong understanding of Databricks architecture and its integration with AWS services.
  • Experience in designing and implementing scalable data processing pipelines using Databricks.
  • Familiarity with cloud-based data storage and processing technologies, particularly AWS services.
  • Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Prior experience in the pharmaceutical or healthcare industry is a plus.

--

Thanks & Regards


  • Databricks Engineer

    4 weeks ago


    Jersey City, United States CHUBB Full time

    Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...


  • Jersey City, United States ishare Inc Full time

    Hiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...

  • Databricks Architect

    4 weeks ago


    Jersey City, United States Inizio Partners Full time

    Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoringContinuously improve systems through...

  • Databricks Architect

    1 month ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...

  • Databricks Admin

    2 weeks ago


    Foster City, United States Elgebra Full time

    Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions • Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments. • Management of Databricks at the Workspace and Account levels with a centralized approach. • Experience with setting up UC across...


  • Foster City, United States A Society Group, Inc. Full time

    We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...


  • Foster City, United States A Society Group, Inc. Full time

    Job DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...

  • Databricks Admin

    3 days ago


    Foster City, United States MeganSoft Full time

    Position: Databricks Admin Location: Foster City, CA - Onsite Duration: 12+ months MOI: Phone & WebEx***Passport Number mandatory***"Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutionsExpertise in migrating to and enabling Unity Catalog (UC) within Databricks environments.Management of...

  • Software Engineer III

    3 weeks ago


    Jersey City, United States JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III at JPMorgan Chase within the Digital Document Services, Core Platform Services and AI Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a...


  • Kansas City, United States ClifyX Full time

    RR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...

  • Databricks Admin

    3 days ago


    Foster City, United States Canvendor Inc Full time

    We do have a Databricks Admin role in Foster city, Ca. Please find the Job Description below and kindly respond back with your updated resume.Job Title: Databricks AdminJob Location: Foster city, CaDuration: 12+ Months Job Description:Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Jersey City, United States Delta System & Software, Inc. Full time

    Position: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...


  • Charles City, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations. We are looking for a creative, passionate and well-rounded leader to join the Industry Solutions marketing team at Databricks and lead our largest and fastest growing vertical, Financial Services. The right fit for this role will have a...


  • Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...


  • Jersey City, United States Kavyos Consulting Inc Full time

    What you'll do:As a Director of Data Engineering, you will be instrumental in driving innovation, ensuring data quality, and fostering collaboration across teams to harness the power of data for informed decision-makingCollaborate with the Business Intelligence team as well as Operators, Merchants, Marketers, Department heads, etc. to define use cases,...

  • AWS Architect

    2 days ago


    Jersey City, United States NR Consulting Full time

    Job Title: AWS Architect Duration: 12+Months Location: New Jersey City NJ ( Remote )Description: 12-15 years of development experience with AWS Cloud based Java Web/Enterprise projects Must have expert level experience working on AWS services like S3, Lambada, SQS, API Gateway, IAM, Elastic Kubernetes Services Must have good working knowledge of OpenSearch...