AWS Databricks Engineer

2 weeks ago


Jersey City, United States KTek Resourcing Full time

Responsibilities:

  • Evaluate and understand the latest features and capabilities of the Databricks platform and assess their potential impact on our organization's data ecosystem.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Databricks.
  • Help to design, develop, and implement scalable and efficient data science/data engineering solutions using Databricks and related technologies.
  • Optimize and fine-tune existing Databricks workflows to improve performance and reliability.
  • Collaborate with data scientists, data engineers, and other stakeholders to ensure seamless integration of Databricks solutions into our data ecosystem.
  • Understand the typical integrations with other Data Integration / Data Governance frameworks such as Starburst Trino, Collibra, Immuta, etc., and assess their compatibility and potential specific adoption criteria for our organization.
  • Stay up-to-date with the latest trends and advancements in Databricks and related technologies, and proactively recommend improvements and enhancements to our existing systems.
  • Strong understanding of Delta Live Tables, Medallion architecture and unity Catalog.


Requirements:

  • Proven experience as a Databricks Engineer, with a focus on Databricks-AWS implementation.
  • 5+year of experience in Python, Spark, Scala and big data with AWS platform
  • Nice to have experience in Streaming preferably Kafka and Databricks integrations.
  • Strong understanding of Databricks architecture and its integration with AWS services.
  • Experience in designing and implementing scalable data processing pipelines using Databricks.
  • Familiarity with cloud-based data storage and processing technologies, particularly AWS services.
  • Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Prior experience in the pharmaceutical or healthcare industry is a plus.

--

Thanks & Regards


  • Databricks Engineer

    3 weeks ago


    Jersey City, United States CHUBB Full time

    Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...

  • Databricks Architect

    3 weeks ago


    Jersey City, United States Inizio Partners Full time

    Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoringContinuously improve systems through...


  • Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...

  • Databricks Architect

    4 weeks ago


    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...


  • Jersey City, United States CyberTec Full time

    Verisk 12+ Years $65 C2C No H1B, CPT AWS Data Engineer Position: Cloud Data Engineer, AWS Location: Jersey City New Jersey 07310 (Hybrid, 3 days in a week) ( Only local) Duration: 6+ Months Contract Job Description: Required Skills: Description: We are looking for a Cloud Data Engineer, who will be responsible to plan, design, develop and maintain...

  • Databricks Admin

    6 days ago


    Foster City, United States Elgebra Full time

    Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions • Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments. • Management of Databricks at the Workspace and Account levels with a centralized approach. • Experience with setting up UC across...


  • Kansas City, United States ClifyX Full time

    RR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...

  • Software Engineer III

    2 weeks ago


    Jersey City, United States JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III at JPMorgan Chase within the Digital Document Services, Core Platform Services and AI Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a...


  • Jersey City, United States Diverse Lynx Full time

    Senior Data Engineer with SAS/Databricks/PySpark Locations Mt Laurel, NJ & Charlotte, NC (Hybrid Work: 3 Days Onsite Per Week) Required Experience: 10-12+ Years Primary Tech skills SAS, Databricks, Pyspark Secondary Tech skills Azure, Synapse Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts Experience...


  • Charles City, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations. We are looking for a creative, passionate and well-rounded leader to join the Industry Solutions marketing team at Databricks and lead our largest and fastest growing vertical, Financial Services. The right fit for this role will have a...


  • Jersey City, United States ClifyX Full time

    We are looking more of AWS experience with RDS expertise. Please share profiles . AWS Engineer with RDS Mount Lauren, NJ (Remote Job) Rate: $75-$80/hr 10+years only Description: We are looking for WS Engineer to support cloud deployments. This role requires a self-starter who is adept at solving problems, is a collaborative teammate and an effective...

  • AWS Engineer with RDS

    2 weeks ago


    Jersey City, United States ClifyX Full time

    We are looking more of AWS experience with RDS expertise. Please share profiles . AWS Engineer with RDS Mount Lauren, NJ (Remote Job) Rate: $75-$80/hr 10+years only Description: We are looking for WS Engineer to support cloud deployments. This role requires a self-starter who is adept at solving problems, is a collaborative teammate and an effective...

  • AWS/DevOps Engineer

    2 weeks ago


    Jersey City, United States Crescens Full time

    Role: AWS/DevOps Engineer - Infrastructure Location: Berkeley Heights, NJ Duration: Full TimeJob Description: Provide SME level knowledge and skills to manage, configure and monitor AWS environments. Mentor other resources. Ability to build enterprise-grade systems in AWS including the provisioning and configuration of infrastructure. Provide hands-on...


  • Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...

  • AWS Architect

    2 weeks ago


    Jersey City, United States NR Consulting Full time

    Job Title: AWS Architect Duration: 12+Months Location: New Jersey City NJ ( Remote )Description: 12-15 years of development experience with AWS Cloud based Java Web/Enterprise projects Must have expert level experience working on AWS services like S3, Lambada, SQS, API Gateway, IAM, Elastic Kubernetes Services Must have good working knowledge of OpenSearch...

  • AWS Cloud Engineer

    2 weeks ago


    Jersey City, United States Diverse Lynx Full time

    Job Description: 3+ years of experience in similar DevOps, SRE, or Platform roles in a cloud-based environment Experience with Kubernetes networking/routing. Experience with Kubernetes and EKS add-ons 3+ years of experience with messaging and queuing systems (RabbitMQ, AWS MQ, AWS MSK, AWS SQS and AWS SNS) 2+ years of experience with containers and container...

  • AWS Data Engineer

    3 weeks ago


    Jersey City, United States iShare Inc Full time

    Job DescriptionJob DescriptionAWS Data EngineerLocation Jersey City NJ (Onsite) - 6 Months ContractJob responsibilitiesExecutes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problemsCreates secure and high-quality production...

  • Data Engineer

    2 weeks ago


    Jersey City, United States ClifyX Full time

    Job title : Data Engineer - Databricks Location : New Jersey (Remote) Duration : Contract / Fulltime Health Care Company $75/Hr (Contract) salary 120-135K/Annum (Fulltime) Job Description: • Experience with PySpark or Python • DataBricks experience is mandatory • Experience with big data tools Spark, Hadoop Kafka would be good to have • Hands on...


  • Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....


  • Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....