AWS Databricks Engineer
3 weeks ago
Responsibilities:
- Evaluate and understand the latest features and capabilities of the Databricks platform and assess their potential impact on our organization's data ecosystem.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Databricks.
- Help to design, develop, and implement scalable and efficient data science/data engineering solutions using Databricks and related technologies.
- Optimize and fine-tune existing Databricks workflows to improve performance and reliability.
- Collaborate with data scientists, data engineers, and other stakeholders to ensure seamless integration of Databricks solutions into our data ecosystem.
- Understand the typical integrations with other Data Integration / Data Governance frameworks such as Starburst Trino, Collibra, Immuta, etc., and assess their compatibility and potential specific adoption criteria for our organization.
- Stay up-to-date with the latest trends and advancements in Databricks and related technologies, and proactively recommend improvements and enhancements to our existing systems.
- Strong understanding of Delta Live Tables, Medallion architecture and unity Catalog.
Requirements:
- Proven experience as a Databricks Engineer, with a focus on Databricks-AWS implementation.
- 5+year of experience in Python, Spark, Scala and big data with AWS platform
- Nice to have experience in Streaming preferably Kafka and Databricks integrations.
- Strong understanding of Databricks architecture and its integration with AWS services.
- Experience in designing and implementing scalable data processing pipelines using Databricks.
- Familiarity with cloud-based data storage and processing technologies, particularly AWS services.
- Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Prior experience in the pharmaceutical or healthcare industry is a plus.
--
Thanks & Regards
-
Databricks Engineer
4 weeks ago
Jersey City, United States CHUBB Full timeJob Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture. Key Responsibilities: ...
-
Databricks Architect
3 days ago
Jersey City, United States ishare Inc Full timeHiring on behalf of a client for full time , direct hire role for Databricks Architect /1) Hybrid in Jersey City 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid)Role & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in...
-
Databricks Architect
4 weeks ago
Jersey City, United States Inizio Partners Full timeRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoringContinuously improve systems through...
-
Databricks Architect
1 month ago
Jersey City, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionRole & Responsibilities Overview:Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for...
-
Databricks Admin
2 weeks ago
Foster City, United States Elgebra Full timeOwnership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions • Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments. • Management of Databricks at the Workspace and Account levels with a centralized approach. • Experience with setting up UC across...
-
Databricks Admininstrator
4 days ago
Foster City, United States A Society Group, Inc. Full timeWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities: Hands-on administration experience with setting up the Databricks environment,...
-
Databricks Admininstrator
4 days ago
Foster City, United States A Society Group, Inc. Full timeJob DescriptionJob DescriptionWe are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.Responsibilities:Hands-on administration experience with setting up the...
-
Databricks Admin
3 days ago
Foster City, United States MeganSoft Full timePosition: Databricks Admin Location: Foster City, CA - Onsite Duration: 12+ months MOI: Phone & WebEx***Passport Number mandatory***"Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutionsExpertise in migrating to and enabling Unity Catalog (UC) within Databricks environments.Management of...
-
Software Engineer III
3 weeks ago
Jersey City, United States JPMorgan Chase & Co. Full timeWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Digital Document Services, Core Platform Services and AI Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a...
-
Azure Databricks Architect
3 days ago
Kansas City, United States ClifyX Full timeRR-344784.1 zure Databricks Architect Kansas City,Missouri Day 1 onsite Burns & McDonnell Pay Rate $95/hr or $150 K customer was explicitly looking for a profile with design experience in Databricks Medallion architecture, and hands-on development as well. • Must have minimum of 3 Years of Data & Analytics Solution Experience as an Architect • Overall...
-
Databricks Admin
3 days ago
Foster City, United States Canvendor Inc Full timeWe do have a Databricks Admin role in Foster city, Ca. Please find the Job Description below and kindly respond back with your updated resume.Job Title: Databricks AdminJob Location: Foster city, CaDuration: 12+ Months Job Description:Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data...
-
Jersey City, United States Delta System & Software, Inc. Full timePosition: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...
-
Jersey City, United States Delta System & Software, Inc. Full timePosition: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...
-
Jersey City, United States Delta System & Software, Inc. Full timePosition: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...
-
Jersey City, United States Delta System & Software, Inc. Full timePosition: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2 Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...
-
Jersey City, United States Delta System & Software, Inc. Full timePosition: LEAD Level Azure Databricks Data Engineer with Finance Experience Duration: 12+ months Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 Rate: $75/hr – W2Job DescriptionsAZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databricksyears database/warehouse design, and development, prior experience with SQL Server SSIS...
-
Charles City, United States Databricks Full timeWhile candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations. We are looking for a creative, passionate and well-rounded leader to join the Industry Solutions marketing team at Databricks and lead our largest and fastest growing vertical, Financial Services. The right fit for this role will have a...
-
Principal Data Engineer
1 month ago
Jersey City, New Jersey, United States Tiger Analytics, LLC Full timeAs a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...
-
Director Of Data Engineering
3 days ago
Jersey City, United States Kavyos Consulting Inc Full timeWhat you'll do:As a Director of Data Engineering, you will be instrumental in driving innovation, ensuring data quality, and fostering collaboration across teams to harness the power of data for informed decision-makingCollaborate with the Business Intelligence team as well as Operators, Merchants, Marketers, Department heads, etc. to define use cases,...
-
AWS Architect
2 days ago
Jersey City, United States NR Consulting Full timeJob Title: AWS Architect Duration: 12+Months Location: New Jersey City NJ ( Remote )Description: 12-15 years of development experience with AWS Cloud based Java Web/Enterprise projects Must have expert level experience working on AWS services like S3, Lambada, SQS, API Gateway, IAM, Elastic Kubernetes Services Must have good working knowledge of OpenSearch...