Azure Databricks Infrastructure Manager
1 week ago
New York University (NYU) Langone Health is a world-class, patient-centered institution seeking an experienced professional to fill the role of Azure Databricks Administrator. As part of our team, you will play a crucial role in overseeing the daily operations of our Azure Databricks platform, ensuring seamless performance, security, and scalability for our data workloads. Our ideal candidate possesses strong technical skills, excellent communication abilities, and a passion for delivering high-quality solutions.
Job Description
The successful candidate will be responsible for managing and maintaining our Azure Databricks environment, including clusters, workspaces, and jobs. This involves overseeing user administration, implementing cost control measures, and monitoring platform usage and performance. Additionally, the administrator will collaborate with cross-functional teams to optimize data workflows and analytical pipelines on the Databricks platform. Key responsibilities include:
- ">
- Managing Azure storage solutions, including Blob Storage and Data Lake Storage.
- Administering Azure Key Vault for secure storage of secrets and keys.
- Configuring and managing Azure Data Factory for data integration and ETL processes.
- Implementing and managing VNETs, firewalls, Azure policies, and security best practices.
- Implementing and managing Azure DevOps for CI/CD pipelines and version control.
Requirements and Qualifications
To be considered for this exciting opportunity, applicants must possess a Bachelor's degree in Computer Science, Information Systems, or Engineering and have at least 7 years of related professional experience administering data platforms. Experience with Azure Databricks Lakehouse Platform is required, as well as proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash. The ideal candidate should also demonstrate knowledge of security best practices and compliance requirements. Furthermore, they should be able to troubleshoot and resolve issues in a timely and efficient manner, possessing strong verbal and written communication skills. A commitment to providing high-quality support to internal and external users and stakeholders is essential. Salary: $81,325.15 - $135,541.73 annually.
-
Databricks and Azure Expert
2 weeks ago
New York, New York, United States NYU Langone Health Full timeResponsibilities and ExpectationsWe seek an accomplished Azure Databricks Administrator to oversee the management and maintenance of our Databricks platform. As a key member of our team, you will ensure seamless operation, optimal performance, and robust security across our workspaces, clusters, and jobs. Your primary responsibilities will include:">Ensuring...
-
Azure Databricks Administrator Specialist
1 week ago
New York, New York, United States NYU Langone Full timeThe ideal candidate will have a strong background in data platforms and experience with Azure Databricks. The salary range for this role is $81,325.15 - $135,541.73 Annually.We are looking for a skilled Azure Databricks Administrator to join our team. In this role, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal...
-
Azure Databricks Platform Administrator
4 weeks ago
New York, New York, United States NYU Langone Health Full timeJob Summary:NYU Langone Health is seeking a highly skilled Azure Databricks Administrator to join our team. The ideal candidate will have experience managing and maintaining Databricks platforms, ensuring optimal performance and security across workspaces, clusters, and jobs.Key Responsibilities:Manage and maintain Azure Databricks Platform workspaces,...
-
Data Engineer
4 weeks ago
New York, New York, United States Diverse Lynx Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team as an Azure Databricks Specialist. This role will focus on working with Azure Databricks services, creating and managing data pipelines, and developing scalable data solutions.ResponsibilitiesDesign and implement data ingestion, transformation, and loading pipelines using Azure Data...
-
High-Level Azure Databricks Administrator Expert
4 weeks ago
New York, New York, United States NYU Langone Full timeCompany Overview:NYU Langone Health is a world-class academic medical center, renowned for its exceptional clinical care, research, and education. With over 200 locations across the New York area, it encompasses five inpatient facilities, a children's hospital, three emergency rooms, and a level 1 trauma center.The institution comprises the Laura and Isaac...
-
Azure Databricks Specialist
1 week ago
New York, New York, United States Diverse Lynx Full timeAbout the Position:Diverse Lynx LLC is seeking an experienced Azure Databricks Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks services.Key Responsibilities:Design and implement data pipelines using Azure Data...
-
Cloud Databricks Engineer
2 weeks ago
New York, New York, United States NYULMC Full timeCloud Databricks Engineer Job Description:Nyulmc is looking for a Cloud Databricks Engineer to join our team. This is an exciting opportunity to work with cutting-edge technology and contribute to the development of robust data solutions.The ideal candidate will have 7 years of experience administering data platforms and 3 years of experience with Azure...
-
New York, New York, United States Publicis Sapient Full timeUnlock Business Value with Databricks ExpertiseAbout the Role:We're seeking a highly skilled Data Engineering Architect to lead the build of global Databricks platforms, enabling real business outcomes for our enterprise clients. As a top-notch technologist, you'll create impact for some of the world's biggest brands by translating their needs into...
-
Senior IT Manager
1 week ago
New York, New York, United States KPMG Full timeKPMG is seeking a Senior IT Manager - Data Infrastructure to join our Digital Nexus technology organization. This is a remote work opportunity.The estimated salary for this position is around $160,000-$240,000 per year, depending on location and experience. We're looking for someone with at least five years of recent experience in developing and implementing...
-
Senior II Databricks Technical Lead
1 week ago
New York, New York, United States NYULMC Full timeAbout Us:Nyulmc, a world-class, patient-centered, integrated academic medical center, is known for its excellence in clinical care, research, and education. With over 200 locations throughout the New York area, we provide a wide range of services to our patients and community.We are committed to diversity, equity, and inclusion, and strive to be a place...
-
Azure Infrastructure Leader
2 weeks ago
New York, New York, United States APN Consulting Full timeAbout the JobWe are hiring an Azure Infrastructure Leader to oversee the migration of existing applications and infrastructure to Azure, focusing on governance and security aspects. This role requires a strong understanding of Azure security and governance principles and best practices.Responsibilities:Oversee the migration of existing applications and...
-
New York, New York, United States DataBricks Full timeWe are seeking an experienced Data Architect Lead to join our team at Databricks, a leading provider of cloud-based data analytics and machine learning platforms. In this role, you will be responsible for driving customer success by delivering high-quality solutions that meet the complex needs of our clients.About the RoleThis is a hybrid technical and...
-
Azure Infrastructure Lead
1 week ago
New York, New York, United States Diverse Lynx Full timeJob Summary: We are looking for a talented Devops Engineer to join our team at Diverse Lynx LLC. The successful candidate will have experience with cloud-based infrastructure, continuous integration and delivery, and DevOps practices.Estimated Salary: $120,000 - $150,000 per yearAbout the Role: In this role, you will be responsible for designing,...
-
AWS Databricks Architect
1 week ago
New York, New York, United States Diverse Lynx Full timeAWS Databricks Architect:We are seeking an experienced AWS Databricks Architect to join our data engineering team. In this role, you will design and implement large-scale data processing systems using Databricks and PySpark on AWS. As a key member of our team, you will collaborate with cross-functional teams to ensure seamless integration with existing...
-
Azure Cloud Infrastructure Engineer
7 days ago
New York, New York, United States Mizuho Americas Full timeAt Mizuho Americas, we are looking for an experienced Azure Cloud Infrastructure Engineer to join our team. As a key member of the team, you will be responsible for automating, deploying, and maintaining scalable, secure, and high-performance cloud solutions on Microsoft Azure.Key Responsibilities:Automate, deploy, and maintain cloud solutions in accordance...
-
Databricks Infrastructure Specialist
1 day ago
New York, New York, United States AI Talent Flow Full timeAI TalentFlowDream Job Alert!Are you a data enthusiast with a passion for innovation? Do you want to make a real impact in the financial services sector?We're looking for a highly skilled Databricks Engineer to join our team. As a key player in our organization, you will be responsible for designing, developing, and implementing efficient and scalable data...
-
Azure Data Engineering Professional
2 weeks ago
New York, New York, United States Lorven Technologies Full timeLorven Technologies is seeking an experienced Azure Data Engineering Professional to join our team. As a key member of our Data Strategy group, you will play a crucial role in the development and implementation of our data platform on Azure Cloud Platform.Job Description:The ideal candidate will have 10+ years of experience in software development using...
-
Azure Infrastructure Specialist
7 days ago
New York, New York, United States Mizuho Corporate Bank Full timeAbout the RoleThe ideal candidate for this position will have a deep understanding of Azure cloud computing, DevOps methodologies, and development skills. Key responsibilities include:Designing and developing secure and reliable cloud solutionsIdentifying and resolving cloud infrastructure vulnerabilities and application deployment issuesCollaborating with...
-
Azure Power BI Infrastructure Specialist
1 week ago
New York, New York, United States The Dignify Solutions LLC Full timeWe are looking for a highly skilled Azure Power BI Infrastructure Specialist to join our team at The Dignify Solutions LLC. As an Azure Power BI Infrastructure Specialist, you will be responsible for creating gateway connections for Power BI and PowerApp, providing primary support for design and access to Power BI through Pro and Premium Capacity platforms,...
-
Azure Infrastructure Specialist
1 week ago
New York, New York, United States Mizuho Americas Full timeAbout the RoleThe Cloud Engineer will play a pivotal role in automating, deploying, and maintaining scalable, secure, and high-performance cloud solutions on Azure. Key responsibilities include designing, developing, and deploying secure and reliable cloud solutions, identifying and resolving cloud infrastructure vulnerabilities and application deployment...