Azure Databricks Infrastructure Manager

1 week ago


New York, New York, United States NYU Langone Health Full time
Overview
New York University (NYU) Langone Health is a world-class, patient-centered institution seeking an experienced professional to fill the role of Azure Databricks Administrator. As part of our team, you will play a crucial role in overseeing the daily operations of our Azure Databricks platform, ensuring seamless performance, security, and scalability for our data workloads. Our ideal candidate possesses strong technical skills, excellent communication abilities, and a passion for delivering high-quality solutions.

Job Description
The successful candidate will be responsible for managing and maintaining our Azure Databricks environment, including clusters, workspaces, and jobs. This involves overseeing user administration, implementing cost control measures, and monitoring platform usage and performance. Additionally, the administrator will collaborate with cross-functional teams to optimize data workflows and analytical pipelines on the Databricks platform. Key responsibilities include:
  1. ">
  2. Managing Azure storage solutions, including Blob Storage and Data Lake Storage.
  3. Administering Azure Key Vault for secure storage of secrets and keys.
  4. Configuring and managing Azure Data Factory for data integration and ETL processes.
  5. Implementing and managing VNETs, firewalls, Azure policies, and security best practices.
  6. Implementing and managing Azure DevOps for CI/CD pipelines and version control.

Requirements and Qualifications
To be considered for this exciting opportunity, applicants must possess a Bachelor's degree in Computer Science, Information Systems, or Engineering and have at least 7 years of related professional experience administering data platforms. Experience with Azure Databricks Lakehouse Platform is required, as well as proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash. The ideal candidate should also demonstrate knowledge of security best practices and compliance requirements. Furthermore, they should be able to troubleshoot and resolve issues in a timely and efficient manner, possessing strong verbal and written communication skills. A commitment to providing high-quality support to internal and external users and stakeholders is essential. Salary: $81,325.15 - $135,541.73 annually.

  • New York, New York, United States NYU Langone Health Full time

    Responsibilities and ExpectationsWe seek an accomplished Azure Databricks Administrator to oversee the management and maintenance of our Databricks platform. As a key member of our team, you will ensure seamless operation, optimal performance, and robust security across our workspaces, clusters, and jobs. Your primary responsibilities will include:">Ensuring...


  • New York, New York, United States NYU Langone Full time

    The ideal candidate will have a strong background in data platforms and experience with Azure Databricks. The salary range for this role is $81,325.15 - $135,541.73 Annually.We are looking for a skilled Azure Databricks Administrator to join our team. In this role, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal...


  • New York, New York, United States NYU Langone Health Full time

    Job Summary:NYU Langone Health is seeking a highly skilled Azure Databricks Administrator to join our team. The ideal candidate will have experience managing and maintaining Databricks platforms, ensuring optimal performance and security across workspaces, clusters, and jobs.Key Responsibilities:Manage and maintain Azure Databricks Platform workspaces,...

  • Data Engineer

    4 weeks ago


    New York, New York, United States Diverse Lynx Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team as an Azure Databricks Specialist. This role will focus on working with Azure Databricks services, creating and managing data pipelines, and developing scalable data solutions.ResponsibilitiesDesign and implement data ingestion, transformation, and loading pipelines using Azure Data...


  • New York, New York, United States NYU Langone Full time

    Company Overview:NYU Langone Health is a world-class academic medical center, renowned for its exceptional clinical care, research, and education. With over 200 locations across the New York area, it encompasses five inpatient facilities, a children's hospital, three emergency rooms, and a level 1 trauma center.The institution comprises the Laura and Isaac...


  • New York, New York, United States Diverse Lynx Full time

    About the Position:Diverse Lynx LLC is seeking an experienced Azure Databricks Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks services.Key Responsibilities:Design and implement data pipelines using Azure Data...


  • New York, New York, United States NYULMC Full time

    Cloud Databricks Engineer Job Description:Nyulmc is looking for a Cloud Databricks Engineer to join our team. This is an exciting opportunity to work with cutting-edge technology and contribute to the development of robust data solutions.The ideal candidate will have 7 years of experience administering data platforms and 3 years of experience with Azure...


  • New York, New York, United States Publicis Sapient Full time

    Unlock Business Value with Databricks ExpertiseAbout the Role:We're seeking a highly skilled Data Engineering Architect to lead the build of global Databricks platforms, enabling real business outcomes for our enterprise clients. As a top-notch technologist, you'll create impact for some of the world's biggest brands by translating their needs into...

  • Senior IT Manager

    1 week ago


    New York, New York, United States KPMG Full time

    KPMG is seeking a Senior IT Manager - Data Infrastructure to join our Digital Nexus technology organization. This is a remote work opportunity.The estimated salary for this position is around $160,000-$240,000 per year, depending on location and experience. We're looking for someone with at least five years of recent experience in developing and implementing...


  • New York, New York, United States NYULMC Full time

    About Us:Nyulmc, a world-class, patient-centered, integrated academic medical center, is known for its excellence in clinical care, research, and education. With over 200 locations throughout the New York area, we provide a wide range of services to our patients and community.We are committed to diversity, equity, and inclusion, and strive to be a place...


  • New York, New York, United States APN Consulting Full time

    About the JobWe are hiring an Azure Infrastructure Leader to oversee the migration of existing applications and infrastructure to Azure, focusing on governance and security aspects. This role requires a strong understanding of Azure security and governance principles and best practices.Responsibilities:Oversee the migration of existing applications and...


  • New York, New York, United States DataBricks Full time

    We are seeking an experienced Data Architect Lead to join our team at Databricks, a leading provider of cloud-based data analytics and machine learning platforms. In this role, you will be responsible for driving customer success by delivering high-quality solutions that meet the complex needs of our clients.About the RoleThis is a hybrid technical and...


  • New York, New York, United States Diverse Lynx Full time

    Job Summary: We are looking for a talented Devops Engineer to join our team at Diverse Lynx LLC. The successful candidate will have experience with cloud-based infrastructure, continuous integration and delivery, and DevOps practices.Estimated Salary: $120,000 - $150,000 per yearAbout the Role: In this role, you will be responsible for designing,...


  • New York, New York, United States Diverse Lynx Full time

    AWS Databricks Architect:We are seeking an experienced AWS Databricks Architect to join our data engineering team. In this role, you will design and implement large-scale data processing systems using Databricks and PySpark on AWS. As a key member of our team, you will collaborate with cross-functional teams to ensure seamless integration with existing...


  • New York, New York, United States Mizuho Americas Full time

    At Mizuho Americas, we are looking for an experienced Azure Cloud Infrastructure Engineer to join our team. As a key member of the team, you will be responsible for automating, deploying, and maintaining scalable, secure, and high-performance cloud solutions on Microsoft Azure.Key Responsibilities:Automate, deploy, and maintain cloud solutions in accordance...


  • New York, New York, United States AI Talent Flow Full time

    AI TalentFlowDream Job Alert!Are you a data enthusiast with a passion for innovation? Do you want to make a real impact in the financial services sector?We're looking for a highly skilled Databricks Engineer to join our team. As a key player in our organization, you will be responsible for designing, developing, and implementing efficient and scalable data...


  • New York, New York, United States Lorven Technologies Full time

    Lorven Technologies is seeking an experienced Azure Data Engineering Professional to join our team. As a key member of our Data Strategy group, you will play a crucial role in the development and implementation of our data platform on Azure Cloud Platform.Job Description:The ideal candidate will have 10+ years of experience in software development using...


  • New York, New York, United States Mizuho Corporate Bank Full time

    About the RoleThe ideal candidate for this position will have a deep understanding of Azure cloud computing, DevOps methodologies, and development skills. Key responsibilities include:Designing and developing secure and reliable cloud solutionsIdentifying and resolving cloud infrastructure vulnerabilities and application deployment issuesCollaborating with...


  • New York, New York, United States The Dignify Solutions LLC Full time

    We are looking for a highly skilled Azure Power BI Infrastructure Specialist to join our team at The Dignify Solutions LLC. As an Azure Power BI Infrastructure Specialist, you will be responsible for creating gateway connections for Power BI and PowerApp, providing primary support for design and access to Power BI through Pro and Premium Capacity platforms,...


  • New York, New York, United States Mizuho Americas Full time

    About the RoleThe Cloud Engineer will play a pivotal role in automating, deploying, and maintaining scalable, secure, and high-performance cloud solutions on Azure. Key responsibilities include designing, developing, and deploying secure and reliable cloud solutions, identifying and resolving cloud infrastructure vulnerabilities and application deployment...