Databricks Admininstrator

We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.

Responsibilities:

• Hands-on administration experience with setting up the Databricks environment, administering, configuring and installing libraries on the instance.
• Advise on architecture and scaling for Databricks environments.
• Hands-on experience with workspaces, Unity Catalog, audit logs, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
• Experience managing tenants including workspace creation, user management, cloud resources, and account usage monitoring.
• Experience managing cluster and jobs, policies, templates, pools configuration options.
• Experience as the Databricks account owner, AWS accounts and high-level usage monitoring.
• Experience with Databricks security and privacy setup.
• Experience managing storage accounts access across a large user base.
• Monitor and manage auto-scaling to ensure resources are allocated efficiently.
• Experience optimizing usage for performance, monitor cluster health checks and cost preferred.
• Collaborate with data scientists, analysts, and other stakeholders to understand and deliver data solutions.
• Experience with marketplace plugins and integration with other tools.
• Experience troubleshooting end user and platform-level issues.
• Document and maintain Databricks best practices and standards.
• Experience with Hadoop and EMR administration.

Requirements

• 5+ years of experience working as databricks administrator/architect.
• Strong fluency with Python or Java.
• Must have experience with unity catalog migration.
• Advanced understanding of SQL to extract data from the databases.
• Experience with Amazon Web Services(AWS). 

Benefits

• Daily free breakfasts and lunches
• Health Care Plan (Medical, Dental & Vision)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Training & Development
• Retirement Plan (401k, IRA)