See more Collapse

Databricks Admin

1 month ago


Foster CA, United States Elgebra Full time

Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions

  • Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments.
  • Management of Databricks at the Workspace and Account levels with a centralized approach.
  • Experience with setting up UC across multiple workspaces, including separate environments for Production and Non-Production.
  • Capability to handle deduplication of workspaces efficiently.
  • Proficient in implementing access control mechanisms to secure data and workflows.
  • Ability to assist during the migration to Unity Catalog, ensuring a smooth transition.
  • Knowledge and experience in managing licensing, resource utilization, scaling, and storage specifically for Databricks on AWS.
  • Experience in spinning up new Databricks workspaces and migrating data from AWS S3 buckets.
  • Ability to create and manage new server clusters on AWS efficiently.
Good Experience in Apache Spark and Delta Lake Technology (DLT), as well as Hive Metastore management.
  • Skills in query optimization, managing notebooks, and effectively utilizing Databricks for data operations.
  • Understanding of role-based access control (RBAC) and attribute-based access control (ABAC), along with overall data governance.
  • Expertise in metadata modeling to support effective data management and analysis.
  • Knowledge in handling sensitive information, including skills in data segregation, encryption, and anonymization to ensure privacy and compliance.
  • Basic knowledge of AWS services, including VPC, Private Subnet, NACL, and VPC Endpoints