Data Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Role: Sr Data Engineer - Disney
Location: Glendale, CA (Hybrid - 2- 4 Days Onsite)
Full Time
In Person is interview is must
Mandatory skills: Databricks experience (primary requirement), Apache Airflow, Advanced SQL skills, Python, Spark / PySpark, Scala, Experience building and maintaining data pipelines and workflows
Job Description:
Key Responsibilities:
Design, write, test, and deploy data pipelines using PySpark, Scala, SQL, Python
Meet with stakeholders to gather requirements and translate them into scalable data platform solutions
Understanding of Databricks platform and developer tooling to diagnose errors, audit platform activity, and automate updates across pipelines, objects, and integrations
Ability to explain Spark architecture and pipeline behavior to stakeholders to diagnose root causes and recommend solutions
Provide solution architecture across AWS, Databricks, Kubernetes, and Airflow (MWAA), including cross-platform integrations
Manage Databricks platform governance, including Unity Catalog, ACLs, lineage, and data discovery and privacy tooling
Build and maintain Kubernetes containers and containerized utilities supporting deployed data platform services
Apply networking knowledge to troubleshoot connectivity and integration errors across platform components
Perform platform administration: provision and remove access, assess resource utilization, monitor platform health and cost, and evaluate stakeholder requests
Collaborate with engineers, architects, and product managers to drive