Senior Azure Databricks Data Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Job Summary
We are seeking a skilled Databricks Engineer with minimum of 5+ years of hands-on in Databricks who can design, develop, and optimize scalable data platforms and analytics solutions using the Databricks Lakehouse Platform. The ideal candidate will have expertise in data engineering, ETL/ELT development, cloud technologies preferably Azure, and big data processing to support enterprise analytics and AI initiatives.
Job Description: Azure / Databricks Data Engineer (9-15 Years Experience)
Senior Azure Databricks Data Engineer
Experience
9-15 Years of IT Experience
Location
Hybrid
Job Summary
We are seeking a skilled Databricks Engineer with minimum of 5+ years of hands-on in Databricks who can design, develop, and optimize scalable data platforms and analytics solutions using the Databricks Lakehouse Platform. The ideal candidate will have expertise in data engineering, ETL/ELT development, cloud technologies preferably Azure, and big data processing to support enterprise analytics and AI initiatives.
Key Responsibilities
- Design, develop, and maintain data pipelines using Databricks, Apache Spark, and cloud-native services.
- Build and optimize ETL/ELT workflows for large-scale structured and unstructured data.
- Develop data models and implement data quality, validation, and governance frameworks.
- Integrate data from multiple sources into a unified Lakehouse architecture.
- Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency.
- Implement security controls, access management, and data governance using Unity Catalog.
- Collaborate with business, analytics, and AI/ML teams to deliver trusted data products.
- Monitor, troubleshoot, and resolve data pipeline issues.
- Support CI/CD, DevOps, and infrastructure automation practices.
- Maintain technical documentation and best practices.
Required Technical Skills Core Technologies
- Databricks Lakehouse Platform
- Apache Spark / PySpark
- Delta Lake
- SQL
- Python
Data Engineering
- ETL / ELT Development
- Data Modeling
- Data Warehousing
- Data Quality & Validation
- Streaming & Real-Time Processing
Governance & Security
- Unity Catalog
- Data Lineage
- Row-Level Security
- Access Control & Compliance
- Data Governance Frameworks
Cloud & DevOps
- Azure / AWS / GCP
- Terraform
- GitHub Actions / Azure DevOps
- CI/CD Pipelines
Analytics & AI
- Semantic Layers
- Data Products
- BI Platforms
- Machine Learning Support
- Generative AI & RAG Architectures
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
- 9-15 years of experience in Data Engineering and Data Warehousing.
- Minimum 5+ years of hands-on experience with Azure Data Engineering technologies.
- Minimum 4+ years of hands-on experience with Azure Databricks and Spark ecosystem.
- Strong understanding of data lake, lakehouse, and cloud-native architecture patterns.
- Experience in handling large-scale structured and unstructured datasets.
- Strong analytical, problem-solving, and troubleshooting skills.
Preferred Qualifications
- Microsoft Certified: Azure Data Engineer Associate (DP-203).
- Databricks Certified Data Engineer Associate/Professional.
- Experience with Snowflake, Power BI, or Microsoft Fabric.
- Experience in real-time streaming solutions using Kafka/Event Hubs.
- Exposure to Data Governance and Master Data Management initiatives.
Soft Skills
- Strong stakeholder management and communication skills.
- Ability to lead technical initiatives and drive architecture discussions.
- Experience working in Agile/Scrum environments.
- Excellent documentation and presentation skills.
- Strong mentoring and team leadership abilities.
Nice to Have
- Microsoft Fabric
- Power BI
- Azure Event Hubs
- Kafka
- Machine Learning data pipelines
- Data Governance tools such as Purview
Responsibilities
Support critical and nonproduction databases in multitenant, highstress environments.
Support applications Installation, Configuration, Management, and Monitoring of databases in a SOX and PHI compliant environment
Installation, configuration, and integration of thirdparty applications and tools
Development of procedures for automated monitoring and proactive intervention, preventing customer impact
Qualifications
Bachelors Degree/ Post Bachelor Degree 8 - 10+ Years
-
Senior Azure Databricks Data Engineer
1 week ago
New York, New York, United States EXL Full-time $90,500 - $140,000 ContractJob Summary We are seeking a skilled Databricks Engineer with minimum of 5+ years of hands-on in Databricks who can design, develop, and optimize scalable data platforms and analytics solutions using the Databricks Lakehouse Platform. The ideal candidate will have expertise in data engineering, ETL/ELT development, cloud technologies preferably Azure, and...
-
.png?1696511761)
Data Engineer – Azure Databricks
23 hours ago
New York, New York, United States High Bridge Consulting Full-time $70 - $90 PermanentData Engineer – Azure Databricks (Corporate Data Platform) We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG. This role focuses on modern cloud data engineering, ETL/ELT...
-
Sr. Cloud Engineer
24 hours ago
New York, TX, 75770, United States, New York Saxon Global Full-time $75 - $80 Permanent** Please mention these details before submitting the candidate.** Full Name: Contact # Email Address: MM/DD: Availability: Immediately Actively Interviewing (Y/N): Visa Status: Current Location: On-site Interviewing (Y/N, Explanation): LinkedIn: Client: Con Edison Job Location - NY, NY Duration: 12+ months Rate: $75-80/hr C2C OPEN TO GC/USC (they must...
-
Senior Data Engineer – Databricks
23 hours ago
New York, New York, United States hiretalent Full-timeKey Responsibilities • Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL. • Build and optimize data processing workflows using Apache Spark and Delta Lake. • Develop reliable data ingestion, transformation, validation, and enrichment processes across multiple data sources. • Work with large and...
-
Databricks Data Engineer
22 hours ago
New York city, New Jersey, United States PeopleNTech Full-time $75 - $78 PermanentRole : Databricks Data Engineer Location : New York city (Hybrid) Rate : $75 - $78/hr Contract Azure Data Engineer with Databricks Expertise Job Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...
-
Databricks Data Engineer
2 days ago
New York, New York, United States, New York Inizio Partners Corp Full-timeJob Overview: We are seeking a skilled Databricks Data Engineer to join our team. The successful candidate will be responsible for development and optimization of data pipelines, implementing robust data checks, and ensuring the accuracy and integrity of data flows. This role is critical in supporting data-driven decision-making processes, especially in...
-
Databricks Data Engineer
2 days ago
New York, New York, United States Deloitte Full-time $86,700 - $170,900 ContractJoin Deloitte's Core AI & Data practice and help organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities. As a Databricks Data Engineer, you will support the design, build, and optimization of cloud-based data engineering solutions that enable large-scale transformation. You...
-
DataBricks Data Engineer
24 hours ago
New York, New York, United States Globalchannelmanagement Full-timeDataBricks Data Engineer requires: Must have functional and technical experience with Sales Incentive Compensation (SIC) including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing. At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience ...
-
Azure Databricks Engineer
24 hours ago
Branchville, NJ, 07826, United States, New Jersey QTech Full-time $50 - $55 PermanentJob Title: Azure Databricks Engineer Location: Branchville, NJ -5 Days Onsite Duration: Long Term Contract Looking for W2 Candidates. No C2C Above 10+ years of experience. Mandatory : Need minimum 5 yrs of experience working on ETL development minimum 3 yrs experience on Azure Databricks development Need exp on Prem to cloud migration project for Azure...
-
Azure Databricks Platform Support Engineer 3641534
24 hours ago
New York City, New York, United States Axiom Path Full-timeBe Part Of A High-Performing Team:Join a technology organization supporting data and analytics platforms within a global financial services environment. This team is focused on building secure, scalable cloud infrastructure that enables application teams to use Azure and Databricks effectively. The environment combines hands-on technical support,...
