Azure Databricks Engineer

We are seeking a highly skilled Azure Databricks Developer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Databricks, ADLS, and pyspark.

• Design and develop data pipelines using Azure Databricks, ADLS, and pyspark
• Experience in generating data pipelines in Azure ADF and ingesting data from different sources
• Transform data using Azure Databricks, Delta lake, and Pyspark
• Implement integration solutions in Microsoft Azure
• Perform data analysis to troubleshoot data-related issues and assist in resolution
• Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines
• Monitor, troubleshoot, and optimize data pipelines for seamless functionality
• Ensure data solutions align with security and compliance standards

• 10-12 years of experience in data engineering and Azure Databricks
• Experience in Azure DevOps CI/CD, Stories, Bugs, and Issue management
• Strong understanding of data modeling and data architecture
• Excellent problem-solving skills and attention to detail

Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company. All qualified applicants will receive due consideration for employment without any discrimination.