Cloud Databricks Specialist

Job Summary:
We are seeking a highly skilled Cloud Databricks Specialist to join our team. The successful candidate will have expertise in designing, implementing, and maintaining large-scale data pipelines in Azure ADF, as well as experience in ingesting data from various sources and transforming it using Azure Databricks & Delta lake and Pyspark. This role offers opportunities for professional growth and development in a collaborative and dynamic work environment.

Key Responsibilities:
- Design and develop data pipelines in Azure ADF
- Implement data ingestion solutions using Azure ADF
- Develop and maintain data transformation scripts using Azure Databricks & Delta lake and Pyspark
- Troubleshoot data-related issues using data analysis techniques
- Collaborate with cross-functional teams to ensure data pipeline efficiency

Requirements:
- 3+ years of experience in data engineering
- Expertise in Azure ADF, Databricks, and Pyspark
- Strong understanding of data transformation and cleansing concepts
- Experience working in agile development projects
- Excellent problem-solving and communication skills

Compensation: $140,000 - $200,000 per year

About Our Company:
Diverse Lynx LLC is an Equal Employment Opportunity employer. We value diversity and inclusion in the workplace and are committed to providing equal opportunities to all applicants.

---