Azure Databricks Engineer

Role name: Developer Role Description: •Experience in generating data pipelines in Azure ADF•Experience in ingesting data from different Sources using in Azure ADF•Experience in transforming the data using Azure Databricks & Delta lake and Pyspark•Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management•Implement Integration solution in Microsoft Azure•Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues•Experience working in agile development projects and sprint deliver•Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.•Perform data transformations and cleansing operations to ensure data accuracy and consistency.•Evolve existing scripts and notebooks to meet client needs.•Monitor, troubleshoot, and optimize data pipelines for seamless functionality.•Ensure data solutions align with security and compliance standards•Work closely with data architects to harmonize data models with project objectives.•Document programming efforts and processes, technical specifications, and best practices. Competencies: Digital : Microsoft Azure, Digital : Databricks

Note: Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions. We promote and support a diverse workforce at all levels in the company. This is not an unsolicited mail and if it is not intended for you or you are not interested in receiving our e-mails, you can unsubscribe. We are sorry for any inconvenience.

---