Azure Databricks Engineer

4 weeks ago

Louisville, Kentucky, United States Diverse Lynx Full time
Job Description:

At Diverse Lynx LLC, we are seeking a highly skilled Azure Databricks Engineer to join our team. The ideal candidate will have experience in generating data pipelines in Azure ADF, ingesting data from various sources using Azure ADF, and transforming data using Azure Databricks & Delta lake and Pyspark. Additionally, the candidate should have expertise in Azure DevOps CI/CD, including story, bug, and issue management. The successful candidate will also have experience in implementing integration solutions in Microsoft Azure and performing data analysis to troubleshoot data-related issues. The role requires collaboration with cross-functional teams to elicit data requirements and architect effective data pipelines. The candidate should also be able to perform data transformations and cleansing operations to ensure data accuracy and consistency. Furthermore, the candidate will be responsible for evolving existing scripts and notebooks to meet client needs, monitoring, troubleshooting, and optimizing data pipelines for seamless functionality. The ideal candidate will also ensure that data solutions align with security and compliance standards and work closely with data architects to harmonize data models with project objectives. Finally, the candidate will document programming efforts and processes, technical specifications, and best practices.

Responsibilities:

1. Generate data pipelines in Azure ADF

2. Ingest data from various sources using Azure ADF

3. Transform data using Azure Databricks & Delta lake and Pyspark

4. Implement integration solutions in Microsoft Azure

5. Perform data analysis to troubleshoot data-related issues

6. Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines

7. Perform data transformations and cleansing operations to ensure data accuracy and consistency

8. Evolve existing scripts and notebooks to meet client needs

9. Monitor, troubleshoot, and optimize data pipelines for seamless functionality

10. Ensure data solutions align with security and compliance standards

11. Work closely with data architects to harmonize data models with project objectives

12. Document programming efforts and processes, technical specifications, and best practices

Requirements:

* Experience in generating data pipelines in Azure ADF

* Experience in ingesting data from various sources using Azure ADF

* Experience in transforming data using Azure Databricks & Delta lake and Pyspark

* Expertise in Azure DevOps CI/CD

* Experience in implementing integration solutions in Microsoft Azure

* Ability to perform data analysis to troubleshoot data-related issues

* Ability to collaborate with cross-functional teams

* Ability to perform data transformations and cleansing operations

* Ability to evolve existing scripts and notebooks

* Ability to monitor, troubleshoot, and optimize data pipelines

* Ability to ensure data solutions align with security and compliance standards

* Ability to work closely with data architects

* Ability to document programming efforts and processes

What We Offer:

At Diverse Lynx LLC, we offer a diverse and inclusive work environment, competitive salary, and comprehensive benefits package. We are an equal employment opportunity employer and welcome applications from qualified candidates.

How to Apply:

If you are a motivated and experienced professional looking for a new challenge, please submit your application, including your resume and cover letter, to [insert contact information]. We look forward to hearing from you.

Equal Employment Opportunity:

Diverse Lynx LLC is an equal employment opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination.

Disclaimer:

All applicants will be evaluated solely on the basis of their ability, competence, and their proven capability to perform the functions outlined in the corresponding role.

Company Information:

Diverse Lynx LLC is a company that promotes and supports a diverse workforce across all levels in the company.

Contact Information:

For more information, please contact [insert contact information].

Company Address:

[Insert company address].

Phone Number:

[Insert phone number].

Email Address:

[Insert email address].

Website:

[Insert website URL].

Social Media:

[Insert social media handles].

References:

[Insert references].

Job Type:

Full-time

Job Category:

Engineering

Location:

[Insert location].

Work Type:

On-site

Work Schedule:

[Insert work schedule].

Benefits:

[Insert benefits].

Salary:

[Insert salary].

Experience:

[Insert experience].

Education:

[Insert education].

Language:

English

Language Code:

en

  • Azure Databricks Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Job Title: Azure Databricks EngineerJob Description:Develop and maintain data pipelines in Azure ADF, ensuring seamless data ingestion and transformation.Collaborate with cross-functional teams to architect effective data pipelines, aligning with project objectives and security standards.Perform data analysis to troubleshoot data-related issues and assist in...

  • Azure Databricks Engineer

    4 weeks ago

    Louisville, Kentucky, United States ApTask Full time

    About the Role:The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. As a key member of the ApTask team, you will have the opportunity to work with a diverse range of clients and projects,...

  • Azure Data Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Job SummaryAt Diverse Lynx LLC, we are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines in Azure ADF. Your expertise in data ingestion, transformation, and integration will enable us to make data-driven...

  • Azure Data Solutions Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    We are seeking a talented Azure Data Engineer to join our team at Diverse Lynx LLC. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and develop scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure...

  • Senior Azure Solutions Architect

    4 weeks ago

    Louisville, Kentucky, United States Hermitage Infotech Full time

    Job Title: IT Project Manager/Scrum MasterWe are seeking an experienced IT Project Manager/Scrum Master with a strong background in Azure services, specifically Azure Data Factory (ADF), Azure Databricks, and Python, to lead and manage projects in the healthcare data engineering space.Key Responsibilities:• Manage projects that involve complex data...

  • Azure Cloud Solutions Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Job Title: Azure Data EngineerAbout the Role: We are seeking a highly skilled Azure Data Engineer to join our team at Diverse Lynx LLC.Key Responsibilities:* Design, implement, and maintain large-scale data processing systems on Microsoft Azure* Collaborate with cross-functional teams to develop and deploy data solutions* Ensure data security, integrity, and...

  • Cloud Systems Engineer

    4 weeks ago

    Louisville, Kentucky, United States Packsize Full time

    About PacksizeWe are a fast-growing multinational technology company committed to eliminating excessive and unfriendly packaging experiences through the adoption of Right-sized Packaging On Demand systems, software, and services. Our mission is to create a world where every box, envelope, and package shipped is the right size, reducing carbon emissions and...

  • Azure Network Solutions Engineer

    4 weeks ago

    Louisville, Kentucky, United States Equus Full time

    Job SummaryWe are seeking a highly skilled Azure Network Engineer to join our team at Equus Workforce Solutions. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining cloud-based network solutions on the Microsoft Azure platform.Key ResponsibilitiesDesign and implement cloud-based network solutions on...

  • Azure DevOps Systems Engineer III

    1 month ago

    Louisville, Kentucky, United States MILLENNIUMSOFT Full time

    Job Summary:This role is responsible for providing Systems leadership through various phases of product life cycle using their broad technical expertise, leadership skills, and product development knowledge. The Systems Engineer will translate voice of customer and stakeholder needs into system and product requirements, identify potential hazards and assess...

  • Azure DevOps Systems Engineer III

    4 weeks ago

    Louisville, Kentucky, United States MILLENNIUMSOFT Full time

    Job SummaryThis role is responsible for providing Systems leadership through various phases of product life cycle using their broad technical expertise, leadership skills, and product development knowledge.Key Responsibilities Translate voice of customer and stakeholder needs into system and product requirements Identify potential hazards and assess...

  • Azure Network Infrastructure Specialist

    4 weeks ago

    Louisville, Kentucky, United States Equus Full time

    Job Role OverviewThe role of the Azure Network Engineer at Equus Workforce Solutions involves providing operational and technical support to the organization's Information Technology department. This includes ensuring the efficient operation of the company's networks, systems, and associated infrastructure, as well as performing within agreed targets.Key...

  • Full Stack Technical Lead

    4 weeks ago

    Louisville, Kentucky, United States Photon Full time

    Greetings everyone,We are seeking a Fullstack Technical Lead with strong hands-on experience in .NET, Azure Functions, and Azure Service Bus, who will lead the development and architecture of both backend and frontend systems.Key Responsibilities:Lead Fullstack Development: Design, develop, and maintain fullstack solutions using .NET on the backend and...

  • Healthcare Data Engineering Technical Product Owner

    3 weeks ago

    Louisville, Kentucky, United States Emids Full time

    About EmidsEmids is a leading provider of digital transformation solutions to the healthcare industry. We help bridge critical gaps in providing accessible, affordable, and high-quality healthcare by providing digital transformation services, custom application development, data engineering, business intelligence solutions, and specialized consulting...

  • Technical Product Owner

    4 weeks ago

    Louisville, Kentucky, United States emids Full time

    About Emids:As a leading provider of digital transformation solutions to the healthcare industry, Emids serves payers, providers, life sciences, and technology firms. Headquartered in Nashville, Emids bridges critical gaps in providing accessible, affordable, and high-quality healthcare by offering digital transformation services, custom application...

  • Healthcare Data Engineering Lead

    4 weeks ago

    Louisville, Kentucky, United States Emids Full time

    About Emids:Emids is a leading provider of digital transformation solutions to the healthcare industry, serving payers, providers, life sciences, and technology firms. Our mission is to bridge critical gaps in providing accessible, affordable, and high-quality healthcare by providing digital transformation services, custom application development, data...

  • Software Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Job Description:At Diverse Lynx, we are seeking a skilled Software Engineer to join our team. The ideal candidate will have experience with VueJS and Azure, as well as .NET API Development and TDD. The successful candidate will be responsible for coding software applications based on business requirements and will work closely with the Scrum Team to design...

  • Data Analyst

    4 weeks ago

    Louisville, Kentucky, United States Accord Technologies Inc. Full time

    Job SummaryWe are seeking a skilled Data Analyst to join our Data Lake Discovery Program at Accord Technologies Inc. The ideal candidate will have experience in working with large-scale data systems, performing data analysis, and supporting the design and implementation of data lakes.Key Responsibilities:Collaborate with cross-functional teams to understand...

  • Frontend Developer Position

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Key Responsibilities:As a Frontend Developer at Diverse Lynx, you will work with a team of experienced developers to design, develop, test, implement, and support technical solutions and technologies. We utilize a tech stack that includes Git/GitHub, SASS, Typescript, Visual Studio, iServer, Artifactory, Jfrog, CheckMarx, Azure DevOps, SonarQube, and...

  • Senior Software Engineer

    4 weeks ago

    Louisville, Kentucky, United States Diverse Lynx Full time

    Job SummaryAt Diverse Lynx LLC, we are seeking a highly skilled Sr. Software Engineer to join our team. The ideal candidate will have extensive experience in software development, with a strong focus on cloud technologies and Azure.Key Responsibilities- Design and develop software applications based on business and technical requirements.- Collaborate with...

  • Senior Software Engineer

    1 month ago

    Louisville, Kentucky, United States Peaksware Full time

    Job Title: Senior Software EngineerAt Peaksware, we're looking for a talented Senior Software Engineer to join our team. As a key member of our engineering team, you'll be responsible for designing, developing, and deploying scalable and efficient software solutions that meet the needs of our growing customer base.Key Responsibilities:Design and develop...