Azure Databricks Solutions Architect

3 weeks ago


Louisville, Kentucky, United States Diverse Lynx Full time

Diverse Lynx LLC is an Equal Employment Opportunity employer.

">">

We promote and support a diverse workforce across all levels in the company.

">">Salary:">

The estimated salary for this role is around $120,000 per year, based on the location and industry standards.

">">Job Description:">

Title: Big Data Engineer - Azure Databricks

">

Location: Louisville, Kentucky (Onsite)

">

Job Type: Contract

">

Job Description:

">

We are looking for a highly skilled Big Data Engineer - Azure Databricks to join our team. The ideal candidate will have experience in generating data pipelines in Azure ADF, ingesting data from different sources using Azure ADF, transforming data using Azure Databricks & Delta lake and Pyspark, and implementing integration solutions in Microsoft Azure.

">

The successful candidate will also have excellent problem-solving skills, with the ability to troubleshoot data-related issues and assist in the resolution of data issues. Experience working in agile development projects and sprint delivery is essential.

">

Candidates should be able to collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines. Perform data transformations and cleansing operations to ensure data accuracy and consistency is crucial.

">

We are looking for someone who can evolve existing scripts and notebooks to meet client needs, monitor, troubleshoot, and optimize data pipelines for seamless functionality. Ensuring data solutions align with security and compliance standards is vital.

">

The selected candidate will work closely with data architects to harmonize data models with project objectives. Documenting programming efforts and processes, technical specifications, and best practices is necessary.

">

Required Skills and Qualifications:

">

• Experience in generating data pipelines in Azure ADF

">

• Experience in ingesting data from different sources using Azure ADF

">

• Experience in transforming data using Azure Databricks & Delta lake and Pyspark

">

• Experience in implementing integration solutions in Microsoft Azure

">

• Excellent problem-solving skills

">

• Experience working in agile development projects and sprint delivery

">

• Ability to collaborate with cross-functional teams

">

• Strong analytical and problem-solving skills

">

• Experience with data transformation and cleansing operations

">

• Strong understanding of data architecture and design

">

• Familiarity with cloud-based data platforms

">

Benefits:

">

• Competitive salary package

">

• Opportunities for professional growth and development

">

• Collaborative and dynamic work environment

">

• Comprehensive benefits package

">

• Recognition and rewards for outstanding performance

">

Others:

">

Diverse Lynx LLC is committed to diversity and inclusion in the workplace. We welcome applications from qualified candidates from diverse backgrounds.

">

Please note that all applicants will be evaluated solely on their ability, competence, and proven capability to perform the functions outlined in the corresponding role.

">

We look forward to receiving your application.

">

BEST OF LUCK WITH YOUR APPLICATION


  • Databricks Expert

    3 weeks ago


    Louisville, Kentucky, United States Diverse Lynx Full time

    Diverse Lynx LLC is an Equal Employment Opportunity employer.">">We strive to create a workplace culture that values diversity, equity, and inclusion.">">Salary:">The estimated annual salary for this position is approximately $125,000, considering the location and industry standards.">">Job Description:">Title: Azure Databricks Data Engineer">Location:...

  • Big Data Engineer

    3 weeks ago


    Louisville, Kentucky, United States Diverse Lynx Full time

    Diverse Lynx LLC is an Equal Employment Opportunity employer.">">We are committed to fostering a diverse and inclusive workplace culture.">">Salary:">The estimated annual salary for this position is approximately $140,000, taking into account the location and industry standards.">">Job Description:">Title: Data Engineer - Azure Databricks">Location:...


  • Louisville, Kentucky, United States ApTask Full time

    About the Role:ApTask is seeking an experienced Azure Databricks Engineer to join our team. In this role, you will be responsible for designing and implementing data pipelines in Azure ADF, ingesting data from various sources, and transforming it using Azure Databricks & Delta Lake.Salary Range: $120K-$130K per annum.Key Responsibilities:- Design and...


  • Louisville, Kentucky, United States Centraprise Full time

    About the RoleWe are seeking a skilled Azure Databricks developer to join our team at Centraprise. In this role, you will be responsible for designing and implementing data pipelines in Azure ADF.Main Responsibilities:Design and develop data pipelines in Azure ADFIngest data from various sources using Azure ADFTransform data using Azure Databricks and Deta...


  • Louisville, Kentucky, United States Futran Tech Solutions Pvt. Ltd. Full time

    About the Role: As an Azure Databricks Engineer at Futran Tech Solutions, you will play a critical role in designing and developing data pipelines and infrastructure using Big Data technologies.">Your Key Responsibilities:">">Design and develop data pipelines and infrastructure using Databricks, Hadoop, Cloudera, and other Big Data technologies">Collaborate...


  • Louisville, Kentucky, United States Marsh LLC Full time

    At Marsh McLennan, we're committed to delivering exceptional services and solutions to our clients. Our team of experts works together to provide tailored advice and guidance to help organizations achieve their goals.We're seeking a highly skilled Data Architect for Cloud Solutions to join our IT Data and Analytics Team. As a key member of our team, you will...

  • Big Data Developer

    3 weeks ago


    Louisville, Kentucky, United States Diverse Lynx Full time

    Job Overview:Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote a diverse workforce across all levels in the company and welcome applications from qualified candidates. As a Data Engineer - Cloud Architect, you will play a critical role in shaping our cloud infrastructure and driving business growth through data-driven insights.Key...

  • Azure Data Engineer

    3 weeks ago


    Louisville, Kentucky, United States Diverse Lynx Full time

    **Job Description:**We are seeking an experienced Azure Data Engineer to join our team at Diverse Lynx LLC. This role involves designing, implementing, and maintaining large-scale data pipelines in Azure ADF. The ideal candidate will have a strong background in data engineering, with experience in ingesting data from various sources using Azure ADF.The...


  • Louisville, Kentucky, United States KPMG Full time

    About the RoleThe Technical Lead I, Data Engineering role at KPMG involves managing and supporting projects of various sizes across multiple applications/technologies and related processes. We are seeking a highly skilled professional with a strong background in data engineering and experience with MS Azure.Key Responsibilities:Design, build, and maintain...


  • Louisville, Kentucky, United States Marsh LLC Full time

    About Our CompanyMMA National is a dynamic organization that provides innovative insurance solutions to organizations and individuals. As a Senior Data Engineer on our IT Data and Analytics Team, you will play a critical role in developing and maintaining scalable data pipelines, enhancing data models, and providing subject matter expertise in data...


  • Louisville, Kentucky, United States Simple Solutions Full time

    Job OverviewSynthesize innovative integration solutions to propel Simple Solutions forward.About the RoleWe seek a seasoned Azure Integration Architect to spearhead our cloud-based integration endeavors. As an onsite expert, you will lead the design and development of complex software systems utilizing Microsoft technologies such as C#, .NET, ASP.NET, MVC,...


  • Louisville, Kentucky, United States Maintec Technologies Full time

    Maintec Technologies is looking for a Cloud Solutions Architect to develop applications on Microsoft Azure Platform.Experience in developing cloud-based services and web applications using various Azure tools, including Cloud Services, Web Role, Worker Role, Azure Web App, Azure API App, Azure Storage, Azure SQL, and Azure Functions.Experience with...

  • Senior Data Architect

    3 weeks ago


    Louisville, Kentucky, United States Marsh LLC Full time

    About the RoleWe are seeking an experienced Senior Data Architect to join our team at Marsh McLennan Agency (MMA). As a key member of our IT Data and Analytics Team, you will play a critical role in developing and maintaining scalable data pipelines, enhancing data models, and providing subject matter expertise in data acquisition and consumption pipelines...


  • Louisville, Kentucky, United States Diverse Lynx Full time

    Job Description:In this role, you will design, develop, and maintain data pipelines in Azure ADF and Databricks to support business growth and decision-making. You will collaborate with cross-functional teams to implement Integration solutions in Microsoft Azure and troubleshoot data-related issues. Additionally, you will participate in Agile development...


  • Louisville, Kentucky, United States Diverse Lynx Full time

    Data Engineering PositionWe are looking for an experienced data engineer to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in data engineering and experience working with cloud-based technologies.Responsibilities include:Designing and implementing data pipelines using Azure ADF.Ingesting data from various sources...


  • Louisville, Kentucky, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Summary: We are looking for a highly skilled Azure Databricks Engineer to lead the design and development of large-scale data systems using Big Data technologies.">Key Responsibilities:">">Design and develop data pipelines and infrastructure using Databricks, Hadoop, Cloudera, and other Big Data technologies">Collaborate with cross-functional teams to...


  • Louisville, Kentucky, United States Marsh LLC Full time

    About the CompanyMMA National is an award-winning company with a Top Workplace culture that values collaboration and innovation.We are seeking a highly skilled Senior Data Engineer to join our IT Data and Analytics Team, where you will be responsible for designing and implementing scalable data pipelines, enhancing data models, and providing subject matter...

  • Data Engineer Lead

    3 weeks ago


    Louisville, Kentucky, United States Diverse Lynx Full time

    What You Will DoThis position will require you to work closely with our development team to architect and develop data pipelines using Azure services such as Azure Data Factory and Azure Databricks. Additionally, you will be responsible for ensuring data security and compliance.


  • Louisville, Kentucky, United States Centraprise Full time

    Job ResponsibilitiesThe successful candidate will be responsible for designing, developing, and maintaining complex data pipelines in Azure ADF. They will work closely with cross-functional teams to identify business requirements and implement data solutions that meet those needs.Key Skills and QualificationsExpertise in Azure Databricks...

  • Cloud Data Engineer

    3 weeks ago


    Louisville, Kentucky, United States Futran Tech Solutions Pvt. Ltd. Full time

    Company Overview: Futran Tech Solutions Pvt. Ltd. is a leading technology firm providing innovative solutions to businesses worldwide.">Job Title: Azure Databricks Engineer">Location: Louisville, KY (Onsite)">Duration: Contract">Estimated Salary: $140,000 - $160,000 per annum">Job Description:">We are seeking an experienced Azure Databricks Engineer to join...