Azure Databrick Engineer

2 weeks ago


Louisville, Kentucky, United States Diverse Lynx Full time
Job Title: Azure Databrick Engineer

Location: Louisville, KY

Duration: Contract

DESCRIPTION:
  • The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
  • Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.
  • Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
  • The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams.
  • Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements
  • Drive technology and business transformation through the creation of the Azure Data Lake
  • Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
  • Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio
Required Skills
  • 10+ / 7+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Clouder
  • 3 + / 2+ years working experience in Databricks (essential) and Python
  • Experience with Cloud / Azure architectural components
  • Experience building data pipelines and infrastructure
  • Deep understanding of Data warehousing concepts, reporting and Analytical concepts
  • Experience with Big Data tech stack, including Hadoop, Java, Spark, Scala, and Hive, NoSQL data stores
  • Bachelors degree in Mathematics, Physical Sciences, Engineering or Computer Science
Nice to Have skills
  • Experience in leading design and development of large systems
  • Demonstrates strong drive to learn and advocate for development best practices
  • Proven track record of building and delivering enterprise-class products
  • Full Stack Experience (End to End Development)
  • Crisp and effective executive communication skills, including significant experience presenting cross-functionally and across all levels
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Louisville, Kentucky, United States Diverse Lynx Full time

    Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory SkillsTechnical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS) Azure Storages like ADLS Gen2, Azure Postgresql . CI/CD, Enterprise...


  • Louisville, Kentucky, United States Diverse Lynx Full time

    JC/Req ID Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS)Azure Storages like ADLS Gen2, Azure Postgresql .CI/CD,...


  • Louisville, Kentucky, United States Cognizant Technology Solutions Full time

    Senior Net Full Stack Engineer with AzureCognizant's Digital Engineering practice is seeking a qualified Full Stack Engineers with experience developing and building strong enterprise applications. You will be part of a digital software team that works on high-demand applications. Our engineers have a passion for high-quality, reliable and maintainable code....


  • Louisville, Kentucky, United States Cognizant Technology Solutions Full time

    Senior Net Full Stack Engineer with AzureCognizant's Digital Engineering practice is seeking a qualified Full Stack Engineers with experience developing and building strong enterprise applications. You will be part of a digital software team that works on high-demand applications. Our engineers have a passion for high-quality, reliable and maintainable code....


  • Louisville, Kentucky, United States Arcfield Full time

    Overview Arcfield is a leading provider of full lifecycle, mission-focused systems engineering and integration capabilities to the U.S. government and its allies. The company has more than 60 years of proven experience providing advanced engineering and analysis, IT and C5ISR capabilities to support our nation's most critical national security missions....


  • Louisville, Kentucky, United States CrowdStrike Full time

    About the Role:Organizations are scaling their data environments at an increasing rate, leaving massive gaps in visibility into activity on endpoints, in particular knowing what endpoints are there to begin with These evolving, heterogeneous environments are immensely difficult to protect because there's no single-pane-of-glass visibility clarifying what...


  • Louisville, Kentucky, United States CrowdStrike, Inc. Full time

    About the Role: Organizations are scaling their data environments at an increasing rate, leaving massive gaps in visibility into activity on endpoints, in particular knowing what endpoints are there to begin with These evolving, heterogeneous environments are immensely difficult to protect because there's no single-pane-of-glass visibility clarifying what...


  • Louisville, Kentucky, United States CrowdStrike, Inc. Full time

    About the Role: Organizations are scaling their data environments at an increasing rate, leaving massive gaps in visibility into activity on endpoints, in particular knowing what endpoints are there to begin with These evolving, heterogeneous environments are immensely difficult to protect because there's no single-pane-of-glass visibility clarifying what...

  • Data Engineer

    1 week ago


    Louisville, Kentucky, United States V-Soft Consulting Group Full time

    Data Engineer Primary Location: Louisville, Kentucky V-Soft Consulting is currently hiring for a Data Engineer for our premier client in Louisville, Kentucky. Education and Experience " Bachelor's degree in computer science, computer engineering, or information systems. Over two years of experience in the use of SQL (T-SQL preferred). Over two...

  • Data Engineer

    1 week ago


    Louisville, Kentucky, United States Congo Brands Full time

    Our Company: Congo Brands is at the epicenter of where consumer demand meets product development. Through brand partnerships with lead influencers, we are afforded an inside look at what consumers truly desire. E-commerce becomes the laboratory for consumer feedback and serves as a data pool for future retail endeavors. Congo Brands is a health and...


  • Louisville, Kentucky, United States MMC Corporate Full time

    Marsh McLennan is seeking a highly skilled, motivated Linux System Engineer to join our dynamic team. This role can be located in the Louisville Kentucky area or out of one of the other offices in the US.What can you expect? Participate in application operations management in Linux systems, running UNIX commands to administrate PROD and non-PROD application...


  • Louisville, Kentucky, United States MMC Corporate Full time

    Marsh McLennan is seeking a highly skilled, motivated Linux System Engineer to join our dynamic team. This role can be located in the Louisville Kentucky area or out of one of the other offices in the US.What can you expect? Participate in application operations management in Linux systems, running UNIX commands to administrate PROD and non-PROD application...


  • Louisville, Kentucky, United States Equus Full time

    Cloud Operations Manager Company: Equus Workforce Solutions Our operational team members aim to efficiently meet the needs of our clients across various lines of business. If your passion is to ensure quality care and help our clients live their best life, we encourage you to join our team. Purpose: The organization's Information Technology requires a team...


  • Louisville, Kentucky, United States Toyota Material Handling Full time

    Position Summary:Is this your next job Read the full description below to find out, and do not hesitate to make an application.The Embedded Software Development Supervisor will be responsible for managing a team of embedded firmware developers with a team size of up to 8. This team will be responsible for creating requirements, developing code, creating and...


  • Louisville, Kentucky, United States Belcan Full time

    Senior Software SpecialistJob Number: 349243Category:Software & Systems SBUDescription: Belcan is seeking a highly skilled and experienced Senior Software Specialist with a focus on network support and database/data tools to join our dynamic team in Denver, CO. In this role, you will be responsible for providing comprehensive support in network...

  • Systems Architect

    4 weeks ago


    Louisville, Kentucky, United States Churchill Downs Incorporated Full time

    SUMMARY:Reporting to the Sr. Director of System Operations, the Systems Architect role will lead the initiative on designing and developing an enterprise-wide strategy for scalability, integration, disaster recovery, and business continuity. The Systems Architect will play a critical role in designing, building, and documenting resilient system and...

  • Systems Architect

    2 months ago


    Louisville, Kentucky, United States Churchill Downs Incorporated Full time

    SUMMARY:Reporting to the Sr. Director of System Operations, the Systems Architect role will lead the initiative on designing and developing an enterprise-wide strategy for scalability, integration, disaster recovery, and business continuity. The Systems Architect will play a critical role in designing, building, and documenting resilient system and...

  • System Administrator

    2 weeks ago


    Louisville, Kentucky, United States Currency Exchange International Full time

    Currency Exchange International (CXI) is a Financial Services and Technology Provider based in Orlando, Florida. Currency Exchange International, Corp. is a publicly traded company on the Toronto Stock Exchange (CXI) and OTC (CURN). CXI provides a wide range of foreign exchange services to customers in both the United States and in Canada. CXIs primary...


  • Louisville, United States Diverse Lynx Full time

    Job Role: Azure Databricks Engineer Location: : Louisville, KY (day 1 onsite) Client: Wipro Duration: Contract Job Description: The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and...


  • Louisville, United States Diverse Lynx Full time

    Job Role: Azure Databricks Engineer Location: : Louisville, KY (day 1 onsite) Client: Wipro Duration: Contract Job Description: The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and...


  • Louisville, United States Diverse Lynx Full time

    Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS) Azure Storages like ADLS Gen2, Azure Postgresql . CI/CD, Enterprise...


  • Louisville, United States Diverse Lynx Full time

    JC/Req ID Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS) Azure Storages like ADLS Gen2, Azure...


  • Louisville, United States Diverse Lynx Full time

    JC/Req ID Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS) Azure Storages like ADLS Gen2, Azure...


  • Louisville, United States Diverse Lynx Full time

    Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS) Azure Storages like ADLS Gen2, Azure Postgresql . CI/CD, Enterprise...


  • Louisville, United States Diverse Lynx Full time

    Role : DataBricks Technical Lead Location : Louisville ,Kentucky (Day 1 onsite) Num of Positions : 1 Required SKills : Must Have/Mandatory Skills: Minimum 9+ years of experience in the IT/Technology and having atleast 3+ years of experience in Azure Databricks Hands on experience in development of Azure cloud DWH & datalakes using Azure...

  • Cloud Engineer

    4 weeks ago


    Louisville, United States Brooksource Full time

    Azure EngineerBrooksourceFortune 50 Healthcare ClientRemoteDo you see your next career move taking you to a Fortune 50 healthcare company? Do you aspire to work in a dynamic, high-energy, agile environment? If you feel these words describe your ideal career opportunity, we may have the position for you!Our client is looking for an Azure Engineer to join...

  • Cloud Engineer

    1 month ago


    Louisville, United States Brooksource Full time

    Azure EngineerBrooksourceFortune 50 Healthcare ClientRemoteDo you see your next career move taking you to a Fortune 50 healthcare company? Do you aspire to work in a dynamic, high-energy, agile environment? If you feel these words describe your ideal career opportunity, we may have the position for you!Our client is looking for an Azure Engineer to join...

  • Azure Network Engineer

    2 months ago


    Louisville, United States Equus Full time

    Job DescriptionJob DescriptionCompany DescriptionOur operational team members focus on efficiently meeting the needs of our clients across various lines of business. If your passion is to ensure quality care to help our clients live their best life we encourage you to apply today!Job DescriptionPURPOSE The organization's Information Technology requires a...


  • Louisville, United States Equus Full time

    Job DescriptionJob DescriptionCompany DescriptionOur operational team members focus on efficiently meeting the needs of our clients across various lines of business. If your passion is to ensure quality care to help our clients live their best life we encourage you to apply today!Job DescriptionPURPOSE The organization's Information Technology requires a...

  • Senior Data Engineer

    1 month ago


    Louisville, United States Marsh McLennan Companies Full time

    Description: Our not-so-secret sauce. Award-winning, inclusive, Top Workplace culture doesn’t happen overnight. It’s a result of hard work by extraordinary people. More than 10, of the industry’s brightest talent drive our efforts to deliver purposeful work and meaningful impact every day. Learn more about what makes us different and how you...

  • Senior Data Engineer

    4 weeks ago


    Louisville, United States Marsh McLennan Companies Full time

    Description: Our not-so-secret sauce. Award-winning, inclusive, Top Workplace culture doesn’t happen overnight. It’s a result of hard work by extraordinary people. More than 10, of the industry’s brightest talent drive our efforts to deliver purposeful work and meaningful impact every day. Learn more about what makes us different and how you...


  • Louisville, United States Crowe Full time

    Your Journey at Crowe Starts Here: At Crowe, you have the opportunity to deliver innovative solutions to today's complex business issues. Crowe's accounting, consulting, and technology personnel are widely recognized for their in-depth expertise and understanding of sophisticated process frameworks and enabling technologies, along with their commitment to...

  • Cloud Engineer Azure

    2 months ago


    Louisville, United States Equus Full time

    Job DescriptionJob DescriptionCompany DescriptionOur operational team members focus on efficiently meeting the needs of our clients across various lines of business. If your passion is to ensure quality care to help our clients live their best life we encourage you to apply today!Job DescriptionPURPOSE The organization's Information Technology requires a...

  • Cloud Engineer Azure

    4 weeks ago


    Louisville, United States Equus Full time

    Job DescriptionJob DescriptionCompany DescriptionOur operational team members focus on efficiently meeting the needs of our clients across various lines of business. If your passion is to ensure quality care to help our clients live their best life we encourage you to apply today!Job DescriptionPURPOSE The organization's Information Technology requires a...


  • Louisville, United States Tata Consultancy Services Full time

    Azure, .net, Csharp, .netcore, Devops, NVC, Asp.net, Sql, •Experience or knowledge of Product-orientedDesign, Agile and DevOps methodologiesMySQL,Python, C++, C, PL/SQL, NoSQL, T-SQL, MicrosoftSQL Server, MySQL, Oracle, Cosmos DB, AzureData Lake, Azure Synapse, Azure SQL DB, Event hub, data factory,dbt, Azure databricks, Azure Monitor service,...

  • Data Engineer

    3 weeks ago


    Louisville, United States Brooksource Full time

    *POSITION: *Data Engineer *REPORTS TO: * CIO *FORMAT:* 6 month Contract to Hire *LOCATION: *90%Remote // Onsite presence 2x / month (Expensed) *SCOPE: *Wasteologys goal is to cultivate a soulful culture that results in a positive and professional environment, which motivates our employees to be the best they can be each day. Wasteology strives to create...

  • Data Engineer

    3 weeks ago


    Louisville, United States Brooksource Full time

    *POSITION: *Data Engineer *REPORTS TO: * CIO *FORMAT:* 6 month Contract to Hire *LOCATION: *90%Remote // Onsite presence 2x / month (Expensed) *SCOPE: *Wasteology’s goal is to cultivate a soulful culture that results in a positive and professional environment, which motivates our employees to be the best they can be each day. Wasteology strives to create...

  • Senior Cloud Engineer

    4 weeks ago


    Louisville, United States Equus Full time

    Job DescriptionJob DescriptionCompany DescriptionThe organization's Information Technology operations depend heavily on cloud based resources. This role, a Cloud Engineers plays a crucial role in helping organizations leverage the benefits of cloud computing, such as scalability, flexibility, and cost-efficiency, while ensuring the security and...