Databricks Developer

5 days ago


Chicago, Illinois, United States Diverse Lynx Full time
Job Title: Azure Databricks Developer

We are seeking a highly skilled Azure Databricks Developer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehouse and data lake solutions using Azure Databricks and related tools.

Key Responsibilities:
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate with applications teams and business users to develop new pipelines with cloud data migration methodologies and processes
  • Design and implement data warehouse and data lake solutions using Azure Databricks and related tools
  • Estimate cluster size, monitor, and troubleshoot Spark Databricks clusters
  • Drive analysis, architecture, design, governance, and development of data warehouse, data lake, and business intelligence solutions
Requirements:
  • 8+ years of experience as a developer in Big Data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation
  • Hands-on experience with Azure Data Factory, T-SQL, PySpark, and U-SQL Azure Data Lake Analytics
  • Extensive hands-on experience implementing Lake House architecture using Data Bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
  • Good understanding of Spark architecture with Databricks Structured Streaming, setting up Azure with Databricks, managing clusters in Databricks
  • Excellent interpersonal, verbal, and written communication skills
What We Offer:
  • A dynamic and collaborative work environment
  • Opportunities for professional growth and development
  • A competitive salary and benefits package

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.



  • Chicago, Illinois, United States Databricks Full time

    Position Overview:We are seeking skilled pre-sales specialists with a proven history of assisting large organizations in becoming more data-centric. Collaborating closely with the Account Executive (AE), the Senior Technical Solutions Consultant for Retail and CPG will establish and guide the technical vision for our most significant accounts, fostering...

  • Staff Data Engineer

    1 week ago


    Chicago, Illinois, United States Motion Recruitment Full time

    About the RoleWe are seeking a highly skilled Staff Data Engineer to join our team at Motion Recruitment. As a Staff Data Engineer, you will play a key role in designing and implementing highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.Key ResponsibilitiesDesign and implement technical solutions and...


  • Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperWe are seeking an experienced Azure API Management Developer to join our team at Optime-Tech LLC.About the RoleThe ideal candidate will be responsible for developing, managing, and optimizing APIs within Azure APIM while also managing data workflows and pipelines in a scalable cloud environment.Key...


  • Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperJob Type: Full-timeCompany: Optime-Tech LLCLocation: RemoteAbout the RoleWe are seeking an experienced Azure API Management Developer to join our team. As an Azure API Management Developer, you will be responsible for designing, implementing, and managing APIs within Azure APIM, ensuring secure, scalable, and reliable...

  • Cloud Data Engineer

    2 weeks ago


    Chicago, Illinois, United States Ampcus Full time

    About the RoleWe are seeking an experienced Data Engineer to contribute to a high-volume Electronic Medical Records (EMR) application at Ampcus. This critical system requires ongoing production maintenance and demands enhancements through integration with Machine Learning and Master Data applications.Key ResponsibilitiesDesign, develop, and fine-tune data...


  • Chicago, Illinois, United States Magicforce Full time

    About This RoleWe are seeking a highly skilled Azure Data Engineer with expertise in Medallion Architecture to join our team at Magicforce.Key ResponsibilitiesData Platform Architecture: Design and implement large-scale data and analytics platforms on Azure, leveraging Medallion Architecture to drive business growth.Data Integration and Governance: Develop...


  • Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines using Azure Data Factory, Python, and Databricks.Key Responsibilities:Design and implement data pipelines to efficiently process and transfer dataCollaborate with cross-functional teams to develop solutions using DatabricksDevelop and maintain code in...


  • Chicago, Illinois, United States JLL Full time

    About the RoleWe are seeking an experienced AI & Innovation Development Manager to join our JLL Technologies team. As a key member of our team, you will be responsible for leading the development of innovative solutions for our clients.Key ResponsibilitiesIdentify and evaluate AI and innovation opportunities within our Data & Analytics landscapeCoordinate...

  • Senior Data Engineer

    2 weeks ago


    Chicago, Illinois, United States InterEx Group Full time

    Job Title: Senior Data EngineerLocation: Remote (preference), flexible work arrangementContract term: Contract to HireAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at InterEx Group. The ideal candidate will have a strong background in building data pipelines, utilizing Azure Data Factory, Python, Databricks, and the Azure...


  • Chicago, Illinois, United States DATA MART Consulting GmbH Full time

    About the RoleThe Data Architect will play a key role in designing and implementing data solutions that drive business value for our clients. As a Snowflake expert, you will be responsible for architecting data systems, enhancing data integrity, security, and performance. Your skills in data modeling, database design, and management will be crucial in...

  • IT Sales Professional

    31 seconds ago


    Chicago, Illinois, United States Bitwise Inc Full time

    IT Solution Sales - HunterBitwise, a leading data and analytics consulting firm, is seeking a driven and experienced sales leader to spearhead the growth of our various Services vertical practice. In this pivotal position, you'll play a key role in helping various institutions harness the power of data to unlock competitive advantage, drive strategic...

  • Staff Data Engineer

    5 days ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will play a critical role in designing and implementing efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.Key Responsibilities:Design and implement...

  • Staff Data Engineer

    5 days ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will play a critical role in designing and implementing efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.Key Responsibilities:Design and implement...

  • Senior Data Engineer

    2 weeks ago


    Chicago, Illinois, United States RSN GINFO SOLUTIONS LLC Full time

    Job DescriptionJob Title: Senior Data Engineer - PySpark ExpertJob Type: Contract-to-HireLocation: Remote (with occasional on-site meetings)Duration: 12 months with possible extensionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at RSN GINFO SOLUTIONS LLC. As a Senior Data Engineer, you will be responsible for designing,...


  • Chicago, Illinois, United States Prodigy Resources Full time

    About the RoleWe are seeking a highly skilled Data Insights Leader to join our dynamic data infrastructure and analytics team at Prodigy Resources. In this pivotal role, you will lead the design, development, and maintenance of robust data pipelines, ensuring that data is efficiently processed and presented in intuitive visual formats that empower...


  • Chicago, Illinois, United States Canadian Imperial Bank of Commerce Full time

    Senior Software Engineer - ETL, US Risk TechnologyAt Canadian Imperial Bank of Commerce, we are committed to fostering a relationship-driven banking experience for the contemporary world. We seek skilled and enthusiastic professionals who prioritize integrity and excellence in serving our clients.We value your unique strengths and aspirations, empowering you...


  • Chicago, Illinois, United States Canadian Imperial Bank of Commerce Full time

    Senior Software Engineer - ETL, US Risk TechnologyAt Canadian Imperial Bank of Commerce, we are dedicated to establishing a relationship-driven banking experience for the contemporary landscape. We seek skilled and enthusiastic professionals committed to prioritizing our clients' needs.We value your unique strengths and aspirations, empowering you to thrive...

  • Cloud Engineer Lead

    2 weeks ago


    Chicago, Illinois, United States Northern Trust Corporation Full time

    About Northern Trust Corporation:Northern Trust Corporation, a leading global financial institution, has been a trusted partner for over 130 years, providing innovative financial services and guidance to the world's most successful individuals, families, and institutions.We are committed to delivering exceptional service, expertise, and integrity, while...


  • Chicago, Illinois, United States Northern Trust Corporation Full time

    About Northern Trust Corporation:Northern Trust Corporation, a leading global financial institution, has been a trusted partner for over 130 years, providing innovative financial services and guidance to the world's most successful individuals, families, and institutions.We are committed to delivering exceptional service, expertise, and integrity, while...


  • Chicago, Illinois, United States Northern Trust Corporation Full time

    About Northern TrustNorthern Trust is a globally recognized, award-winning financial institution with a rich history dating back to 1889. As a Fortune 500 company, we provide innovative financial services and guidance to the world's most successful individuals, families, and institutions.Job SummaryWe are seeking a dynamic Senior Lead Cloud Engineer to...