Current jobs related to Senior Azure Databricks Developer - Chicago - Avance Consulting

  • Databricks Developer

    5 days ago

    Chicago, Illinois, United States Diverse Lynx Full time

    Job Title: Azure Databricks DeveloperWe are seeking a highly skilled Azure Databricks Developer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehouse and data lake solutions using Azure Databricks and related tools.Key Responsibilities:Develop and...

  • Azure Databricks Cloud Data Architect

    1 month ago

    Chicago, United States Itl Usa Full time

    Job description Infosys is seeking an Azure Databricks Cloud Data Architect.Required Qualifications:Candidate must be located within commuting distance of Chicago, IL or be willing to relocate to this location.At least 7 years of Information Technology experienceHands on experience in architecting Cloud data solutions using Azure Synapse, Databricks, Python,...

  • Azure API Management Developer

    1 day ago

    Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperWe are seeking an experienced Azure API Management Developer to join our team at Optime-Tech LLC.About the RoleThe ideal candidate will be responsible for developing, managing, and optimizing APIs within Azure APIM while also managing data workflows and pipelines in a scalable cloud environment.Key...

  • Azure API Management Developer

    1 week ago

    Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperJob Type: Full-timeCompany: Optime-Tech LLCLocation: RemoteAbout the RoleWe are seeking an experienced Azure API Management Developer to join our team. As an Azure API Management Developer, you will be responsible for designing, implementing, and managing APIs within Azure APIM, ensuring secure, scalable, and reliable...

  • Senior Technical Solutions Consultant, Retail Sector

    3 weeks ago

    Chicago, Illinois, United States Databricks Full time

    Position Overview:We are seeking skilled pre-sales specialists with a proven history of assisting large organizations in becoming more data-centric. Collaborating closely with the Account Executive (AE), the Senior Technical Solutions Consultant for Retail and CPG will establish and guide the technical vision for our most significant accounts, fostering...

  • Senior Data Engineer

    3 days ago

    Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines using Azure Data Factory, Python, and Databricks.Key Responsibilities:Design and implement data pipelines to efficiently process and transfer dataCollaborate with cross-functional teams to develop solutions using DatabricksDevelop and maintain code in...

  • Azure Data Engineer With Medallion

    2 weeks ago

    Chicago, Illinois, United States Magicforce Full time

    About This RoleWe are seeking a highly skilled Azure Data Engineer with expertise in Medallion Architecture to join our team at Magicforce.Key ResponsibilitiesData Platform Architecture: Design and implement large-scale data and analytics platforms on Azure, leveraging Medallion Architecture to drive business growth.Data Integration and Governance: Develop...

  • Azure Sr. Data Engineer

    2 weeks ago

    Chicago, United States Cyclotron, Inc. Full time

    Job DescriptionJob DescriptionSr. Data EngineerLevel: SeniorDepartment: AzureLocation: Anywhere in US or Canada (fully remote)Type: FTE  GENERAL DESCRIPTION & RESPONSIBILITIES The Sr. Azure Data Engineer will lead the creation of high-value data driven solutions leveraging Cyclotron’s proven implementation methodology and solutions for enterprise...

  • Azure Data Architect with Medallion Architecture Exp

    2 weeks ago

    Chicago, United States Magicforce Full time

    As a Data Architect you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards. Responsibilities: Design and architect scalable highperformance and costeffective cloudbased solutions using Azure services and Databricks. Develop comprehensive...

  • Senior Data Engineer

    4 months ago

    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Senior Data Engineer

    2 weeks ago

    Chicago, Illinois, United States InterEx Group Full time

    Job Title: Senior Data EngineerLocation: Remote (preference), flexible work arrangementContract term: Contract to HireAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at InterEx Group. The ideal candidate will have a strong background in building data pipelines, utilizing Azure Data Factory, Python, Databricks, and the Azure...

  • Azure Data Engineer With Medallion

    2 weeks ago

    Chicago, United States Magicforce Full time

    12 years of experience in implementing large data and analytics platforms. Deep experience architecting and building data platforms on Azure with strong experience on Medallion Architecture Experience architecting and building data platforms on Databricks from scratch. Proficient in all Databricks engineering services Unity Catalog Spark Jobs Delta Live...

  • Azure Data Engineer with Medallion Exp

    2 weeks ago

    Chicago, United States Magicforce Full time

    Strong data management foundation and specialized skills in Azure cloud computing Strong experience on Medallion Architecture Experience with Azure data storage solutions such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage Knowledge of data integration tools such as Azure Data Factory and Azure Databricks Understanding of data modelling...

  • Azure Data Architect with Medallion ExpDay 1 onsite

    2 weeks ago

    Chicago, United States Magicforce Full time

    Sr. Azure Data Engineer Lead DataBricks ADF Medallion Architecture As an Sr.Data Engineer Lead you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards . Responsibilities: 15 years of experience in implementing large data and analytics platforms. Deep...

  • Senior Data Engineer PySpark

    3 weeks ago

    Chicago, United States RSN GINFO SOLUTIONS LLC Full time

    Position: Senior Data Engineer (PySpark, Spark, SQL CI/CD, Databricks) Location: Chicago, IL (Onsite role 5 days every week) – Local resources required Duration: 12 Months with possible extension Employment Type: C2C Onsite: They want the candidate to come into their office in Westmont, IL. The candidate should be in Chicago (1st Preference) or...

  • Senior Data Engineer

    2 weeks ago

    Chicago, Illinois, United States RSN GINFO SOLUTIONS LLC Full time

    Job DescriptionJob Title: Senior Data Engineer - PySpark ExpertJob Type: Contract-to-HireLocation: Remote (with occasional on-site meetings)Duration: 12 months with possible extensionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at RSN GINFO SOLUTIONS LLC. As a Senior Data Engineer, you will be responsible for designing,...

  • Senior Data Engineer

    3 months ago

    Chicago, United States InterEx Group Full time

    Senior Data Engineer - Consumer GoodsTech Stack: Senior Data Engineer, Python, Azure Data Warehouse, Azure Databricks, Azure Synapse, PowerBIWe have an opening for a Senior Data Engineer (Azure Databricks, Azure Synapse, PowerBI) to join a high-performing Data Team within an IT department of 1050 heads. As a Senior, you will have the opportunity to mentor a...

  • Senior Data Engineer

    3 months ago

    Chicago, United States InterEx Group Full time

    Senior Data Engineer - Consumer GoodsTech Stack: Senior Data Engineer, Python, Azure Data Warehouse, Azure Databricks, Azure Synapse, PowerBIWe have an opening for a Senior Data Engineer (Azure Databricks, Azure Synapse, PowerBI) to join a high-performing Data Team within an IT department of 1050 heads. As a Senior, you will have the opportunity to mentor a...

  • Senior Data Engineer

    3 days ago

    Chicago, Illinois, United States InterEx Group Full time

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our Data Team within the IT department of a leading consumer goods company. As a Senior, you will have the opportunity to mentor junior data engineers and contribute to the development of our data infrastructure.The ideal candidate will have a strong background in...

  • Senior Data Architect

    7 days ago

    Chicago, Illinois, United States Top Prospect Group Full time

    Job Summary:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team at Top Prospect Group. The ideal candidate will have a strong background in SQL and extensive experience with Microsoft Azure.Key Responsibilities:Design, develop, and maintain robust and scalable data pipelines using SQL and Azure.Implement ETL...

Senior Azure Databricks Developer

4 months ago

Chicago, United States Avance Consulting Full time
Job DescriptionJob Description

Job Description

• Overall 10+ years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems

• Experience in developing Spark applications using spark-SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns

• Extract, transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Pyspark and U-SQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks

• Hands on experience on developing SQL scripts for automation

• Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog

• Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing clusters in Databricks

• Excellent interpersonal, verbal, and written communication skills

• Bachelor’s degree or equivalent work experience



• Responsible for estimating the cluster size, monitoring and troubleshooting of spark databrick cluster

• Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions

• Research, synthesize, recommend, and select technical approaches for solving difficult migration, development, and integration problems

• Conduct and support workshops, design sessions, and project meetings as needed, playing a key role in client relations

• Develop and optimize ETL processes using Databricks and related tools like Apache Spark

• Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc

• Experience working in agile development projects and sprint deliver