Current jobs related to Senior Azure Databricks Developer - Chicago, Illinois - Siri InfoSolutions Inc

  • Databricks Developer

    7 days ago

    Chicago, Illinois, United States Diverse Lynx Full time

    Job Title: Azure Databricks DeveloperWe are seeking a highly skilled Azure Databricks Developer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehouse and data lake solutions using Azure Databricks and related tools.Key Responsibilities:Develop and...

  • Azure API Management Developer

    4 days ago

    Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperWe are seeking an experienced Azure API Management Developer to join our team at Optime-Tech LLC.About the RoleThe ideal candidate will be responsible for developing, managing, and optimizing APIs within Azure APIM while also managing data workflows and pipelines in a scalable cloud environment.Key...

  • Azure API Management Developer

    1 week ago

    Chicago, Illinois, United States Optime-Tech LLC Full time

    Job Title: Azure API Management DeveloperJob Type: Full-timeCompany: Optime-Tech LLCLocation: RemoteAbout the RoleWe are seeking an experienced Azure API Management Developer to join our team. As an Azure API Management Developer, you will be responsible for designing, implementing, and managing APIs within Azure APIM, ensuring secure, scalable, and reliable...

  • Senior Technical Solutions Consultant, Retail Sector

    4 weeks ago

    Chicago, Illinois, United States Databricks Full time

    Position Overview:We are seeking skilled pre-sales specialists with a proven history of assisting large organizations in becoming more data-centric. Collaborating closely with the Account Executive (AE), the Senior Technical Solutions Consultant for Retail and CPG will establish and guide the technical vision for our most significant accounts, fostering...

  • Senior Data Engineer

    5 days ago

    Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines using Azure Data Factory, Python, and Databricks.Key Responsibilities:Design and implement data pipelines to efficiently process and transfer dataCollaborate with cross-functional teams to develop solutions using DatabricksDevelop and maintain code in...

  • Azure Data Engineer With Medallion

    2 weeks ago

    Chicago, Illinois, United States Magicforce Full time

    About This RoleWe are seeking a highly skilled Azure Data Engineer with expertise in Medallion Architecture to join our team at Magicforce.Key ResponsibilitiesData Platform Architecture: Design and implement large-scale data and analytics platforms on Azure, leveraging Medallion Architecture to drive business growth.Data Integration and Governance: Develop...

  • Senior Data Engineer

    2 weeks ago

    Chicago, Illinois, United States InterEx Group Full time

    Job Title: Senior Data EngineerLocation: Remote (preference), flexible work arrangementContract term: Contract to HireAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at InterEx Group. The ideal candidate will have a strong background in building data pipelines, utilizing Azure Data Factory, Python, Databricks, and the Azure...

  • Senior Data Engineer

    2 weeks ago

    Chicago, Illinois, United States RSN GINFO SOLUTIONS LLC Full time

    Job DescriptionJob Title: Senior Data Engineer - PySpark ExpertJob Type: Contract-to-HireLocation: Remote (with occasional on-site meetings)Duration: 12 months with possible extensionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at RSN GINFO SOLUTIONS LLC. As a Senior Data Engineer, you will be responsible for designing,...

  • Senior Data Engineer

    5 days ago

    Chicago, Illinois, United States InterEx Group Full time

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our Data Team within the IT department of a leading consumer goods company. As a Senior, you will have the opportunity to mentor junior data engineers and contribute to the development of our data infrastructure.The ideal candidate will have a strong background in...

  • Senior Data Architect

    1 week ago

    Chicago, Illinois, United States Top Prospect Group Full time

    Job Summary:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team at Top Prospect Group. The ideal candidate will have a strong background in SQL and extensive experience with Microsoft Azure.Key Responsibilities:Design, develop, and maintain robust and scalable data pipelines using SQL and Azure.Implement ETL...

  • Senior Java Developer with Azure Expertise

    3 weeks ago

    Chicago, Illinois, United States Cognizant Full time

    About the RoleCognizant is seeking a highly skilled and innovative Senior Java Developer with expertise in Azure to join our team. As a key member of our team, you will be responsible for designing and developing cutting-edge, cloud-based software that powers modern business.Key ResponsibilitiesProvide technical roadmaps and solutions for project...

  • Senior SQL Database Administrator

    4 days ago

    Chicago, Illinois, United States 1872 Consulting Full time

    Job Title: Senior SQL Database AdministratorWe are seeking a highly skilled Senior SQL Database Administrator to join our team at 1872 Consulting. As a key member of our IT department, you will be responsible for maintaining the operations of our databases and DBMSs, ensuring the security and integrity of our data.Key Responsibilities:Maintain operations of...

  • Azure Data Engineer

    2 weeks ago

    Chicago, Illinois, United States Tanu Infotech Inc Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Tanu Infotech Inc. as a Senior Data Engineer - Cloud Computing Expert.Key ResponsibilitiesDesign and implement optimal data pipeline architecture to ensure efficient data processing and analysis.Analyze and organize raw data to extract valuable insights and inform business...

  • Senior Technology Engineer

    4 weeks ago

    Chicago, Illinois, United States Canadian Imperial Bank of Commerce Full time

    Senior Software Engineer - ETL, US Risk TechnologyAt Canadian Imperial Bank of Commerce, we are committed to fostering a relationship-driven banking experience for the contemporary world. We seek skilled and enthusiastic professionals who prioritize integrity and excellence in serving our clients.We value your unique strengths and aspirations, empowering you...

  • Senior Azure Cloud Solutions Architect

    4 weeks ago

    Chicago, Illinois, United States Enterprise Performance Group Full time

    Job OverviewThe Senior Azure Cloud Solutions Architect will be responsible for shaping the cloud strategy and architecture for our organization.Key Responsibilities:Establishing architectural policies, standards, and governance frameworks to align with strategic objectives.Collaborating with vendors to enforce policies and procedures effectively.Defining the...

  • Senior Azure Reliability Engineer

    4 weeks ago

    Chicago, Illinois, United States Jobot Full time

    Remote Azure Site Reliability Engineer OpportunityThis position is hosted by Jobot Consulting.About Us:We are a dynamic tech consulting firm seeking a Senior Cloud Site Reliability Engineer with a strong background in Azure Cloud. In this role, you will play a key part in implementing Site Reliability Engineering (SRE) practices across our enterprise...

  • Senior Software Engineer

    5 days ago

    Chicago, Illinois, United States Servicenow Full time

    About Digital TechnologyWe're redefining what it means to be IT with a mindset centered on transformation, experience, AI-driven automation, innovation, and growth. Our team is focused on accelerating innovations and developing new concepts, forward-thinking solutions and products leveraging ServiceNow's Intelligent platform.We're not just building software,...

  • Senior Data Quality Analyst

    2 days ago

    Chicago, Illinois, United States 84.51 Full time

    Senior Data Quality Analyst84.51° is a retail data science, insights, and media company that helps The Kroger Co., consumer packaged goods companies, agencies, publishers, and affiliates create personalized experiences for shoppers. As a Senior Data Quality Analyst, you will be responsible for ensuring the accuracy and reliability of our data assets.Key...

  • Senior SQL Database Administrator

    5 days ago

    Chicago, Illinois, United States 1872 Consulting Full time

    Job SummaryWe are seeking a highly skilled Sr SQL DBA to join our team at 1872 Consulting. As a key member of our database management team, you will be responsible for maintaining the integrity and performance of our cloud-based database systems.Key ResponsibilitiesMaintain operations of databases and DBMSs, ensuring optimal performance and security.Develop...

  • IT Sales Professional

    3 days ago

    Chicago, Illinois, United States Bitwise Inc Full time

    IT Solution Sales - HunterBitwise, a leading data and analytics consulting firm, is seeking a driven and experienced sales leader to spearhead the growth of our various Services vertical practice. In this pivotal position, you'll play a key role in helping various institutions harness the power of data to unlock competitive advantage, drive strategic...

Senior Azure Databricks Developer

3 months ago

Chicago, Illinois, United States Siri InfoSolutions Inc Full time
Job DescriptionJob Description

Position:

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location: Chicago, IL

Job Description

  • Overall 10+ years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using spark-SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Extract, transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Pyspark and U-SQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks
  • Hands on experience on developing SQL scripts for automation
  • Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
  • Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing clusters in Databricks
  • Excellent interpersonal, verbal, and written communication skills
  • Bachelor's degree or equivalent work experience
  • Responsible for estimating the cluster size, monitoring and troubleshooting of spark databrick cluster
  • Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions
  • Research, synthesize, recommend, and select technical approaches for solving difficult migration, development, and integration problems
  • Conduct and support workshops, design sessions, and project meetings as needed, playing a key role in client relations
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc
  • Experience working in agile development projects and sprint deliver