Azure Databricks Admin

3 weeks ago


Minneapolis, United States Avance Consulting Full time
Job DescriptionJob Description

Create and manage Azure Databricks workspaces, Unity Catalog setup allocating resources and configuring settings based on specific needs for all environments (Dev/Test/Prod).

· Design and implement access control mechanisms, user permissions, and security policies to safeguard sensitive data. : 6 to 10 yesr expereince

· Configure and launch Databricks clusters, optimizing performance and cost through effective instance type selection, auto-scaling, and termination policies.

· Monitor cluster health and performance, troubleshoot issues proactively, and adjust configurations as necessary.

· Install and configure libraries, dependencies, and environment variables essential for data engineering and analytics tasks.

· Implement robust security practices, including network security settings, integration with Azure Active Directory, and data encryption.

· Stay informed about security best practices and updates, applying them proactively to maintain a secure environment.

· Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction.

· Analyze cluster performance metrics and implement tuning strategies to ensure optimal query execution times and resource utilization.

· Track system logs and identify potential issues before they impact users or operations.

· Collaborate with data engineers, data scientists, and other stakeholders to understand their analytics needs and translate them into effective configurations.

· Provide technical support to users, troubleshooting issues and resolving technical inquiries.

· Document setup processes, configurations, and troubleshooting steps for future reference and knowledge sharing



  • Minneapolis, United States TCS USAAvance Consulting Full time

             Create and manage Azure Databricks workspaces, Unity Catalog setup allocating resources and configuring settings based on specific needs for all environments (Dev/Test/Prod). ·         Design and implement access control mechanisms, user permissions, and security policies to safeguard sensitive data. : 6 to 10 yesr expereince...


  • Minneapolis, United States Tata Consultancy Services Full time

    Create and manage Azure Databricks workspaces, Unity Catalog setupallocating resources and configuring settings based on specific needs for allenvironments (Dev/Test/Prod). •Design and implement access control mechanisms, userpermissions, and security policies to safeguard sensitive data. : 6 to 10yesr expereince •Configure and launch Databricks...


  • Minneapolis, Minnesota, United States Insight Global Full time

    We are seeking a REMOTE Data Engineer to join the Digital Marketing team at a large provider/payor.Design, develop, and implement end-to-end data solutions using Azure Databricks and other relevant technologies.3+ years of most-recent experience as a Data Engineer in an Azure, not AWS, environment, building code, and QA'ing it.Strong experience with Azure...

  • Data Engineer

    2 days ago


    Minneapolis, United States Marvel Technologies Inc Full time

    Job DescriptionJob DescriptionLocation: Minneapolis, MN (Hybrid Role)Rate: Open - best possible rateDuration: Long Term.Start Date: 05.27.2024Core skills required Azure Cloud Azure Data Factory Databricks Azure SQL Python or same/similar scripting for automation A few things that he did mention that he would like on the "Wish List": Azure Services/Azure...

  • Linux/Windows Admin

    2 weeks ago


    Minneapolis, United States C4 Technical Services Full time

    Linux/Windows Admin Plymouth MNLinux Skills Redhat 7 and 8 Ansible Realm Bash or some other form of scripting Gitlab Windows Skills Active Directory User/Groups/OU/Delegation GPO DNS Certificates - obtain and deploy IIS PowerShell Server OS 2008rw - Server 2019 NTFS and Share Permission/DFS Working knowledge of Microsoft SQL including executing scripts,...

  • Linux/Windows Admin

    3 days ago


    Minneapolis, United States C4 Technical Services Full time

    Linux/Windows Admin Plymouth MNLinux Skills Redhat 7 and 8 Ansible Realm Bash or some other form of scripting Gitlab Windows Skills Active Directory User/Groups/OU/Delegation GPO DNS Certificates - obtain and deploy IIS PowerShell Server OS 2008rw - Server 2019 NTFS and Share Permission/DFS Working knowledge of Microsoft SQL including executing scripts,...

  • System Admin

    2 weeks ago


    Minneapolis, United States C4 Technical Services Full time

    Linux/Windows Admin Plymouth MNLinux Skills Redhat 7 and 8 Ansible Realm Bash or some other form of scripting Gitlab Windows Skills Active Directory User/Groups/OU/Delegation GPO DNS Certificates - obtain and deploy IIS PowerShell Server OS 2008rw - Server 2019 NTFS and Share Permission/DFS Working knowledge of Microsoft SQL including executing scripts,...

  • Sr. Data Engineer

    2 weeks ago


    Minneapolis, United States Improving Full time

    Sr. Data Engineer (Cloud) Description As a Data Engineer, you'll be working with the latest cloud and technology stacks to help clients implement and mature their modern data architecture. You will work with tools/platforms like Kafka, Snowflake, and Databricks to help clients get the most out of their data that may be in systems like Salesforce, SAP, SQL...

  • Azure DevOps Engineer

    2 weeks ago


    Minneapolis, United States C4 Technical Services Full time

    Infrastructure DevOps Engineer Location: Remote or Hybrid (MN or Lenexa, KS) The Infrastructure DevOps Engineer role will work to provision and maintain reliable and repeatable cloud infrastructure for business applications. The role will use an infrastructure as code approach to secure cloud resources and application registrations and permissions within...

  • Sr Data Architect

    2 weeks ago


    Minneapolis, United States Diverse Lynx Full time

    Role: Sr Data Architect Location: Minneapolis, MN - Onsite Type: Fulltime / permanentSkill Data Architecture and Modeling Minimum Experience 8 - 10 Years Job description: Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. Should be hands on engineer with experience in multiple data...

  • Sr Data Architect

    3 days ago


    Minneapolis, United States Diverse Lynx Full time

    Role: Sr Data Architect Location: Minneapolis, MN - Onsite Type: Fulltime / permanentSkill Data Architecture and Modeling Minimum Experience 8 - 10 Years Job description: Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. Should be hands on engineer with experience in multiple data...


  • Minneapolis, United States Inspire11 Full time

    DATA ARCHITECT Inspire11 is a full-service consulting firm that helps clients reach their full potential by getting closer to their customers, their employees, and their communities. Utilizing innovative and strategic thought with technology to bring change and disruption to life. Our team partners with technology leaders to help them strategize and execute...


  • Minneapolis, United States The Dignify Solutions LLC Full time

    • Bachelor's degree or equivalent combination of education and experience • 5+ years of related experience a must • Good technical consulting skills, analytical and problem solving skills to troubleshoot systems problems • Must be resourceful, self-starter, maintain skill set; aptitude to evaluate / become proficient in new technologies, processes...


  • Minneapolis, United States OneNet Global Full time

    Job DescriptionJob DescriptionSales Support/Admin will carry out administrative duties that help the sales team run smoothly.Responsibilities:Monitor pricing requests in CHR systemAssign requests as neededEnsure requests are addressed in a timely manner (SLA 24 hours)Follow up with responsible parties as appropriate (vendors, sales, operations,...


  • Minneapolis, United States C4 Technical Services Full time

    Web Application Developer Location: Offshore The Web Application Developer role will work to transform the organization's portfolio of web applications through best practices and ensure the timely and successful deployment of new features. This individual will apply proven communication and problem-solving skills to guide and assist the web applications...


  • Minneapolis, United States C4 Technical Services Full time

    Web Application Developer Location: Offshore The Web Application Developer role will work to transform the organization's portfolio of web applications through best practices and ensure the timely and successful deployment of new features. This individual will apply proven communication and problem-solving skills to guide and assist the web applications...