AWS Databricks Administrator

4 weeks ago

Minneapolis, United States Ender-IT Full time

AWS Databricks Administrator /Engineer

Location: Minneapolis, MN

Duration: 3 Months+ Contract to hire


No sponsorship available


AWS Databricks Administrator /Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. Collaborating with data engineers, data scientists, and stakeholders, you’ll ensure the platform aligns with requirements while maintaining security and performance standards.

Job Description:

  • Configure, deploy and maintain Databricks clusters and workspaces.
  • Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources. Ensure consistency and repeatability by treating infrastructure as code
  • Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
  • Implement and manage access controls and security policies to protect sensitive data.
  • Manage platform feature and software releases and updates.
  • Provide technical support to Databricks users, including troubleshooting and issue resolution.
  • Conduct training sessions to educate users on platform best practices and capabilities.
  • Optimize cluster configurations for performance and cost-effectiveness.
  • Monitor and manage auto-scaling to ensure resources are allocated efficiently.
  • Implement and enforce security policies, access controls, and encryption mechanisms.
  • Stay up-to-date with security best practices and compliance requirements.
  • Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
  • Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
  • Monitor and manage platform costs, including optimizing resource utilization to control expenses.
  • Maintain detailed documentation of configurations, procedures, and best practices.
  • Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions

Minimum Qualifications:

  • Bachelor's degree in a relevant field (computer science, data engineering, etc.)
  • 7+ years of related professional experience.
  • 3 years’ experience with Databricks Lakehouse Platform Architecture on AWS
  • Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps
  • Proficiency in AWS cloud platforms
  • Experience in Utility and Energy related business is a plus.

  • AWS Databricks Administrator

    4 weeks ago

    Minneapolis, United States Ender-IT Full time

    AWS Databricks Administrator /EngineerLocation: Minneapolis, MN Duration: 3 Months+ Contract to hireNo sponsorship availableAWS Databricks Administrator /Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to...

  • AWS Databricks Administrator

    4 weeks ago

    Minneapolis, United States Ender-IT Full time

    AWS Databricks Administrator /EngineerLocation: Minneapolis, MN Duration: 3 Months+ Contract to hireNo sponsorship availableAWS Databricks Administrator /Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to...

  • AWS Databricks Administrator

    1 day ago

    Minneapolis, United States Ender-IT Full time

    AWS Databricks Administrator /EngineerLocation: Minneapolis, MN Duration: 3 Months+ Contract to hireNo sponsorship availableAWS Databricks Administrator /Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to...

  • & onsite to Minnesota or Colorado AWS Databricks Administrator

    3 weeks ago

    Minneapolis, United States Blink Technology Partners Full time

    Position : AWS Databricks Administrator /Engineer Location : Onsite (Minneapolis, MN or Denver CO) Duration : 6 Months+ Contract to hire Mode of Interview : Telephonic/Video Job Description: Need at least 10+ years of experience. Minimum Qualifications: Bachelor's degree in a relevant field (computer science, data engineering, etc.) 7+ years of related...

  • AWS Databricks

    2 days ago

    Minneapolis, United States Avance Consulting Full time

    Job DescriptionJob DescriptionJob DescriptionRole - DEVELOPER Relevant Experience (in Yrs) 4-6 YRSMust Have Technical/Functional Skills 3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark, Databricks SQL, Data pipelines using Delta Lake. • 3 years of experience years of experience in ETL, Big Data/Hadoop and data...

  • AWS Databricks

    1 day ago

    Minneapolis, United States Avance Consulting Full time

    Job DescriptionJob DescriptionJob DescriptionRole - DEVELOPER Relevant Experience (in Yrs) 4-6 YRSMust Have Technical/Functional Skills 3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark, Databricks SQL, Data pipelines using Delta Lake. • 3 years of experience years of experience in ETL, Big Data/Hadoop and data...

  • AWS Databricks

    1 day ago

    Minneapolis, United States Avance Consulting Full time

    Job DescriptionJob DescriptionJob DescriptionRole - DEVELOPER Relevant Experience (in Yrs) 4-6 YRSMust Have Technical/Functional Skills 3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark, Databricks SQL, Data pipelines using Delta Lake. • 3 years of experience years of experience in ETL, Big Data/Hadoop and data...

  • Sr. Databricks Platform Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Randstad USA Full time

    job summary: Our client is seeking a Contract to hire Sr. Databricks Platform Engineer. In either Denver, CO or Minneappolis, MN. As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to...

  • Data warehouse Architect

    3 weeks ago

    Minneapolis, United States Select Source International Full time

    Job Title: Data Warehouse ArchitectLocation: 1800 Larimer Street Denver Colorado 80202 / Minneapolis, MN (3 days onsite 2 days remote)Duration: CTH , initially 3 Months contract (will convert Full time after 3 months) As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS...

  • Database Administrator

    4 days ago

    Minneapolis, United States Insight Global Full time

    Insight Global is seeking a Sr. Databricks Platform Administrator local to MN, CO, TX or WI to join the Unified Data Platform team at one of our largest Utility Clients. This individual will be the key participant and contributor to the Databricks center of Excellence for Data Platform tools. They will be responsible for the development, administration, and...

  • Database Administrator

    1 day ago

    Minneapolis, United States Insight Global Full time

    Insight Global is seeking a Sr. Databricks Platform Administrator local to MN, CO, TX or WI to join the Unified Data Platform team at one of our largest Utility Clients. This individual will be the key participant and contributor to the Databricks center of Excellence for Data Platform tools. They will be responsible for the development, administration, and...

  • Data Warehouse Architect

    2 weeks ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support...

  • Data Warehouse Architect

    5 days ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to...

  • Data Warehouse Architect

    2 weeks ago

    Minneapolis, Minnesota, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote.Job Description:As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support...

  • Data Warehouse Architect

    2 days ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to...

  • Data Warehouse Architect

    2 days ago

    Minneapolis, Minnesota, United States Genesis10 Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote.Job Description:As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support...

  • AWS Developer

    3 weeks ago

    Minneapolis, United States Diverse Lynx Full time

    Job Title: AWS Developer Location: Minneapolis, MN Duration: FulltimeSkill: AWS AdminJob Description: Must Have Technical/Functional Skills Bachelor's/Master's Degree or equivalent professional experience. Experience in enterprise-scale cloud and hybrid infrastructures for migrations, and technology management. Technology industry experience with ability...

  • AWS Developer

    24 hours ago

    Minneapolis, United States Diverse Lynx Full time

    Job Title: AWS Developer Location: Minneapolis, MN Duration: FulltimeSkill: AWS AdminJob Description: Must Have Technical/Functional Skills Bachelor's/Master's Degree or equivalent professional experience. Experience in enterprise-scale cloud and hybrid infrastructures for migrations, and technology management. Technology industry experience with ability...

  • Sr. Data Engineer

    2 days ago

    Minneapolis, United States Improving Full time

    Sr. Data Engineer (Cloud) Description As a Data Engineer, you'll be working with the latest cloud and technology stacks to help clients implement and mature their modern data architecture. You will work with tools/platforms like Kafka, Snowflake, and Databricks to help clients get the most out of their data that may be in systems like Salesforce, SAP, SQL...

  • AWS Engineer

    3 days ago

    Minneapolis, United States BCforward Full time

    AWS Engineer BCforward is currently seeking a highly motivated Senior IT Cloud Engineer for a remote position. Position Title: Senior IT Cloud EngineerLocation: RemoteAnticipated Start Date: [6/15/2024] Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Contract...