Databricks Platform Manager

4 days ago


Pittsburgh, Pennsylvania, United States Tredence Inc. Full time
About the Role

Tredence Inc. is seeking a highly skilled Databricks Administrator to join our team. As a key member of our data engineering and analytics team, you will be responsible for the management, configuration, and maintenance of our Databricks platform.

Key Responsibilities
  • Platform Administration
    • Manage and monitor Databricks workspaces, clusters, jobs, and notebooks.
    • Configure and optimize cluster policies, instance pools, and auto-scaling settings to ensure efficient resource usage.
    • Oversee the installation, configuration, and maintenance of Databricks components and integrations.
  • User and Access Management
    • Manage user access and permissions, ensuring compliance with organizational security policies.
    • Configure and manage Identity and Access Management (IAM) roles and policies within Databricks.
    • Support users in onboarding, troubleshooting access issues, and ensuring proper usage of the platform.
  • Security and Compliance
    • Implement and enforce security best practices, including encryption, network security, and data access controls.
    • Monitor and audit Databricks environments to ensure compliance with data governance policies and regulatory requirements.
    • Work with the IT security team to ensure that Databricks is integrated with the organization's security protocols.
  • Performance Monitoring and Optimization
    • Monitor the performance of Databricks clusters and jobs, identifying and resolving issues related to resource usage, performance bottlenecks, and job failures.
    • Optimize the performance of data pipelines, ETL processes, and machine learning workflows on Databricks.
    • Implement monitoring and alerting solutions to proactively address performance and reliability issues.
  • Support and Troubleshooting
    • Provide technical support to users, including data engineers, data scientists, and analysts, in their use of Databricks.
    • Troubleshoot and resolve issues related to cluster configurations, job execution, data access, and integration with other systems.
    • Work closely with Databricks support and engineering teams to address platform issues and implement fixes or improvements.
  • Collaboration and Communication
    • Collaborate with data engineers, data scientists, and other stakeholders to understand their needs and ensure that the Databricks environment supports their requirements.
    • Communicate platform updates, changes, and best practices to users and stakeholders.
    • Participate in cross-functional projects and initiatives involving the Databricks platform.
  • Continuous Improvement
    • Stay updated with the latest features, updates, and best practices related to Databricks and big data technologies.
    • Recommend and implement improvements to the Databricks environment to enhance performance, security, and user experience.
    • Contribute to the development of documentation, training materials, and guidelines for Databricks users.


  • Pittsburgh, Pennsylvania, United States Merkle Full time

    Job OverviewCompany OverviewMerkle is a premier data-centric, technology-driven global performance marketing agency dedicated to delivering exceptional, personalized customer experiences across various platforms and devices. With over three decades of experience, we collaborate with Fortune 1000 companies and leading nonprofit organizations to enhance the...


  • Pittsburgh, Pennsylvania, United States Merkle Full time

    Job DescriptionMerkle is a leading data-driven, technology-enabled, global performance marketing agency that specializes in the delivery of unique, personalized customer experiences across platforms and devices.For more than 30 years, Fortune 1000 companies and leading nonprofit organizations have partnered with us to maximize the value of their customer...


  • Pittsburgh, Pennsylvania, United States Innovation Works, Inc. Full time

    Job OverviewExciting Opportunity at Innovation Works, Inc.Step into the innovative realm of Innovation Works, Inc., a unique digital platform designed for female business travelers. Our web application promotes interaction, idea exchange, and networking among our users, functioning as a private community for empowered professionals. The technology stack...


  • Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About the RoleAurora Innovation is seeking a highly skilled Site Reliability Engineer to join our team. As a key member of our Client Platform Engineering group, you will be responsible for ensuring the integrity and availability of our enterprise fleet of laptops and InfoSec/Enterprise infrastructure services.Key ResponsibilitiesImplement scalable solutions...


  • Pittsburgh, Pennsylvania, United States Merkle Full time

    Job OverviewCompany OverviewMerkle is a premier global performance marketing agency that leverages data and technology to deliver personalized customer experiences across various platforms and devices. With over three decades of experience, we collaborate with Fortune 1000 companies and leading nonprofit organizations to enhance the value of their customer...


  • Pittsburgh, Pennsylvania, United States Merkle Full time

    Job OverviewCompany OverviewMerkle is a premier data-driven, technology-focused global performance marketing agency dedicated to delivering personalized customer experiences across various platforms and devices. With over three decades of experience, we collaborate with Fortune 1000 companies and leading nonprofit organizations to enhance the value of their...


  • Pittsburgh, Pennsylvania, United States eNGINE Full time

    eNGINE is seeking an experienced Reporting & Analytics Lead to provide expertise and direction for a client in the Specialty Pharmacy sector. This position requires effective leadership of a technical team while fostering their development.Essential Qualifications:At least 5 years of experience in report generation and team leadership.Strong knowledge of...


  • Pittsburgh, Pennsylvania, United States Techstra Solutions Full time

    As an Azure Data Engineer at Techstra Solutions, you will play a pivotal role in designing, implementing, and managing data architecture on the Azure cloud platform. The ideal candidate will be proficient in leveraging Azure data services and tools to extract insights from large datasets, drive data-driven decision making, and contribute to the overall data...


  • Pittsburgh, Pennsylvania, United States Innovation Works, Inc. Full time

    Digital Marketing Manager/ Specialist Innovation Works, Inc.The Communications Department of Innovation Works develops and manages activities, content, and relationships that enhance the organization's brand in real-time and online and builds stakeholders' relationships for future partnerships and support. The Communications Department maintains...


  • Pittsburgh, Pennsylvania, United States PNC Financial Services Group Full time

    Job Profile Position Overview At PNC Financial Services Group, our workforce is our most significant differentiator and competitive edge in the markets we operate. We are united in our commitment to delivering exceptional experiences for our clients. We collaborate daily to cultivate an inclusive workplace culture where all employees feel respected, valued,...


  • Pittsburgh, Pennsylvania, United States V2Soft Full time

    Essential Technical Skills and ExperienceExpertise in the establishment, evaluation, and upkeep of operational and technological risk frameworksAdvanced skills in PowerPoint, Excel, and SharePoint applicationsFamiliarity with Archer GRC platformCreation and oversight of internal risk management and control measuresKnowledge of ServiceNow platformExperience...

  • DevOps Manager

    2 months ago


    Pittsburgh, Pennsylvania, United States Motion Recruitment Full time

    Join a DevOps team with a focus on development and improvement of CI/CD build pipelines, including build scripts, tests, security tooling and release of code. This role is focused on production of products that can be released to multiple different platforms in unified tech stack. The DevOps team is committed to improving developer productivity using...


  • Pittsburgh, Pennsylvania, United States American Eagle Outfitters Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Software Development Manager to lead our engineering team and drive the development and growth of our platform.Key ResponsibilitiesTechnical Leadership: Provide technical guidance and mentorship to a team of Java developers, ensuring the delivery of high-quality software solutions.Business...


  • Pittsburgh, Pennsylvania, United States AMETEK Full time

    Position Overview:The Aftermarket Operations Manager is tasked with supervising all facets of the Process Instruments Aftermarket sector, which encompasses online sales, customer service, and the effective distribution of replacement components.Key Responsibilities:- Oversee the e-commerce platform to ensure seamless transactions and customer satisfaction.-...


  • Pittsburgh, Pennsylvania, United States Presidio Full time

    **Job Summary**Presidio is seeking an IT Asset Management Specialist for an onsite position. This individual will be responsible for managing IT assets, tracking inventory, and performing warehouse duties.**Key Responsibilities:**Manage IT assets, including tracking inventory and performing regular audits.Utilize Microsoft Excel to analyze data and create...


  • Pittsburgh, Pennsylvania, United States Motion Recruitment Full time

    Location: Hybrid Employment Type: Full Time Salary Range: $170k - $180k We are seeking a DevOps Manager to oversee a dedicated team focused on the development and enhancement of CI/CD build pipelines. This includes managing build scripts, testing protocols, security tools, and the deployment of code. This position emphasizes the creation of products that are...


  • Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About the RoleAurora Innovation is seeking a highly skilled Technical Program Manager to join our Aurora Services Platform team. As a Technical Program Manager, you will play a critical role in commercializing our Aurora Driver into public roads and carrier operations.Key ResponsibilitiesBuild Operations Technology: Develop and implement operations...


  • Pittsburgh, Pennsylvania, United States American Eagle Outfitters Full time

    Job OverviewASSISTANT MEDIA MANAGER - AERIE BRAND MEDIAYOUR ROLE:As the Assistant Media Manager for Aerie, you will collaborate closely with the Senior Manager to craft and implement the brand's media strategies for one of the most dynamic names in retail. Joining a dedicated team of creative marketers at Aerie, your focus will be on designing innovative...

  • Data Technical Lead

    4 weeks ago


    Pittsburgh, Pennsylvania, United States Techstra Solutions Full time

    As Data Technical Lead, you will play a pivotal role in driving the strategic direction of our consulting services related to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical expertise, software and cloud engineering, and client management skills.While working with teams in an...


  • Pittsburgh, Pennsylvania, United States Gridwise Full time

    About GridwiseGridwise stands out as a rapidly expanding startup within the gig-mobility sector. Our innovative platform delivers comprehensive gig-mobility solutions designed to empower drivers, corporations, and municipal entities.We have successfully supported over 300,000 ride-hailing and delivery drivers through our mobile application and marketplace...