Senior Databricks Engineer

2 weeks ago


Armonk, NY, United States Kforce Full time
Responsibilities

Kforce has a client that is seeking a Senior Databricks Engineer in Armonk, NY.Summary:We are seeking a Senior Databricks Engineer to join our team and lead the architecture, setup, and optimization of Databricks environments for enterprise-scale data initiatives. This role will be critical in establishing secure and scalable Databricks platforms, integrating with diverse data sources, and enabling advanced analytics and AI/ML workloads.Responsibilities:
  • Architect, deploy, and configure Databricks workspaces in Azure environments
  • Establish secure and optimized connections to data sources (on-premise, cloud storage, relational and NoSQL databases, APIs, etc.)
  • Design and implement data pipelines using Databricks Delta Live Tables (DLT), Spark, and related technologies
  • Collaborate with security teams to ensure compliance with enterprise governance, authentication (IAM), and network policies (VPC, Private Link, etc.)
  • Optimize cluster configurations for cost, performance, and scalability based on workload patterns
  • Provide technical leadership and best practices guidance to data engineers and analysts on leveraging Databricks for data ingestion, transformation, and ML workflows
  • Troubleshoot and resolve performance, connectivity, and configuration issues within the Databricks platform
  • Develop automation scripts for provisioning and managing Databricks resources (Terraform, CI/CD pipelines, etc.)
Skills
  • 5+ years of hands-on experience with Databricks platform setup and administration
  • Experience integrating Databricks with Snowflake
  • Deep expertise in Databricks architecture, workspace administration, and cloud integrations (Azure) with a proven ability to partner with data engineering, platform, and business teams to drive outcomes
Preferred:
  • Prior experience in Utility/electric/gas industries (Healthcare, Financial Services, etc.) ensuring compliance and data governance


The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

By clicking "Apply Today" you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce is a professional staffing services firm offering Technology and Finance & Accounting jobs with top employers nationwide. We specialize in providing contract, contract-to-hire and direct placement opportunities, with over 50 years of experience in the staffing industry. Kforce offers many consultants comprehensive benefits depending on employment status, including medical, dental, 401(K), life insurance and disability. Our vision is to be "the firm most respected by those we serve."

  • Armonk, NY, United States Kforce Full time

    Kforce has a client in Armonk, NY that is seeking a detail-oriented Matillion Developer to design, develop, and maintain data integration solutions supporting electric utility data initiatives.Summary:In this role, you will build robust ETL/ELT pipelines using Matillion to process and transform large volumes of data from advanced metering infrastructure...

  • Matillion Developer

    7 days ago


    Armonk, NY, United States Kforce Full time

    Responsibilities Kforce has a client in Armonk, NY that is seeking a detail-oriented Matillion Developer to design, develop, and maintain data integration solutions supporting electric utility data initiatives.Summary:In this role, you will build robust ETL/ELT pipelines using Matillion to process and transform large volumes of data from advanced metering...

  • Matillion Developer

    2 weeks ago


    Armonk, NY, United States Kforce Full time

    Responsibilities Kforce has a client in Armonk, NY that is seeking a detail-oriented Matillion Developer to design, develop, and maintain data integration solutions supporting electric utility data initiatives.Summary:In this role, you will build robust ETL/ELT pipelines using Matillion to process and transform large volumes of data from advanced metering...

  • Matillion Developer

    3 days ago


    Armonk, NY, United States Kforce Full time

    Responsibilities Kforce has a client in Armonk, NY that is seeking a detail-oriented Matillion Developer to design, develop, and maintain data integration solutions supporting electric utility data initiatives.Summary:In this role, you will build robust ETL/ELT pipelines using Matillion to process and transform large volumes of data from advanced metering...

  • Data Architect

    1 day ago


    Armonk, NY, United States Kforce Full time

    Responsibilities Kforce has a client in Armonk, NY that is seeking a Data Architect to lead the design, modernization, and optimization of enterprise-scale data platforms. This role will be instrumental in shaping data architecture strategy across transactional systems, operational data stores, data lakes, and analytical platforms, with a strong emphasis on...

  • Data Architect

    3 days ago


    Armonk, NY, United States Kforce Full time

    Responsibilities Kforce has a client in Armonk, NY that is seeking a Data Architect to lead the design, modernization, and optimization of enterprise-scale data platforms. This role will be instrumental in shaping data architecture strategy across transactional systems, operational data stores, data lakes, and analytical platforms, with a strong emphasis on...


  • Armonk, New York, United States PandoLogic Full time

    Senior System Engineer, IBM Corporation, Armonk, NY and various unanticipated client sites throughout the US (Up to 20% telecommuting permitted): Develop high-quality enterprise integration solutions that meet the demanding challenges of usability, resilience, performance, scalability, and security. Lead and participate in creating MVPs (Minimum Viable...


  • Armonk, United States BioSpace Full time

    Join to apply for the Senior Manager, Inspection Management role at BioSpace 1 day ago Be among the first 25 applicants Join to apply for the Senior Manager, Inspection Management role at BioSpace The Senior Manager will support the Inspection Management Leads (IMLs) with the effective management of GCP, GVP and GLP inspections. The Senior Manager will...

  • Senior Java

    3 days ago


    Armonk, United States Next Level Business Services, Inc. Full time

    A leading IT services company in Armonk, NY is seeking a Resource Manager with over 6 years of experience in Java and J2EE. The ideal candidate should have strong analytical skills, the ability to coordinate projects, and excellent communication skills. Responsibilities include translating business processes into technical requirements and providing onsite...


  • Armonk, United States Harry Marketing Full time

    This is a hybrid role based in Armonk, NY. Overview The Sr. Digital Marketing Manager is a strategic, hands-on leader who drives digital innovation and measurable results for a diverse range of clients. You’ll develop, implement, and optimize digital marketing campaigns across channels—including paid media, SEO, and content marketing—all while...


  • Armonk, United States Harry Marketing Full time

    This is a hybrid role based in Armonk, NY.OverviewThe Sr. Digital Marketing Manager is a strategic, hands-on leader who drives digital innovation and measurable results for a diverse range of clients. You’ll develop, implement, and optimize digital marketing campaigns across channels—including paid media, SEO, and content marketing—all while delivering...