Sr. Databricks Engineer

6 days ago

Dallas, TX, United States Insight Global Full time

Job Description

We're looking for a seasoned Senior Data Engineer with hands-on expertise in Databricks to help architect, build, and refine data pipelines and analytics solutions. This role requires a strong background in data engineering, ETL development, and production support, with a focus on delivering scalable, high-performance data systems within an Azure cloud environment.

Key Responsibilities:

Design and maintain scalable data pipelines using Databricks, Spark, and PySpark.

Optimize SQL queries and ETL workflows for performance and reliability.

Collaborate with cross-functional teams to build data models and deliver insights.

Ensure data quality and system reliability across Azure-based environments.

Provide production support, troubleshoot Spark jobs, and resolve performance issues.

Maintain CI/CD pipelines and documentation for data workflows.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

10+ years overall experience in data engineering or related fields.

3-5 years hands-on experience with Databricks and Spark.

Strong proficiency in SQL and data analysis techniques.

Experience with ETL processes, data modeling, and performance tuning.

Familiarity with Python or Scala for data engineering tasks.

Excellent problem-solving and communication skills. Knowledge of insurance industry data.

Experience with Power BI or other BI tools.

  • Sr. Databricks Engineer

    2 weeks ago

    Dallas, TX, United States Diverse Lynx Full time

    Sr. Databricks Engineer || Dallas , TX , Charlotte , NC ,Atlanta , GA , Richmond , VA || Fulltime Job Description Must Have Technical/Functional Skills • 10+ years overall experience in data engineering or related fields. • 3-5 years hands-on experience with Databricks and Spark. • Strong proficiency in SQL and data analysis techniques. •...

  • Sr. Databricks Engineer

    15 hours ago

    Dallas, TX, United States Diverse Lynx Full time

    Sr. Databricks Engineer || Dallas , TX , Charlotte , NC ,Atlanta , GA , Richmond , VA || Fulltime Job Description Must Have Technical/Functional Skills • 10+ years overall experience in data engineering or related fields. • 3-5 years hands-on experience with Databricks and Spark. • Strong proficiency in SQL and data analysis techniques. •...

  • Senior Technical Solutions Engineer, Lakebase

    10 hours ago

    Dallas, TX, United States Databricks Full time

    RDQ127R37 While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Senior Technical Solutions Engineer, you will provide technical support for Databricks Lakebase related issues and resolve any challenges involving the Neon.com cloud-native Postgres service. You will assist customers in...

  • Azure Databricks Engineer

    1 week ago

    Dallas, TX, United States Cedent Full time

    Key Responsibilities: Azure Databricks Architecture & Design: Design, build, and optimize scalable, high-performance data pipelines and data lakes using Azure Databricks. Architect and implement end-to-end analytics solutions leveraging Databricks and other Azure services (e.g., Azure Data Lake, Azure SQL, Azure Blob Storage). Lead the design of...

  • Azure Databricks Engineer

    1 week ago

    Dallas, TX, United States Cedent Full time

    Key Responsibilities: Azure Databricks Architecture & Design: Design, build, and optimize scalable, high-performance data pipelines and data lakes using Azure Databricks. Architect and implement end-to-end analytics solutions leveraging Databricks and other Azure services (e.g., Azure Data Lake, Azure SQL, Azure Blob Storage). Lead the design of...

  • Sr. Data Engineer

    1 week ago

    Dallas, TX, United States TrinityRail Full time

    Trinity Industries is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with the Trinity Rail teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL. Join our team today and be a part of Delivering Goods for the Good of All! What you'll do: Facilitate...

  • Sr. Data Engineer

    2 weeks ago

    Dallas, TX, United States TrinityRail Full time

    Trinity Industries is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with the Trinity Rail teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL. Join our team today and be a part of Delivering Goods for the Good of All! What you'll do: Facilitate...

  • Sr. Data Engineer

    6 days ago

    Dallas, TX, United States TrinityRail Full time

    Trinity Industries is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with the Trinity Rail teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL. Join our team today and be a part of Delivering Goods for the Good of All! What you'll do: Facilitate...

  • Sr. Data Engineer

    2 weeks ago

    Dallas, TX, United States TrinityRail Full time

    Trinity Industries is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with the Trinity Rail teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL. Join our team today and be a part of Delivering Goods for the Good of All! What you'll do: Facilitate...

  • Sr. Data Engineer

    4 days ago

    Dallas, TX, United States TrinityRail Full time

    Trinity Industries is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with the Trinity Rail teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL. Join our team today and be a part of Delivering Goods for the Good of All! What you'll do: Facilitate...