ADB Developer

Job Title:
ADB Developer

Location:
Louisville, KY

Duration:
6 Months (Contract)

Position Overview:

We are seeking an experienced
ADB (Azure Databricks) Developer
with strong expertise in
data engineering, ETL pipeline development
, and
cloud data architecture
. The ideal candidate will have a proven track record of building scalable, high-performance data solutions on the
Azure platform
, leveraging
Databricks
,
Spark
, and
Azure Data Lake
technologies.

This role will work closely with data architects, analysts, and business stakeholders to design, develop, and optimize data workflows that support analytics, reporting, and business intelligence initiatives.

Key Responsibilities:

• Design and develop
  ETL/ELT pipelines
  using
  Azure Databricks
  ,
  PySpark
  , and
  Azure Data Factory
  .
• Build and maintain scalable data ingestion, transformation, and storage solutions using
  Azure Data Lake Storage (ADLS)
  and
  Delta Lake
  .
• Collaborate with cross-functional teams to define
  data models
  ,
  schemas
  , and
  data integration strategies
  .
• Develop efficient
  Spark code
  to process large-scale datasets and optimize performance.
• Implement
  data quality checks, validation frameworks, and error handling mechanisms
  within pipelines.
• Work closely with
  data architects
  to align with enterprise data governance and architecture standards.
• Support migration of on-premise data systems to
  Azure Cloud
  environments.
• Participate in
  code reviews, performance tuning, and optimization
  of existing data workflows.
• Ensure data solutions are secure, reliable, and compliant with organizational and regulatory requirements.

Required Skills & Experience:

• 5–8+ years
  of experience in
  data engineering
  or
  data development
  roles.
• Hands-on expertise with
  Azure Databricks (ADB)
  ,
  PySpark
  , and
  Azure Data Factory (ADF)
  .
• Strong experience in
  SQL
  ,
  ETL design
  , and
  data modeling
  (dimensional and relational).
• Experience with
  Azure Data Lake
  ,
  Delta Lake
  , and
  Azure Synapse Analytics
  .
• Strong knowledge of
  Spark optimization techniques
  ,
  partitioning
  , and
  performance tuning
  .
• Familiarity with
  DevOps practices
  (CI/CD pipelines, Git, ARM templates, or Terraform).
• Proficient in
  Python
  or
  Scala
  for data processing.
• Strong analytical and troubleshooting skills in large-scale data ecosystems.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with
  Azure Machine Learning
  or
  Power BI integration
  .
• Exposure to
  Databricks REST APIs
  ,
  Job Orchestration
  , and
  Workflow Automation
  .
• Knowledge of
  data governance frameworks
  and
  metadata management tools
  .
• Azure certification (e.g.,
  DP-203: Data Engineering on Microsoft Azure
  ) is a plus.

Education:

• Bachelor's or Master's degree in
  Computer Science, Information Systems, Data Engineering
  , or related field.