Senior Azure Data Engineer

2 weeks ago

Blue Ash, Ohio, United States Compunnel Full time
Job Summary:

We are looking for a Senior Azure Data Engineer to join our dynamic and forward-thinking data team. The ideal candidate will be responsible for designing, developing, and maintaining robust, scalable, and high-performance data pipelines and architectures using Microsoft Azure technologies. This role requires a deep understanding of cloud-based data processing systems and close collaboration with data scientists, analysts, and business stakeholders to ensure efficient data workflows and reliable data availability.

Key Responsibilities:
  • Design and implement scalable and secure data pipelines and ETL processes using Azure Data Factory, Azure Synapse, and Databricks.
  • Develop and maintain data lakes and data warehouses on Azure Data Lake Storage.
  • Leverage Python and PySpark to manipulate, clean, and transform large-scale datasets.
  • Design and optimize SQL queries and develop efficient data models to support analytical and reporting needs.
  • Ensure high data quality and integrity through data validation, monitoring, and logging mechanisms.
  • Collaborate with cross-functional teams including data scientists, BI developers, and business analysts to understand data requirements.
  • Apply DevOps practices such as CI/CD pipelines, version control (e.g., Git), and environment management for deployment and integration.
  • Monitor, troubleshoot, and optimize data workflows to ensure performance and reliability in a production environment.
Required Skills & Qualifications:
  • 5+ years of experience in data engineering or related roles.
  • 2+ years of hands-on experience with Microsoft Azure cloud technologies.
Deep expertise in:

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Azure Data Lake Storage

Strong programming skills in Python and PySpark for big data processing.

Advanced proficiency in SQL and data modeling principles.

Solid knowledge of cloud architecture, data warehousing, and distributed systems.

Strong problem-solving skills and the ability to troubleshoot complex data issues.

Preferred Skills:
  • Experience with DevOps practices, CI/CD pipelines, and tools such as Azure DevOps or GitHub Actions.
  • Knowledge of data security, data governance, and compliance best practices.
  • Familiarity with Delta Lake, Apache Spark, and real-time data processing.
  • Experience working in Agile/Scrum environments.
Certifications (Preferred but not required):

Microsoft Certified: Azure Data Engineer Associate

Microsoft Certified: Azure Solutions Architect Expert

Any relevant Azure or data engineering certifications

Education: Bachelors Degree

  • Data Engineer Level 2

    6 hours ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world. Job...

  • Senior Data Engineer

    6 days ago

    Blue Ash, Ohio, United States Kroger Tech & Digital Full time

    Data Engineering for Mfg and MAKE program - taking legacy systems/data and building up environments/set up/data modeling/repositories to shift to new ERP solution M3 (Infor Product).Data needs, with procurement, flows, etc. Accountable for developing and delivering technological responses to targeted business outcomes.Analyze, design and develop...

  • Remote - Data Platform Support Lead

    4 days ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world. Databricks...

  • Enterprise Data Infrastructure Expert

    3 days ago

    Blue Ash, Ohio, United States beBee Careers Full time

    Enterprise Data ArchitectureWe are seeking a talented Senior Data Engineer to join our team and help us develop an enterprise data architecture that meets the needs of our customers.This role involves designing and developing data models, data pipelines, and other data infrastructure components using a range of technologies including Databricks, Azure Data...

  • Technical Data Solutions Specialist

    4 days ago

    Blue Ash, Ohio, United States beBee Careers Full time

    Data Solutions DevelopmentWe are seeking a skilled Senior Data Engineer to join our team and help us develop complex data solutions that meet the needs of our customers.This role involves designing and developing data pipelines, data models, and other data infrastructure components using a range of technologies including Databricks, Azure Data Lake, and...

  • Senior Data Architect

    4 days ago

    Blue Ash, Ohio, United States beBee Careers Full time

    Data Engineering OpportunitiesOur company is seeking a skilled Senior Data Engineer to join our team. This role involves designing and developing complex data solutions that meet the needs of our customers.The ideal candidate will have a strong background in computer science, software engineering, or a related field, with experience in data warehousing, big...

  • Data Engineer Leader

    4 days ago

    Blue Ash, Ohio, United States beBee Careers Full time

    Transforming Data AssetsWe are seeking a talented Senior Data Engineer to join our team and help us transform our data assets. In this role, you will design and develop complex data solutions that meet the needs of our customers.You will have a strong background in computer science, software engineering, or a related field, with experience in data...

  • Data Engineer Level 2

    6 hours ago

    Blue Ash, Ohio, United States Aditi Consulting Full time

    Payrate: $70.00- $75.00/hr. Summary: The Data Integration Team is seeking a Data Engineer with ETL experience. We are looking for highly technical and progressive Data Engineers to support both the operations of The Co. and its forward-thinking Data Strategy organization. The Data Engineer position entails building strong relationships with business partners...

  • Data Scientist Level 2

    2 weeks ago

    Blue Ash, Ohio, United States Golden Technology Full time

    Job Description Join a leading-edge company that partners with Fortune 50 clients to deliver transformative retail and ecommerce solutions. We are at the forefront of innovation, helping global brands navigate the rapidly evolving digital landscape. Our team is composed of industry experts who are passionate about driving business success through strategic...

  • Senior Data Architect

    6 days ago

    Blue Ash, Ohio, United States beBee Careers Full time

    About the Role:We are seeking a skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data systems. You will work closely with cross-functional teams to develop and deliver innovative data solutions that meet business needs.Key...