Azure Data Engineer

Job Title: Mid Level Azure Data Engineer

Location: Remote

Type: Full Time

Experience Level: 3 5 years (mid-level) in data engineering or related role

Reports to: Data Engineering Lead / Data Platform Manager

About Us

We are a dynamic enterprise moving to cloud-native data platforms. We partner with business units globally and need strong data engineering talent to build and scale our Azure data ecosystem.

Key Responsibilities

• Design, build and maintain scalable data pipelines and ETL/ELT workflows using Azure services.
• Collaborate with data scientists, analysts and business stakeholders to understand data needs and turn them into production solutions.
• Work with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake and associated Azure storage solutions to integrate structured and unstructured data.
• Develop and maintain data models, data warehouses, data marts, and data lakes to support analytics and reporting.
• Write, optimise and maintain SQL queries (Azure SQL Database, Azure Synapse SQL) and scripts (Python / Scala) for data processing and transformation.
• Implement big-data processing frameworks (Spark, Databricks) and streaming where required.
• Ensure data quality, data governance, metadata management, and support data security/compliance (GDPR, HIPAA etc) in cloud environments.
• Monitor, troubleshoot and optimise data performance: storage, job runtimes, cost, throughput, scalability.
• Participate in cross-team initiatives: define best practices for cloud data engineering, adopt new technologies, document architecture and pipelines.
• Mentor junior engineers or teammates, and contribute to design reviews and code reviews.

Required Skills & Tools

• Experience (3-5 years) in data engineering, preferably in enterprise environments.
• Strong hands-on experience with Microsoft Azure data platform:
• Azure Data Factory (ADF) or equivalent orchestration tool
• Azure Synapse Analytics / SQL Data Warehouse
• Azure Databricks and Spark (PySpark/Scala)
• Azure Data Lake Storage (ADLS)
• Azure SQL Database / SQL Server on Azure
• Azure Cosmos DB or other NoSQL storage (preferred)
• Strong SQL skills: ability to write, analyse and optimise complex queries, understand execution plans and performance implications.
• Programming/scripting language skills: Python, Scala or R (Python preferred) for data processing.
• Big data frameworks: Spark (batch and streaming), Kafka or other streaming tool (preferred).
• Data modelling & warehousing: star/schema modelling, dimensional design, OLAP/OLTP distinctions.
• Understanding of ETL/ELT patterns, data pipelines, data lakes vs data warehouses, and modern cloud architectures.
• Experience with data governance, metadata, security, compliance (e.g., encryption, role-based access, logging).
• Familiarity with DevOps/CI-CD practices for data engineering: versioning, automated testing, deployment pipelines.
• Strong problem-solving skills, ability to work in agile teams, collaborate with business stakeholders and translate business needs into technical solutions.
• Excellent communication skills: present data engineering ideas clearly, document work, review code and pipelines.

Preferred Qualifications

• Azure certifications: e.g., Microsoft Certified: Azure Data Engineer Associate, or Azure Solutions Architect Data.
• Familiarity with Power BI or other BI tools for analytics consumption.
• Experience with containerization or Kubernetes for data workloads.
• Experience in multi-cloud or hybrid environments (AWS/GCP experience is plus).
• Experience with real-time data streaming, event-driven architectures, or IoT data ingestion.
• Knowledge of cost-optimisation in Azure: e.g., managing data lake costs, compute scaling, reserved instances.

Education & Background

• Bachelor's degree in Computer Science, Information Systems, Engineering or equivalent experience.
• 3 to 5 years of relevant experience (data engineering, cloud engineering, analytics engineering).
• Demonstrated track record of delivering data solutions from design through production.

Job Type: Full-time

Pay: $134, $162,486.89 per year

Benefits:

• 401(k)
• 401(k) matching
• Flexible schedule
• Health insurance
• Paid time off
• Vision insurance

Work Location: Remote