Azure Data Engineer Specialist

3 days ago


Minneapolis, Minnesota, United States Diverse Lynx Full time
Job Overview

Diverse Lynx LLC is a leading company in the field of data engineering, and we are currently seeking a highly skilled Azure Data Engineer Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing scalable ETL processes using Python, Apache Spark, and Azure Synapse. Your expertise in Azure Cloud, including SQL Pools and Spark Pools, will be essential in managing and processing large datasets efficiently.

We offer a competitive salary of $180,000 per annum, commensurate with experience. Our benefits package includes health insurance, 401(k) matching, and paid time off.

In this role, you will have the opportunity to work on complex data projects, collaborate with cross-functional teams, and develop your skills in cloud-based data engineering. If you are a motivated and detail-oriented individual with a passion for data-driven solutions, we encourage you to apply.

Key Responsibilities

- Design, develop, and optimize scalable ETL processes using Python, Apache Spark, and Azure Synapse.
- Build and manage Azure Data Factory pipelines to orchestrate complex data workflows.
- Use SQL Pools and Spark Pools within Synapse to manage and process large datasets efficiently.
- Implement Data Warehousing solutions using Azure Synapse Analytics to provide structured and queryable data layers.
- Ensure the data platform supports real-time and batch AI/ML data requirements.

Required Skills and Qualifications

- Expertise in Python and Apache Spark for large-scale data processing.
- Strong experience in Azure Synapse Analytics, including SQL Pools and Spark Pools.
- Advanced proficiency in Azure Data Factory for ETL pipeline orchestration and management.
- Knowledge of Data Warehousing principles, with hands-on experience building solutions on Azure.
- Experience with SQL, including complex queries, optimization, and performance tuning.
- Familiarity with CI/CD tools like Azure DevOps and managing infrastructure in Azure Cloud.
- Experience in Java for API integration and microservices architecture.
- Hands-on knowledge of Kubernetes for containerized data processing environments.
- Proficiency in working with Azure Data Lake Storage (ADLS) Gen2 for data storage and management.
- Experience working with APIs (REST, SOAP) and building API-based data integrations.

Salary: $180,000 per annum

Contact Information: Diverse Lynx LLC



  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    We are hiring a seasoned Azure Spark Engineering Specialist to join our team at Futran Tech Solutions Pvt. Ltd.The successful candidate will have extensive experience in designing, developing, and deploying scalable cloud-based data engineering solutions using Pyspark and Spark SQL programming.This role involves working closely with the development team to...


  • Minneapolis, Minnesota, United States STIAOS Technologies Full time

    Job Summary: We are seeking an Azure Data Scientist to design, develop, and implement data engineering solutions using Azure cloud services. The estimated salary for this role is $160,000 per year.Key Responsibilities:• Develop and maintain data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis.• Configure and manage Azure...


  • Minneapolis, Minnesota, United States Aloden, Inc. Full time

    Job DescriptionWe are seeking an experienced Azure Data Engineer Lead to join our team at Aloden, Inc. As a key member of our engineering team, you will be responsible for leading the design, development, and implementation of large-scale data solutions on Microsoft Azure.The ideal candidate will have a strong understanding of relational database concepts,...


  • Minneapolis, Minnesota, United States Omni Inclusive Full time

    We are looking for a skilled Senior Data Engineer to join our team at Omni Inclusive. This role offers a competitive salary range of $220,000 - $280,000 per year and comes with various benefits.About the RoleThe successful candidate will have extensive experience in designing and implementing large-scale data engineering solutions using Azure services.Main...


  • Minneapolis, Minnesota, United States Eateam Full time

    Job Description: We are looking for an experienced Data Engineer to join our team at Eateam. As a Sr. Data Engineer, you will play a key role in designing and implementing data pipelines that drive business growth. Your primary responsibilities will include developing scalable data pipelines using Azure Data Factory and Azure Databricks, implementing data...


  • Minneapolis, Minnesota, United States Aloden, Inc. Full time

    Key ResponsibilitiesThe Senior Azure Data Engineer Lead will be responsible for leading the design, development, and implementation of large-scale data solutions on Microsoft Azure, as well as collaborating with cross-functional teams to ensure smooth project delivery.The successful candidate will have a strong understanding of relational database concepts,...


  • Minneapolis, Minnesota, United States Omni Inclusive Full time

    Omni Inclusive is offering a highly competitive salary of $250,000 - $300,000 per year for this Senior Data Engineer role. The position requires a strong background in developing and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our...


  • Minneapolis, Minnesota, United States Simplicity Group Holdings Full time

    About the RoleWe are seeking a skilled Data Engineer Specialist to join our team at Simplicity Group Holdings. As a key member of our technology department, you will play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure.This is an exempt position with a base salary ranging from $110,000 to $130,000 per year,...


  • Minneapolis, Minnesota, United States SysMind Tech Full time

    At SysMind Tech, we are seeking a skilled Data Engineer Expert to join our team. As a key member of our engineering department, you will be responsible for designing and implementing scalable data systems that meet the needs of our organization.The ideal candidate will have a strong background in data engineering with experience in structured databases...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineering Lead to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing scalable ETL processes using Python, Apache Spark, and Azure Synapse. Your expertise in Azure Cloud, including SQL Pools and Spark...

  • Azure API Engineer

    3 days ago


    Minneapolis, Minnesota, United States TechWish Full time

    Job Title: Azure API EngineerWe are seeking an experienced Azure API Engineer to join our team at TechWish. As a key member of our engineering team, you will be responsible for designing and developing scalable Azure API solutions from the ground up.The ideal candidate will have 5+ years of experience with C#, .NET application development, SQL Server...


  • Minneapolis, Minnesota, United States Luminary Group Full time

    Job OverviewLuminary Group is a cutting-edge medical device company seeking an exceptional Technical Lead to spearhead the development of innovative solutions on the Azure platform.Key ResponsibilitiesLead a team of developers and engineers in designing, developing, and implementing medical device solutions utilizing Azure cloud services.Collaborate with...


  • Minneapolis, Minnesota, United States Goli Tech Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Goli Tech. As a Data Engineer, you will play a crucial role in designing and developing scalable data pipelines for reporting teams.ResponsibilitiesDesign and implement data extracts based on customer reporting needsCollaborate with IT Dev Ops partners to ingest extracts into a...


  • Minneapolis, Minnesota, United States The Dignify Solutions LLC Full time

    About the RoleThe Dignify Solutions LLC is looking for an experienced Azure DevOps Engineer to lead the implementation and maintenance of our Azure Kubernetes Platform.You will work with our development teams to design and implement scalable, secure, and efficient cloud-based solutions using Azure services.With a strong background in software development and...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Senior Data Engineer - Cloud Computing to lead our team in designing, implementing, and maintaining large-scale cloud-based data engineering solutions.The ideal candidate will have extensive experience with Pyspark, Spark SQL programming, and expertise in Azure services such as ADLS Gen2, AZ copy,...

  • Data Architect

    3 weeks ago


    Minneapolis, Minnesota, United States Eateam Full time

    Data Engineering ExpertiseWe are seeking a skilled Data Engineer to join our team at Eateam. The ideal candidate will have expertise in designing and creating Data Pipelines in the Azure Cloud using Azure Data factory, ADLS, Azure Databricks, Log Analytics, Application Insight, and Azure Monitor. Additionally, the candidate will have experience in writing...


  • Minneapolis, Minnesota, United States Improving Full time

    About the RoleWe are seeking a highly skilled Sr. Data Engineer to join our team at Improving. As a Data Engineer, you will be working with the latest cloud and technology stacks to help clients implement and mature their modern data architecture.You will work with tools/platforms like Kafka, Snowflake, and Databricks to help clients get the most out of...


  • Minneapolis, Minnesota, United States Simplicity Group Holdings Full time

    Job OverviewThis role is a crucial part of our data engineering team, responsible for designing and maintaining scalable data pipelines to drive business decisions.We are seeking an experienced Data Engineer to join our team in Minneapolis, MN. The ideal candidate will have hands-on experience with cloud platforms like AWS and Azure, as well as proficiency...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Description:Azure Data Engineer at Futran Tech Solutions Pvt. Ltd.About Us:Futran Tech Solutions Pvt. Ltd. is a leading provider of innovative data solutions, and we are currently seeking an experienced Azure Data Engineer to join our team.Key Responsibilities:Design and build complex data ingestion pipelines using ADF.Create efficient data processing...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Engineering Lead for Big Data IntegrationWe are seeking an experienced Cloud Engineering Lead to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have hands-on experience in designing, implementing, and managing big data integration solutions using Azure and Apache Spark.The estimated salary for this role is...