Azure Data Engineering Manager

5 days ago


Charlotte, North Carolina, United States Insight Global Full time

Job Summary

Azure Data Engineering Manager is responsible for spearheading the design, development, and implementation of data solutions to empower the organization to derive actionable insights from intricate datasets.

The Manager will lead a team of data engineers, foster collaboration with cross-functional teams, and spearhead initiatives to fortify data infrastructure, CI/CD pipelines, and analytics capabilities.

Key Responsibilities

  • Apply advanced knowledge of Data Engineering principles, methodologies, and techniques to design and implement data loading and aggregation frameworks.
  • Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing on cloud migration.
  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet product, engineering, and business needs.
  • Experience building enterprise systems, especially using Databricks, Snowflake, and Azure, AWS, GCP platforms.
  • Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate data solution delivery.
  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
  • Drive continuous improvement initiatives to enhance data infrastructure performance, reliability, and scalability.
  • Collaborate with data scientists, analysts, and stakeholders to understand business requirements and translate them into technical solutions.
  • Implement best practices for data governance, security, and compliance to ensure data integrity and confidentiality.

Requirements

  • 12+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
  • 2+ years of experience working as a Manager.
  • Strong proficiency in SQL, specifically handling window functions like rank, average, standard deviation.
  • Python and PySpark programming languages.
  • Strong experience with the Azure cloud platform.
  • Experience working in a retail environment.
  • Extensive experience working with Databricks and Azure Data Factory for data lake and data warehouse solutions.
  • Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
  • Hands-on experience with big data technologies like Hadoop, Spark, Kafka.

About Insight Global

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.

We are an equal opportunity/affirmative action employer that believes everyone matters.

Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex, sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:



  • Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Lead Azure Data EngineerJob Summary:We are seeking an experienced Lead Azure Data Engineer to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data solutions within Azure to empower our organization to derive actionable insights from intricate...


  • Charlotte, North Carolina, United States Trident Consulting Full time

    Job Title: Microsoft Cloud Data Engineer Azure/FabricTrident Consulting is seeking a highly skilled Microsoft Cloud Data Engineer Azure/Fabric to join our team. As a global leader in business and technology services, we are committed to delivering the best and brightest individuals in the industry for our clients' toughest requirements.Job Summary:We are...


  • Charlotte, North Carolina, United States Trident Consulting Full time

    Job Title: Microsoft Cloud Data Engineer Azure/FabricTrident Consulting is seeking a highly skilled Microsoft Cloud Data Engineer Azure/Fabric to join our team. As a global leader in business and technology services, we are committed to delivering the best and brightest individuals in the industry for our clients' toughest requirements.Job Summary:We are...

  • Azure Cloud Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Motion Recruitment Full time

    Job Title: Azure Cloud EngineerWe are seeking a highly skilled Azure Cloud Engineer to design and implement Azure hybrid cloud and cloud-native solutions using Microsoft's IaaS, PaaS, and SaaS offerings. This role will also focus on disaster recovery services leveraging Azure's cloud infrastructure.Key Responsibilities:* Develop and maintain a secure,...

  • Azure Data Architect

    1 month ago


    Charlotte, North Carolina, United States InterEx Group Full time

    {"h1": "Azure Data Architect Opportunity", "p": "We are seeking an experienced Azure Data Architect to join our team at InterEx Group. As a key member of our data infrastructure team, you will be responsible for designing and implementing data solutions on the Azure platform. Key Responsibilities: * Design and implement data solutions on the Azure...

  • Azure DevOps Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Amaze Systems Inc. Full time

    Job OverviewWe are seeking a highly skilled DevOps Engineer with expertise in Azure to join our team at Amaze Systems Inc.The ideal candidate will have a strong background in designing, implementing, and maintaining end-to-end machine learning pipelines in Azure using Azure Machine Learning, Azure DevOps, Helm charts, and Prometheus.Key...


  • Charlotte, North Carolina, United States InterEx Group Full time

    Azure Data Architect OpportunityWe are seeking an experienced Azure Data Architect to join our team at InterEx Group. This role will be pivotal in driving our migration to Azure, leveraging your expertise in Azure Data Lake, SQL, Databricks, and PowerShell Scripting.Key Responsibilities:Design and implement data solutions on the Azure platform.Lead the...

  • Azure Cloud Engineer

    4 weeks ago


    Charlotte, North Carolina, United States Martello Re Limited Full time

    Job Title: Azure Cloud EngineerWe are seeking a highly skilled Azure Cloud Engineer to join our team at Martello Re Limited. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining secure and scalable cloud infrastructure on the Azure platform.Key Responsibilities:Design and implement secure cloud...

  • Azure Entra Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Digital Technology Solutions Full time

    Job Title: Azure Entra EngineerWe are seeking a highly skilled Azure Entra Engineer to join our team at Digital Technology Solutions. As an Azure Entra Engineer, you will be responsible for designing, implementing, and managing identity and access management solutions for our clients.Key Responsibilities:Design and implement identity and access management...


  • Charlotte, North Carolina, United States Microsoft Full time

    OverviewMicrosoft is seeking a highly skilled Principal Software Engineering Manager to lead our Azure Storage team. As a key member of our engineering organization, you will be responsible for driving the development and delivery of our cloud storage service, which hosts data for some of the world's largest companies.The ideal candidate will have a strong...


  • Charlotte, North Carolina, United States Global Channel Management Full time

    Azure Entra Engineer Job DescriptionGlobal Channel Management is seeking an experienced Azure Entra Engineer to join our team. The ideal candidate will have a strong background in identity access management, OU hierarchies, and RBAC.Key Responsibilities:Design and implement directory infrastructure, including FSMO roles, trusts, and Kerberos KDCs.Create and...


  • Charlotte, North Carolina, United States Chatham Financial Full time

    About the RoleWe are seeking a highly skilled Data Engineering Manager to lead our data platform evolution at Chatham Financial. As a key member of our team, you will be responsible for creating strategies and leading the creation of Data Lake and Data Warehouse platforms, as well as ETL processes that feed these new systems.Key ResponsibilitiesLead the...

  • Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    We are seeking a skilled Data Analytics Engineer to join our team at Randstad Digital. This hybrid role requires 1 day of onsite work in Charlotte, focusing on data visualization and analytics.Key Responsibilities:Develop and manage reports and dashboards using Tableau or Power BI.Perform exploratory data analysis (EDA) and apply data science techniques like...


  • Charlotte, North Carolina, United States Microsoft Full time

    OverviewMicrosoft is seeking a highly skilled Principal Software Engineering Manager to lead our Azure Storage team. As a key member of our engineering organization, you will be responsible for driving the development and delivery of our cloud storage services.ResponsibilitiesManage a team of engineers to design, develop, and deploy cloud storage...


  • Charlotte, North Carolina, United States Forsyth Barnes Full time

    Job Title: Head of Data Engineering & Business IntelligenceAbout the Role:Forsyth Barnes is seeking a seasoned Data Engineering Leader to spearhead our data strategy and drive business growth through data-driven insights. As the Head of Data Engineering & Business Intelligence, you will lead a team of data experts in designing, building, and maintaining our...


  • Charlotte, North Carolina, United States Global Channel Management Full time

    Azure Entra Engineer RoleWe are seeking an experienced Azure Entra Engineer to join our team at Global Channel Management. The successful candidate will be responsible for designing, implementing, and managing directory infrastructure, including FSMO roles, trusts, Kerberos KDCs, replication topology, and schema.Key Responsibilities:Creation and management...


  • Charlotte, North Carolina, United States The Select Group Full time

    Job SummaryAs a Technical Lead - Data Engineer, you will be responsible for designing, developing, and implementing data solutions to empower our organization with actionable insights from complex datasets.You will lead a team of data engineers, collaborate with cross-functional teams, and drive initiatives to strengthen our data infrastructure, CI/CD...


  • Charlotte, North Carolina, United States Driven Brands Full time

    Job Summary:We are seeking a highly skilled Data Engineering Manager to lead our data engineering team at Driven Brands. As a key member of our organization, you will be responsible for overseeing the design, development, and maintenance of our data infrastructure and analytics solutions. Your leadership will ensure the delivery of high-quality, scalable...


  • Charlotte, North Carolina, United States Pyramid Consulting Full time

    Job Title: Senior Azure IAM EngineerJob Description:We are seeking a highly skilled Senior Azure IAM Engineer to join our team at Pyramid Consulting. As a key member of our team, you will be responsible for designing, developing, testing, implementing, and integrating Identity and Access Management (IAM) systems and solutions.Key Responsibilities:Design and...


  • Charlotte, North Carolina, United States Digital Technology Solutions Full time

    Job Title: Azure Entra EngineerWe are seeking an experienced Azure Entra Engineer to join our team at Digital Technology Solutions. As a key member of our technology team, you will be responsible for designing, implementing, and maintaining secure and scalable directory infrastructure solutions.Key Responsibilities:Design and implement directory...