Azure Data Engineering Manager

14 hours ago


Charlotte, North Carolina, United States Insight Global Full time
Azure Data Engineering Manager

We are seeking an experienced Azure Data Engineering Manager to lead our team in designing, developing, and implementing data solutions that empower our organization to make informed decisions.

As a key member of our data engineering team, you will be responsible for guiding a team of data engineers, collaborating with cross-functional teams, and spearheading initiatives to enhance our data infrastructure, CI/CD pipelines, and analytics capabilities.

Key Responsibilities:
  • Apply advanced knowledge of data engineering principles, methodologies, and techniques to design and implement data loading and aggregation frameworks.
  • Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing on cloud-based solutions.
  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product, engineering, and business stakeholders.
  • Experience building enterprise systems, especially using Databricks, Snowflake, and cloud platforms like Azure, AWS, and GCP.
  • Leverage strong Python, Spark, and SQL programming skills to construct robust pipelines for efficient data processing and analysis.
  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
  • Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
  • Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
  • Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.

We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex, sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

Prior experience working with offshore teams and relevant certifications (e.g., Azure, Databricks, Snowflake) would be a plus. Experience working with Snowflake and/or Microsoft Fabric, as well as 12+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses, is required. Strong proficiency in SQL, specifically handling window functions like rank, average, and standard deviation, and Python and PySpark programming languages are also required.

Strong experience with the Azure cloud platform and extensive experience working with Databricks and Azure Data Factory for data lake and data warehouse solutions are highly desirable. Experience in implementing CI/CD pipelines for automating build, test, and deployment processes and hands-on experience with big data technologies (such as Hadoop, Spark, Kafka) are also highly valued.



  • Charlotte, North Carolina, United States InterEx Group Full time

    {"h1": "Azure Data Architect Opportunity", "p": "We are seeking an experienced Azure Data Architect to join our team at InterEx Group. As a key member of our data infrastructure team, you will be responsible for designing and implementing data solutions on the Azure platform. Key Responsibilities: * Design and implement data solutions on the Azure...


  • Charlotte, North Carolina, United States InterEx Group Full time

    Job Title: Azure Data ArchitectWe are seeking a highly skilled Azure Data Architect to join our team at InterEx Group, a leading provider of innovative data solutions. This is a remote contract opportunity that will allow you to work from anywhere in the US and make a significant impact on our client's data infrastructure.Key Responsibilities:Design and...


  • Charlotte, North Carolina, United States Brightspeed Full time

    Job Title: IT Manager, Data EngineeringJob SummaryBrightspeed is seeking an experienced IT Manager, Data Engineering to lead our team of analysts and data engineers in delivering new functionality on the data warehouse and analytics data platforms. As a key member of our team, you will be responsible for managing priorities, budgets, staffing, and skill...


  • Charlotte, North Carolina, United States Microsoft Full time

    OverviewMicrosoft is seeking a highly skilled Principal Software Engineering Manager to lead our Azure Storage team. As a key member of our engineering organization, you will be responsible for driving the development and delivery of our cloud storage services.ResponsibilitiesManage a team of engineers to design, develop, and deploy cloud storage...

  • Lead Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Circle K Full time

    Job Description:As the Technical Lead Data Engineer at Circle K, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...


  • Charlotte, North Carolina, United States Strategic Staffing Solutions Full time

    Position Overview:Strategic Staffing Solutions is seeking a skilled Azure Cybersecurity Analyst to enhance the security posture of our esteemed client.Job Title: Azure Cybersecurity AnalystJob Code: 237154Work Arrangement: HybridContract Duration: 12 monthsCompensation: $65-75 per hourEssential Skills:In-depth knowledge of Azure data protection strategies...

  • Data Engineering Lead

    2 weeks ago


    Charlotte, North Carolina, United States Hunt Hive Talent Full time

    About Hunt Hive TalentWe are a leading talent recruiting agency dedicated to connecting top talent with exciting opportunities. Our mission is to empower businesses and professionals to reach new heights.About the RoleWe are seeking a highly skilled Data Engineering Lead to join our client's team. As a key member of the organization, you will be responsible...


  • Charlotte, North Carolina, United States Microsoft Full time

    OverviewMicrosoft is seeking a highly skilled Principal Software Engineering Manager to lead our Azure Storage team. As a key member of our engineering organization, you will be responsible for driving the development and delivery of our cloud storage services.ResponsibilitiesManage a team of engineers to design, develop, and deploy cloud storage...

  • Senior Data Engineer

    3 weeks ago


    Charlotte, North Carolina, United States Circle K Full time

    Job SummaryWe are seeking a highly skilled and experienced Lead Data Architect to join our team at Circle K. As a key member of our organization, you will be responsible for spearheading the design, development, and implementation of data solutions that drive business growth and innovation.Key ResponsibilitiesData Engineering: Design and implement data...


  • Charlotte, North Carolina, United States Strategic Staffing Solutions Full time

    Position Overview:Strategic Staffing Solutions is seeking an Azure Cybersecurity Analyst to support one of our esteemed clients.Job Title: Azure Cybersecurity AnalystJob Code: 237154Work Arrangement: HybridContract Duration: 12 monthsCompensation: $65-75 per hourEssential Qualifications: Bachelor's degree in computer science, information security, or a...


  • Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Azure Active Directory EngineerWe are seeking an experienced Azure Active Directory Engineer to support our logistics client in their Office 365 migration. The successful candidate will be responsible for assisting with assessment and migration activities from one environment to another, including Azure Tenant and on-prem active directory.Key...


  • Charlotte, North Carolina, United States NTT DATA Full time

    Job Title: Technical Operations Risk EngineerWe are seeking a skilled Technical Operations Risk Engineer to join our team in Charlotte, North Carolina, or other locations. This role involves overseeing activities within Application & Cloud Transformation and monitoring operational risk.Key Responsibilities:Monitor and manage operational risk within...


  • Charlotte, North Carolina, United States Mediabistro Full time

    Job Title: Azure AD Support EngineerWe are seeking a skilled Azure AD Support Engineer to join our team at Mediabistro and help us tackle various technical issues related to authentication and identity management.About the Team:Our team is responsible for receiving and resolving technical cases related to Azure Active Directory, Identity Synchronization...


  • Charlotte, North Carolina, United States Jobot Full time

    Job OverviewRemote Senior Azure Site Reliability Engineer needed at a dynamic technology consulting firmAbout Us:We are in search of a Senior Cloud SRE Engineer with a strong foundation in Azure Cloud to become a vital part of our fully remote workforce. In this position, you will play a key role in executing the comprehensive implementation of Site...

  • Big Data Engineer

    19 hours ago


    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Big Data EngineerAt Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and MapR.Key Responsibilities:Design and...


  • Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Engineer with expertise in data integration to join our team at NTT DATA. As a key member of our Strategic Platform Engineering team, you will play a critical role in designing and implementing cloud-based data integration solutions that drive business value and innovation.Key ResponsibilitiesDesign and...

  • AI-ML Engineer

    3 weeks ago


    Charlotte, North Carolina, United States AIT Global Full time

    Job Title: AI-ML Engineer - Gen AI Data SpecialistLocation: RemoteKey Responsibilities:Participate in developing Generative AI & Traditional AI Platform Capabilities on enterprise on-prem and cloud platforms.Primary responsibilities include working on vector database, creating index, writing Python code for data ingestion, working with content management...

  • Data Engineer

    1 week ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    Machine Learning Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Randstad Digital. As a Data Engineer, you will play a critical role in designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning models and applications.Key...

  • Power BI Developer

    2 weeks ago


    Charlotte, North Carolina, United States Insight Global Full time

    Job DescriptionJob Title: Power BI DeveloperJob Type: Full-timeCompany: Insight GlobalLocation: Remote/HybridJob Category: Data Science & AnalyticsAbout the Company: Insight Global is a leading provider of professional services and solutions.About the Role:We are seeking an experienced Power BI Developer to join our team. As a Power BI Developer, you will be...

  • Data Engineer

    5 days ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    Machine Learning Data EngineerWe are seeking a highly skilled Machine Learning Data Engineer to join our team at Randstad Digital. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines and platforms that support the development and deployment of machine learning...