Lead Azure Data Engineer

3 weeks ago

charlotte, United States Insight Global Full time

POSITION: Lead Azure Data Engineer

LOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)

PAY RANGE: $80.00 - $87.00 per hour W2

DURATION: 6-Month Contract-To-Hire (100% career opportunity)


MUST-HAVES:

  • 10+ years of experience in a data engineering role, with expertise in Azure, designing and building data pipelines, ETL processes, and data warehouses.
  • 2+ years of experience working as a Lead Engineer and developing/mentoring other engineers.
  • 5+ years of experience with Azure Cloud Platform.
  • Extensive experience working with Azure Databricks and Azure Data Factory for Data Lake and Data Warehouse solutions.
  • Must have experience with Azure Synapse Analytics, Databricks Unity Catalog and Azure Logic Apps.
  • Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
  • Advanced proficiency in SQL, specifically being able to handle window functions like rank, average, standard deviation, etc.
  • Python, Spark and PySpark programming languages.
  • Hands-on experience with big data technologies (such as Hadoop, Spark, Kafka).


PLUSSES:

  • Experience working in the retail industry/sector.
  • Relevant certifications (e.g., Azure, Databricks, Snowflake, etc.).
  • Experience working with Snowflake and/or Microsoft Fabric.


SUMMARY:

A top Insight Global client in Charlotte, NC is looking for Lead Azure Data Engineer to join their team. As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions within Azure, aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities.


Responsibilities are shown below:

  • Experience building Azure enterprise systems using Databricks, Unity Catalog, Logic Apps, Synapse and Snowflake.
  • Leverage strong SQL, Python, Spark and PySpark programming skills to construct robust pipelines for efficient data processing and analysis.
  • Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
  • Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
  • Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
  • Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
  • Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.




Compensation:

$80.00 - $87.00/hr


Exact compensation may vary based on several factors, including skills, experience, and education.


Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

  • Lead Azure Data Engineer

    3 weeks ago

    Charlotte, United States Insight Global Full time

    POSITION: Lead Azure Data EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $80.00 - $87.00 per hour W2DURATION: 6-Month Contract-To-Hire (100% career opportunity)MUST-HAVES:10+ years of experience in a data engineering role, with expertise in Azure, designing and building data pipelines, ETL processes, and data warehouses.2+ years of...

  • Lead Azure Data Engineer

    3 weeks ago

    charlotte, United States Insight Global Full time

    POSITION: Lead Azure Data EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $80.00 - $87.00 per hour W2DURATION: 6-Month Contract-To-Hire (100% career opportunity)MUST-HAVES:10+ years of experience in a data engineering role, with expertise in Azure, designing and building data pipelines, ETL processes, and data warehouses.2+ years of...

  • Lead Azure Data Engineer

    1 month ago

    charlotte, United States Insight Global Full time

    POSITION: Lead Azure Data EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $80.00 - $85.00 per hour W2DURATION: 6-Month Contract-To-Hire (100% career opportunity)MUST-HAVES:10+ years of experience in a data engineering role, with expertise in Azure, designing and building data pipelines, ETL processes, and data warehouses.2+ years of...

  • Lead Azure Data Engineer

    2 weeks ago

    Charlotte, NC, United States Insight Global Full time

    POSITION: Lead Azure Data EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $80.00 - $87.00 per hour W2DURATION: 6-Month Contract-To-Hire (100% career opportunity)MUST-HAVES:10+ years of experience in a data engineering role, with expertise in Azure, designing and building data pipelines, ETL processes, and data warehouses.2+ years of...

  • Azure Data Engineering Manager

    4 weeks ago

    Charlotte, North Carolina, United States Insight Global Full time

    Job SummaryAzure Data Engineering Manager is responsible for spearheading the design, development, and implementation of data solutions to empower the organization to derive actionable insights from intricate datasets.The Manager will lead a team of data engineers, foster collaboration with cross-functional teams, and spearhead initiatives to fortify data...

  • Azure Data Engineer

    3 weeks ago

    charlotte, United States Euclid Innovations Full time

    One of our direct client is in need of Azure Data Engineer with heavy focus on Pyspark, Databricks, ADF:Job Duties:Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in data bricks environment to process and...

  • Azure Data Engineer

    3 weeks ago

    charlotte, United States Euclid Innovations Full time

    One of our direct client is in need of Azure Data Engineer with heavy focus on Pyspark, Databricks, ADF:Job Duties:Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in data bricks environment to process and...

  • Azure Data Engineer

    3 weeks ago

    Charlotte, United States Euclid Innovations Full time

    One of our direct client is in need of Azure Data Engineer with heavy focus on Pyspark, Databricks, ADF:Job Duties:Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in data bricks environment to process and...

  • Data Engineering Team Lead

    4 weeks ago

    Charlotte, North Carolina, United States The Select Group Full time

    Job Title: Technical Lead - Data EngineerAbout the Role:We are seeking a highly skilled Technical Lead - Data Engineer to spearhead the design, development, and implementation of data solutions that empower our organization to derive actionable insights from intricate datasets. As a Technical Lead, you will take the lead in guiding a team of data engineers,...

  • Azure Data Architect

    4 weeks ago

    Charlotte, North Carolina, United States InterEx Group Full time

    Azure Data Architect OpportunityWe are seeking an experienced Azure Data Architect to join our team at InterEx Group. This role will be pivotal in driving our migration to Azure, leveraging your expertise in Azure Data Lake, SQL, Databricks, and PowerShell Scripting.Key Responsibilities:Design and implement data solutions on the Azure platform.Lead the...

  • Lead Data QA Engineer

    1 month ago

    charlotte, United States Insight Global Full time

    POSITION: Lead Data Quality Assurance EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $70.00 per hour W2DURATION: 12-Month Contract + Extensions & Potential for FTE Conversion!MUST-HAVES:10+ years of Quality Assurance Testing experience.6+ years of specific "Data-Centric" QA experience.2+ years of experience working in a "Lead"...

  • Lead Data QA Engineer

    1 month ago

    Charlotte, United States Insight Global Full time

    POSITION: Lead Data Quality Assurance EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $70.00 per hour W2DURATION: 12-Month Contract + Extensions & Potential for FTE Conversion!MUST-HAVES:10+ years of Quality Assurance Testing experience.6+ years of specific "Data-Centric" QA experience.2+ years of experience working in a "Lead"...

  • Lead Data QA Engineer

    1 month ago

    Charlotte, United States Insight Global Full time

    POSITION: Lead Data Quality Assurance EngineerLOCATION: Charlotte, NC 28217 (Hybrid 3 times per week)PAY RANGE: $70.00 per hour W2DURATION: 12-Month Contract + Extensions & Potential for FTE Conversion!MUST-HAVES:10+ years of Quality Assurance Testing experience.6+ years of specific "Data-Centric" QA experience.2+ years of experience working in a "Lead"...

  • Azure Data Engineer

    2 weeks ago

    Charlotte, NC, United States Euclid Innovations Full time

    One of our direct client is in need of Azure Data Engineer with heavy focus on Pyspark, Databricks, ADF:Job Duties:Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in data bricks environment to process and...

  • Lead Data Quality Assurance Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Lead Data Quality Assurance EngineerJob Summary:A top Insight Global client in Charlotte, NC is seeking a Lead Data Quality Assurance Engineer to join their team. The successful candidate will assist in data improvement initiatives across the organization, working closely with data engineering, data analytics, and other cross-functional teams that...

  • Data Quality Assurance Lead

    1 month ago

    charlotte, United States Amtex Systems Inc. Full time

    Role: Data Quality Assurance LeadLocation: Hybrid in Charlotte, NCDuration: 6-month contract to potential hireQualifications:• Experience working with business stakeholders and/or product owners to understand data requirements and business cases.• Minimum of 12 years of experience as a QA/Tester with a focus on data-centric projects, with at least 2...

  • Data Quality Assurance Lead

    1 month ago

    Charlotte, United States Amtex Systems Inc. Full time

    Role: Data Quality Assurance LeadLocation: Hybrid in Charlotte, NCDuration: 6-month contract to potential hireQualifications:• Experience working with business stakeholders and/or product owners to understand data requirements and business cases.• Minimum of 12 years of experience as a QA/Tester with a focus on data-centric projects, with at least 2...

  • Data Quality Assurance Lead

    1 month ago

    Charlotte, United States Amtex Systems Inc. Full time

    Role: Data Quality Assurance LeadLocation: Hybrid in Charlotte, NCDuration: 6-month contract to potential hireQualifications:• Experience working with business stakeholders and/or product owners to understand data requirements and business cases.• Minimum of 12 years of experience as a QA/Tester with a focus on data-centric projects, with at least 2...

  • Data Quality Assurance Lead

    3 weeks ago

    Charlotte, United States Progilisys Solutions, A Talent Groups Company Full time

    Hybrid Remote (3 Days in Office in Charlotte, North Carolina)Contract to HireMust be eligible to work in the U.S. without sponsorship.Stack Ranked Experience (Must Have):ETL TestingAzure Data Analytics (Data Warehouse, Power BIAzure Data Factory, Databricks, PythonAgile MethodologyManagerial Experience of a Small QA TeamPosition Summary:The Data Quality...

  • Data Quality Assurance Lead

    3 weeks ago

    charlotte, United States Progilisys Solutions, A Talent Groups Company Full time

    Hybrid Remote (3 Days in Office in Charlotte, North Carolina)Contract to HireMust be eligible to work in the U.S. without sponsorship.Stack Ranked Experience (Must Have):ETL TestingAzure Data Analytics (Data Warehouse, Power BIAzure Data Factory, Databricks, PythonAgile MethodologyManagerial Experience of a Small QA TeamPosition Summary:The Data Quality...