Azure Data Engineer

3 weeks ago

Huntersville, United States SMART IT People Full time

Azure Data Engineer

Contract opportunity

Huntersville, NC (onsite/hybrid or remote)


SMART IT People has a contract opportunity for an experienced Azure Data Engineer. This is an ongoing contract with the potential to convert to full-time if desired. The ideal candidate will have a strong background in data engineering, Azure Data Factory (ADF), Azure Synapse, along with experience ingesting and consolidating data from various data sources including multiple ERP systems. This role requires expertise in designing and implementing data pipelines, data transformation, and data warehousing solutions using Azure services. The Senior Azure Data Engineer will play a crucial role in ensuring the security, reliability, and performance of our data infrastructure while collaborating with cross-functional teams to meet business objectives.


Requirements:

  1. Minimum of Bachelors’ degree in Computer Science, Engineering, Mathematics or related fields
  2. 5+ years of work experience in designing, developing, and troubleshooting complex SQL queries, on DBMS solutions such as Snowflake, Oracle, MS SQL Server, PostgreSQL, and MySQL
  3. 3+ years of hands-on experience in ETL/ELT tools
  4. 3+ years of work experience with Data Platforms
  5. 1+ year development experience in Python or similar scripting languages for data automation
  6. Proven experience as an Azure Data Engineer or similar role, with a focus on designing and implementing data pipelines and data warehousing solutions using Azure services.
  7. Expertise in Azure Data Factory (ADF), Azure Synapse, and multiple ERP systems.
  8. Experience working with On Premise and Cloud systems and data sources
  9. Strong analytical skills related to working with unstructured datasets and designing efficient data processing workflows.
  10. Proficiency in coding and scripting languages such as SQL, Python, or PowerShell.
  11. Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.
  12. Excellent communication skills, with the ability to collaborate effectively with cross-functional teams and drive alignment towards common goals.
  13. Regularly check and maintain data quality by validating data against predefined standards and data governance policies.
  14. Fix data quality issues and errors in data pipelines to maintain accurate data.


Nice to Have:

  1. Certifications such as Azure Solutions Architect Expert or Azure DevOps Engineer Expert.
  2. Experience with other Azure services and frameworks beyond ADF and Synapse including Azure Databricks and Snowflake.
  3. Knowledge of data modeling and analysis techniques using Azure services like Azure Analysis Services.
  4. Experience with Microsoft Fabric
  5. Experience with Informatica Data Quality and MDM


Responsibilities:

  1. Collaborate with stakeholders to understand data requirements and design and maintain secure and compliant data processing pipelines using Azure Data Factory, Azure Synapse, and other tools.
  2. Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure, ensuring efficient and reliable data transfer.
  3. Perform data transformation and processing tasks using Azure Synapse to prepare data for analysis and reporting.
  4. Select and manage appropriate data storage solutions in Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage, based on data requirements.
  5. Successful data movements and transformations using various file formats such as Delta, Parquet, Avro, and CSV.
  6. Implement and optimize data warehousing solutions using Azure Synapse SQL and Azure Synapse Analytics to support large-scale analytics and reporting.
  7. Collaborate with data scientists and analysts to design and implement data models for analytical workloads using Azure Analysis Services or Power BI.
  8. Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.
  9. Support and Troubleshoot On Premise gateways

  • Data Engineer

    3 weeks ago

    Huntersville, United States Optomi Full time

    Note: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...

  • Data Engineer

    3 weeks ago

    Huntersville, United States Optomi Full time

    Note: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...

  • Sourcing Analyst, CI

    1 week ago

    Huntersville, United States NWL Full time

    Description: The Analyst, Procurement – Competitive Intelligence & Innovation, will play an integral role in helping the company achieve its ambition by ensuring that Newell Brands is leveraging scientific methods and analytics to drive Enterprise Procurement improvements. Reporting to the Associate Manager, Procurement – Competitive Intelligence &...

  • Senior Pricing Analyst

    3 weeks ago

    Huntersville, United States Covia Full time

    Sr. Pricing Analyst Covia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to...

  • Quality Assurance Manager-Manufacturing Operations

    3 weeks ago

    Huntersville, United States Macpower Digital Assets Edge Private Limited (MDA Edge) Full time

    Do We Have Signing Bonus: YES, Negotiable Job Summary: Provide leadership and support at all levels of the manufacturing operations, helping to achieve operational excellence, superior product quality and customer experience objectives. Drive consistent processes and metrics in support of One Southwire that align supplier and material quality, sales, product...

  • Distribution Technician I

    7 days ago

    Huntersville, United States TRC Companies Full time

    About Us Groundbreaker. Game changer. Pioneer.TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for breakthrough...

  • Distribution Technician I

    1 week ago

    Huntersville, United States TRC Companies, Inc. Full time

    About Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...

  • Financial Analyst

    4 weeks ago

    Huntersville, United States Covia Full time

    Covia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to building partnerships...

  • Business Development Manager

    3 weeks ago

    Huntersville, United States Bürkert Fluid Control Systems Full time

    Where would you like to shape the success of your future career: At a worldwide leading manufacturer of process measuring and control technology? In a family- owned company that values its more than 3,500 employees in more than 30 countries and sees them all as individuals? In a team that breaks new ground with courage and passion? Did you answer "Yes" three...

  • Business Development Manager

    1 day ago

    Huntersville, United States Bürkert Fluid Control Systems Full time

    Where would you like to shape the success of your future career: At a worldwide leading manufacturer of process measuring and control technology? In a family- owned company that values its more than 3,500 employees in more than 30 countries and sees them all as individuals? In a team that breaks new ground with courage and passion? Did you answer "Yes" three...

  • Senior Accountant

    6 days ago

    Huntersville, United States Structural Integrity Associates, Inc. Full time

    Job DescriptionJob DescriptionStructural Integrity Associates, Inc. (SIA) is seeking a Senior Accountant to join our Finance team in our Huntersville, North Carolina office.Primary Responsibilities: Prepare monthly journal entries, including sales, COGS, other SG&A expenses, intercompany transactions, and intercompany eliminationsAssist in company/subsidiary...

  • Senior Accountant

    2 weeks ago

    Huntersville, United States Structural Integrity Associates, Inc. Full time

    Job DescriptionJob DescriptionStructural Integrity Associates, Inc. (SIA) is seeking a Senior Accountant to join our Finance team in our Huntersville, North Carolina office.Primary Responsibilities: Prepare monthly journal entries, including sales, COGS, other SG&A expenses, intercompany transactions, and intercompany eliminationsAssist in company/subsidiary...

  • Distribution Technician I

    1 week ago

    Huntersville, North Carolina, United States TRC Companies, Inc. Full time

    About Us: Groundbreaker. Game changer. Pioneer.   TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...