Azure Data Engineer

3 weeks ago


Huntersville, United States SMART IT People Full time

Huntersville, NC (Preference for onsite/hybrid but will consider 100% remote for the right candidate) SMART IT People has a contract opportunity for an experienced Azure Data Engineer.

The ideal candidate will have a strong background in data engineering, Azure Data Factory (ADF), Azure Synapse, along with experience ingesting and consolidating data from various data sources including multiple ERP systems. This role requires expertise in designing and implementing data pipelines, data transformation, and data warehousing solutions using Azure services. The Senior Azure Data Engineer will play a crucial role in ensuring the security, reliability, and performance of our data infrastructure while collaborating with cross-functional teams to meet business objectives. Requirements: Minimum of Bachelors’ degree in Computer Science, Engineering, Mathematics or related fields 5+ years of work experience in designing, developing, and troubleshooting complex SQL queries, on DBMS solutions such as Snowflake, Oracle, MS SQL Server, PostgreSQL, and MySQL 3+ years of hands-on experience in ETL/ELT tools 3+ years of work experience with Data Platforms 1+ year development experience in Python or similar scripting languages for data automation Proven experience as an Azure Data Engineer or similar role, with a focus on designing and implementing data pipelines and data warehousing solutions using Azure services. Expertise in Azure Data Factory (ADF), Azure Synapse, and multiple ERP systems. Experience working with On Premise and Cloud systems and data sources Strong analytical skills related to working with unstructured datasets and designing efficient data processing workflows. Proficiency in coding and scripting languages such as SQL, Python, or PowerShell. Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation. Excellent communication skills, with the ability to collaborate effectively with cross-functional teams and drive alignment towards common goals. Regularly check and maintain data quality by validating data against predefined standards and data governance policies. Fix data quality issues and errors in data pipelines to maintain accurate data. Nice to Have: Certifications such as Azure Solutions Architect Expert or Azure DevOps Engineer Expert. Experience with other Azure services and frameworks beyond ADF and Synapse including Azure Databricks and Snowflake. Knowledge of data modeling and analysis techniques using Azure services like Azure Analysis Services. Experience with Microsoft Fabric Experience with Informatica Data Quality and MDM Responsibilities: Collaborate with stakeholders to understand data requirements and design and maintain secure and compliant data processing pipelines using Azure Data Factory, Azure Synapse, and other tools. Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure, ensuring efficient and reliable data transfer. Perform data transformation and processing tasks using Azure Synapse to prepare data for analysis and reporting. Select and manage appropriate data storage solutions in Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage, based on data requirements. Successful data movements and transformations using various file formats such as Delta, Parquet, Avro, and CSV. Implement and optimize data warehousing solutions using Azure Synapse SQL and Azure Synapse Analytics to support large-scale analytics and reporting. Collaborate with data scientists and analysts to design and implement data models for analytical workloads using Azure Analysis Services or Power BI. Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation. Support and Troubleshoot On Premise gateways

#J-18808-Ljbffr


  • Data Engineer

    1 month ago


    Huntersville, United States Optomi Full time

    Note: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...

  • Data Engineer

    1 month ago


    Huntersville, United States Optomi Full time

    Note: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...

  • Databricks Engineer

    3 days ago


    Huntersville, United States Diverse Lynx Full time

    Design and implementation of websites, programs and applications that execute within Microsoft's. NET framework with Azure Web Apps. •Logics & Code development using Azure Functions/ADF/Data Bricks/SQLs wherever applicable •Experience in Data Modeling •Experience with databases and data warehousing •Proficient in writing Spark code in below...


  • Huntersville, United States Oerlikon Group Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Do you like to be on the cutting edge of innovation? If you’re motivated confident and looking to challenge yourself to be your best, then you’ve come to the right place! This is a role where you to showcase your...


  • Huntersville, United States Quantum Technology Group, LLC Full time

    Job DescriptionJob DescriptionTITLE: Sr. Network EngineerDEPARTMENT: Information TechnologyREPORTS TO: Team LeadSUMMARY:Quantum Technology Group is seeking a multitalented Sr. Network Engineer to perform a variety of technical tasks related to enterprise infrastructure and operations. This position will be responsible for technical engineering and...

  • Sourcing Analyst, CI

    10 hours ago


    Huntersville, United States Yankee Candle Full time

    Job Number: The Analyst, Procurement – Competitive Intelligence & Innovation, will play an integral role in helping the company achieve its ambition by ensuring that Newell Brands is leveraging scientific methods and analytics to drive Enterprise Procurement improvements. Reporting to the Associate Manager, Procurement – Competitive Intelligence &...


  • Huntersville, United States JSCM Group Full time

    Forward to localhost with Webhook.site CLI whcli forward --token=e1f9e6f1-0042-4d86-a9cc-6e1f629963af Install whcli Webhook.site generates free, unique URLs and e-mail addressesand lets you see everything that’s sent there instantly. Built-in integrations: Google Sheets, Excel, Slack, Dropbox, SFTP, Email,Push Notifications, and more URLs never expire and...


  • Huntersville, United States Covia Full time

    Sr. Pricing Analyst Covia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to...


  • Huntersville, United States Macpower Digital Assets Edge Private Limited (MDA Edge) Full time

    Do We Have Signing Bonus: YES, Negotiable Job Summary: Provide leadership and support at all levels of the manufacturing operations, helping to achieve operational excellence, superior product quality and customer experience objectives. Drive consistent processes and metrics in support of One Southwire that align supplier and material quality,...


  • Huntersville, United States Blue Signal Search Full time

    Our client is a large-scale manufacturing company that works with Fortune 500 companies and household brands to develop winning products. They’re seeking a talented Senior Formulation Scientist to join our dynamic team and drive innovation in the Over the Counter (OTC) pharmaceutical and supplement markets. The Senior Formulation Scientist will play a...

  • Inspector

    6 days ago


    Huntersville, United States Oerlikon Full time

    Inspector  We are looking for a  3D Scanning Inspector  for our Huntersville, NC facility. In this role, you will be responsible for inspection of both conventionally machined as well as additively manufactured parts utilizing 3D scanning equipment (GOM) and generating inspection reports that comply with customer specifications. The 3D scanning...


  • Huntersville, United States TRC Companies, Inc. Full time

    About Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...


  • Huntersville, United States TRC Companies, Inc. Full time

    About Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...


  • Huntersville, United States TRC Companies, Inc. Full time

    About Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...


  • Huntersville, United States TRC Companies, Inc. Full time

    About Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...


  • Huntersville, United States American Tire Full time

    Are you looking for an opportunity to turn your ambition and your people skills into a rewarding career with an industry leader? Join our team at American Tire Distributors! As the nation's premier tire distributor, ATD’s coast-to-coast distribution network provides approximately 80,000 customers across the U.S. and Canada with rapid and frequent delivery...


  • Huntersville, United States Covia Full time

    Covia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to building partnerships...


  • Huntersville, United States Yankee Candle Full time

    Design Research Manager Job Number: 2401111 United States-North Carolina-Huntersville Location Type - Hybrid Newell is a leading $10B global consumer products organization with over 29,000 employees and more than 100 beloved brands. Newell’s vision is to become a consumer led, innovation powerhouse and growth engine that is a force for good and an amazing...


  • Huntersville, United States TalentBridge Full time

    TalentBridge is partnered with a dynamic and innovative leader in the manufacturing industry, dedicated to delivering high-quality products to our customers. They are committed to developing a continuous improvement culture and are seeking a skilled Continuous Improvement Manager to join their team. The successful candidate will play a crucial role in...

  • Microbiologist

    1 day ago


    Huntersville, United States Actalent Full time

    Our client, an industry leading company is seeking a Microbiologist to assist with day to day testing. Their product line represents the world's biggest range of additives, offering a choice on both metal-based and metal-free chemistries. Microbiologist position that involves sample preparation, media preparation, environmental monitoring, and quality...