Azure Data Engineer
3 weeks ago
Huntersville, NC (Preference for onsite/hybrid but will consider 100% remote for the right candidate)
SMART IT People has a contract opportunity for an experienced Azure Data Engineer.
The ideal candidate will have a strong background in data engineering, Azure Data Factory (ADF), Azure Synapse, along with experience ingesting and consolidating data from various data sources including multiple ERP systems. This role requires expertise in designing and implementing data pipelines, data transformation, and data warehousing solutions using Azure services. The Senior Azure Data Engineer will play a crucial role in ensuring the security, reliability, and performance of our data infrastructure while collaborating with cross-functional teams to meet business objectives.
Requirements:
Minimum of Bachelors’ degree in Computer Science, Engineering, Mathematics or related fields
5+ years of work experience in designing, developing, and troubleshooting complex SQL queries, on DBMS solutions such as Snowflake, Oracle, MS SQL Server, PostgreSQL, and MySQL
3+ years of hands-on experience in ETL/ELT tools
3+ years of work experience with Data Platforms
1+ year development experience in Python or similar scripting languages for data automation
Proven experience as an Azure Data Engineer or similar role, with a focus on designing and implementing data pipelines and data warehousing solutions using Azure services.
Expertise in Azure Data Factory (ADF), Azure Synapse, and multiple ERP systems.
Experience working with On Premise and Cloud systems and data sources
Strong analytical skills related to working with unstructured datasets and designing efficient data processing workflows.
Proficiency in coding and scripting languages such as SQL, Python, or PowerShell.
Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.
Excellent communication skills, with the ability to collaborate effectively with cross-functional teams and drive alignment towards common goals.
Regularly check and maintain data quality by validating data against predefined standards and data governance policies.
Fix data quality issues and errors in data pipelines to maintain accurate data.
Nice to Have:
Certifications such as Azure Solutions Architect Expert or Azure DevOps Engineer Expert.
Experience with other Azure services and frameworks beyond ADF and Synapse including Azure Databricks and Snowflake.
Knowledge of data modeling and analysis techniques using Azure services like Azure Analysis Services.
Experience with Microsoft Fabric
Experience with Informatica Data Quality and MDM
Responsibilities:
Collaborate with stakeholders to understand data requirements and design and maintain secure and compliant data processing pipelines using Azure Data Factory, Azure Synapse, and other tools.
Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure, ensuring efficient and reliable data transfer.
Perform data transformation and processing tasks using Azure Synapse to prepare data for analysis and reporting.
Select and manage appropriate data storage solutions in Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage, based on data requirements.
Successful data movements and transformations using various file formats such as Delta, Parquet, Avro, and CSV.
Implement and optimize data warehousing solutions using Azure Synapse SQL and Azure Synapse Analytics to support large-scale analytics and reporting.
Collaborate with data scientists and analysts to design and implement data models for analytical workloads using Azure Analysis Services or Power BI.
Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.
Support and Troubleshoot On Premise gateways
#J-18808-Ljbffr
-
Data Engineer
1 month ago
Huntersville, United States Optomi Full timeNote: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...
-
Data Engineer
1 month ago
Huntersville, United States Optomi Full timeNote: Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship Overview: Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting applications for Senior and/or Lead level Data Engineers to join a brand new team...
-
Databricks Engineer
3 days ago
Huntersville, United States Diverse Lynx Full timeDesign and implementation of websites, programs and applications that execute within Microsoft's. NET framework with Azure Web Apps. •Logics & Code development using Azure Functions/ADF/Data Bricks/SQLs wherever applicable •Experience in Data Modeling •Experience with databases and data warehousing •Proficient in writing Spark code in below...
-
Product Engineer II
1 day ago
Huntersville, United States Oerlikon Group Full timePress Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Do you like to be on the cutting edge of innovation? If you’re motivated confident and looking to challenge yourself to be your best, then you’ve come to the right place! This is a role where you to showcase your...
-
Senior Network Engineer
19 hours ago
Huntersville, United States Quantum Technology Group, LLC Full timeJob DescriptionJob DescriptionTITLE: Sr. Network EngineerDEPARTMENT: Information TechnologyREPORTS TO: Team LeadSUMMARY:Quantum Technology Group is seeking a multitalented Sr. Network Engineer to perform a variety of technical tasks related to enterprise infrastructure and operations. This position will be responsible for technical engineering and...
-
Sourcing Analyst, CI
10 hours ago
Huntersville, United States Yankee Candle Full timeJob Number: The Analyst, Procurement – Competitive Intelligence & Innovation, will play an integral role in helping the company achieve its ambition by ensuring that Newell Brands is leveraging scientific methods and analytics to drive Enterprise Procurement improvements. Reporting to the Associate Manager, Procurement – Competitive Intelligence &...
-
Network Security Engineer
8 hours ago
Huntersville, United States JSCM Group Full timeForward to localhost with Webhook.site CLI whcli forward --token=e1f9e6f1-0042-4d86-a9cc-6e1f629963af Install whcli Webhook.site generates free, unique URLs and e-mail addressesand lets you see everything that’s sent there instantly. Built-in integrations: Google Sheets, Excel, Slack, Dropbox, SFTP, Email,Push Notifications, and more URLs never expire and...
-
Senior Pricing Analyst
1 month ago
Huntersville, United States Covia Full timeSr. Pricing Analyst Covia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to...
-
Huntersville, United States Macpower Digital Assets Edge Private Limited (MDA Edge) Full timeDo We Have Signing Bonus: YES, Negotiable Job Summary: Provide leadership and support at all levels of the manufacturing operations, helping to achieve operational excellence, superior product quality and customer experience objectives. Drive consistent processes and metrics in support of One Southwire that align supplier and material quality,...
-
Senior Formulation Scientist
1 day ago
Huntersville, United States Blue Signal Search Full timeOur client is a large-scale manufacturing company that works with Fortune 500 companies and household brands to develop winning products. They’re seeking a talented Senior Formulation Scientist to join our dynamic team and drive innovation in the Over the Counter (OTC) pharmaceutical and supplement markets. The Senior Formulation Scientist will play a...
-
Inspector
6 days ago
Huntersville, United States Oerlikon Full timeInspector We are looking for a 3D Scanning Inspector for our Huntersville, NC facility. In this role, you will be responsible for inspection of both conventionally machined as well as additively manufactured parts utilizing 3D scanning equipment (GOM) and generating inspection reports that comply with customer specifications. The 3D scanning...
-
Distribution Technician I
1 month ago
Huntersville, United States TRC Companies, Inc. Full timeAbout Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...
-
Distribution Technician I
3 weeks ago
Huntersville, United States TRC Companies, Inc. Full timeAbout Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...
-
Distribution Technician I
5 days ago
Huntersville, United States TRC Companies, Inc. Full timeAbout Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...
-
Distribution Technician I
4 days ago
Huntersville, United States TRC Companies, Inc. Full timeAbout Us Groundbreaker. Game changer. Pioneer. TRC has long set the bar for clients who require more than just engineering, combining science with the latest technology to devise innovative solutions that stand the test of time. From pipelines to power plants, roadways to reservoirs, schoolyards to security solutions, clients look to TRC for...
-
Supply Chain Analyst
5 days ago
Huntersville, United States American Tire Full timeAre you looking for an opportunity to turn your ambition and your people skills into a rewarding career with an industry leader? Join our team at American Tire Distributors! As the nation's premier tire distributor, ATD’s coast-to-coast distribution network provides approximately 80,000 customers across the U.S. and Canada with rapid and frequent delivery...
-
Marketing Internship
4 days ago
Huntersville, United States Covia Full timeCovia is a leading supplier of minerals and material solutions to the industrial and energy markets. Covia's rich legacy includes many achievements across industries and capital success through partnership. Our ability to deliver the right product, to the right place, at the right time, is unmatched. Just as strong is our commitment to building partnerships...
-
Design Research Manager
2 days ago
Huntersville, United States Yankee Candle Full timeDesign Research Manager Job Number: 2401111 United States-North Carolina-Huntersville Location Type - Hybrid Newell is a leading $10B global consumer products organization with over 29,000 employees and more than 100 beloved brands. Newell’s vision is to become a consumer led, innovation powerhouse and growth engine that is a force for good and an amazing...
-
Continuous Improvement Manager
5 days ago
Huntersville, United States TalentBridge Full timeTalentBridge is partnered with a dynamic and innovative leader in the manufacturing industry, dedicated to delivering high-quality products to our customers. They are committed to developing a continuous improvement culture and are seeking a skilled Continuous Improvement Manager to join their team. The successful candidate will play a crucial role in...
-
Microbiologist
1 day ago
Huntersville, United States Actalent Full timeOur client, an industry leading company is seeking a Microbiologist to assist with day to day testing. Their product line represents the world's biggest range of additives, offering a choice on both metal-based and metal-free chemistries. Microbiologist position that involves sample preparation, media preparation, environmental monitoring, and quality...