Azure Data Engineer
3 days ago
As a Microsoft Azure Data Engineer, you will be responsible for designing, implementing, and managing data pipelines and architectures on the Azure Synapse platform. You will work with a variety of data sources and ensure data is processed and stored efficiently using the Medallion Architecture (Bronze, Silver, Gold layers). Your expertise in PySpark, Synapse pipelines, API integrations, Azure Synaspse Analytics and integration with Master Data Management tools like Profisee will be crucial in developing robust data solutions that meet our business needs.Key Responsibilities:• Design and implement data pipelines using Pyspark Notebooks.• Manage and optimize data storage and processing through the Medallion Architecture (Bronze, Silver, Gold layers).• Develop and maintain ETL processes using notebooks to ingest, transform, and load data from various sources.• Integrate APIs to facilitate data exchange between systems.• Create and manage table views to surface data to end users.• Ensure data quality, consistency, and security across all layers.• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.• Monitor and troubleshoot data pipelines to ensure reliability and performance.• Stay up to date with the latest Azure technologies and best practices.Qualifications:• Bachelor's degree in computer science, Information Technology, or a related field.• Proven experience as a Data Engineer with a focus on Azure technologies.• Strong proficiency in PySpark notebooks and Synapse pipelines with at least 2 years of demonstrable experience with notebooks• Experience with Medallion Architecture and managing data through bronze, silver, and gold layers.• Familiarity with API integration and data exchange.• Experience with master data management tools such as Profisee.• Ability to create and manage table views for data visualization.• Excellent problem-solving skills and attention to detail.• Strong communication and collaboration skills.• Ability to work in a fast-paced, dynamic environment.Preferred Qualifications:• Azure certifications (e.g., Azure Data Engineer Associate).• Experience with other Azure services such as Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.• Knowledge of data governance and security best practices.• Experience with additional master data management tools and techniques
-
Azure Data Engineer
2 weeks ago
Chicago, IL, United States 1872 Consulting Full timezure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...
-
Azure Data Engineer
7 days ago
Chicago, IL, United States 1872 Consulting Full timezure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...
-
Azure Data Engineer
1 week ago
Chicago, IL, United States 1872 Consulting Full timezure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...
-
Azure Data Engineer- Snowflake
1 week ago
Chicago, IL, United States Spruce Infotech Full timeOverview: Looking for an experienced Azure Data Engineer with strong Snowflake expertise to build and optimize enterprise data solutions for Northern Trust's financial services environment. Key Responsibilities: Design, develop, and maintain scalable Snowflake data warehouses and Azure-based data pipelines. Implement ETL/ELT processes using Azure Data...
-
Azure Data Engineer- Snowflake
7 days ago
Chicago, IL, United States Spruce Infotech Full timeOverview: Looking for an experienced Azure Data Engineer with strong Snowflake expertise to build and optimize enterprise data solutions for Northern Trust's financial services environment. Key Responsibilities: Design, develop, and maintain scalable Snowflake data warehouses and Azure-based data pipelines. Implement ETL/ELT processes using Azure Data...
-
Azure Data Engineer
1 week ago
Chicago, IL, United States RIT Solutions, Inc. Full timeJob Title - Azure Data Engineer Location - Chicago, IL - Remote Duration - 4+ months Interview - Video Job Description - Responsibilities: Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Collaborates with architects, data...
-
Azure Data Engineer
2 weeks ago
Chicago, IL, United States RIT Solutions, Inc. Full timeJob Title - Azure Data Engineer Location - Chicago, IL - Remote Duration - 4+ months Interview - Video Job Description - Responsibilities: Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Collaborates with architects, data...
-
Azure Data Engineer
7 days ago
Chicago, IL, United States RIT Solutions, Inc. Full timeJob Title - Azure Data Engineer Location - Chicago, IL - Remote Duration - 4+ months Interview - Video Job Description - Responsibilities: Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Collaborates with architects, data...
-
Azure Data Engineer
18 hours ago
Chicago, IL, United States RIT Solutions, Inc. Full timeJob Title - Azure Data Engineer Location - Chicago, IL - Remote Duration - 4+ months Interview - Video Job Description - Responsibilities: Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Collaborates with architects, data...
-
Azure Data Engineer
2 weeks ago
Chicago, IL, United States Capgemini Full timeAzure Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations?unlock the value...
