Data Engineer
4 weeks ago
8+ Years of hands on experience on below skillset
1. Snowflake
2. Azure Databricks
3. Azure Data Factory
4. Pyspark
5. Python
6. SQL
Role and Responsibilities:
Design, implement, and manage Azure cloud solutions for various projects.
• Develop and maintain data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis.
• Configure and manage Azure Data Factory (ADF) to orchestrate data workflows and ETL processes.
• Implement and optimize Azure Data Lake Storage (ADLS) for efficient data storage and retrieval.
• Collaborate with cross-functional teams to design and implement data warehouse solutions.
• Utilize Git for version control and collaboration on codebase.
• Monitor, troubleshoot, and optimize data processes for performance and reliability.
• Implement security best practices and manage access controls using Azure Active Directory (AAD).
• Document technical designs, processes, and procedures.
• Stay updated with the latest Azure cloud technologies and best practices.
Requirements:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience working with Azure cloud services, including Azure Data Lake Storage, Azure Data Factory, and Azure Active Directory.
• Strong proficiency in PySpark and experience with Databricks for data engineering and analytics.
• Hands-on experience with Git for version control and collaboration.
• Familiarity with data warehousing concepts and technologies.
• Experience with SQL and relational databases.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work effectively in a fast-paced, dynamic environment.
• Azure certifications (e.g., Azure Administrator, Azure Data Engineer) are a plus.
-
Data Engineer
4 days ago
Minneapolis, United States Noblesoft Technologies Full timeJob DescriptionJob DescriptionJob Role - Data Engineer Location - Minneapolis, MN(Remote)Responsibilities: * Analyze large and complex datasets to identify trends, patterns, and anomalies. * Use statistical techniques and data mining tools to extract meaningful insights. * Prepare data visualizations (dashboards, reports) to communicate findings effectively....
-
Network Engineer III
2 weeks ago
Minneapolis, United States Atomic Data Full timeJob DescriptionJob DescriptionNetwork Engineer IIIDepartment: Network EngineeringReports to: Manager of Network Engineering Career path: Network Architect Job SummaryThe Network Engineer III is responsible for the operation, implementation, and maintenance of Atomic Data’s service provider network, as well as supporting all client network...
-
Infrastructure Engineering Manager
3 weeks ago
Minneapolis, Minnesota, United States Atomic Data Full timeJob Overview\We are seeking a highly skilled Manager of Infrastructure Engineering to join our team at Atomic Data. As a key member of our organization, you will be responsible for developing and leading a team of Datacenter and Infrastructure Engineers to deliver exceptional technical support and outstanding customer service.
-
Data Engineer
7 months ago
Minneapolis, United States Saxon Global Full timeClient: Cargill Job Title: Data Engineer Duration: 5/31/2024 Location: Remote Job Description: The Data Engineer III will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment. In this role, you will act as an authority for data access pathways...
-
Data Engineer for Data Operations
1 day ago
Minneapolis, Minnesota, United States Icario Full timeWe are seeking a talented Data Operations Engineer to join our Data Engineering team at Icario, a leading technology company dedicated to improving healthcare member engagement. This is an excellent opportunity for a creative problem solver and self-starter who enjoys working in a fast-paced, rapidly changing environment.About UsIcario is committed to making...
-
Data Engineer
1 month ago
Minneapolis, United States CliftonLarsonAllen Full timeCLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...
-
Data Engineer
2 months ago
Minneapolis, United States Robert Half Full timeJob DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in the non-profit sector. Located in Minneapolis, Minnesota, this role involves working within a team to drive the development and optimization of our data systems.Responsibilities:• Designing and constructing highly scalable data processing systems.• Utilizing...
-
Sr Data Engineer
2 weeks ago
Minneapolis, United States eTek IT Services, Inc. Full timeJob DescriptionJob DescriptionOverviewThe Senior Data Engineer plays a crucial role in building and maintaining the data infrastructure essential for driving decision-making processes in the organization. This position is vital in ensuring that data sources are robust, reliable, and scalable to support complex analytical processes. The Senior Data Engineer...
-
Data Engineering Leader
4 weeks ago
Minneapolis, Minnesota, United States Omni Inclusive Full timeOmni Inclusive is offering a highly competitive salary of $250,000 - $300,000 per year for this Senior Data Engineer role. The position requires a strong background in developing and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our...
-
Data Engineer Lead
4 weeks ago
Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full timeFutran Tech Solutions Pvt. Ltd. is looking for a skilled Data Engineer Lead to join their team in Minneapolis, MN. As a key member of the data engineering team, you will design and build complex data processing pipelines using ADF and Airflow. You will work closely with cross-functional teams to ensure seamless integration with cloud databases like SQL. The...
-
Data Integrity Engineer
3 days ago
Minneapolis, United States K&K Global Talent Solutions Inc. Full timeJob DescriptionJob DescriptionJob Description:Client wants to integrate data quality with metadata management to enable top tier data governance and self-service data analytics.Job Summary: The Data Integrity Engineer will combine the responsibilities of a visualization developer, data engineer and data analyst. This role involves building visualizations and...
-
Data Engineer Expert
4 weeks ago
Minneapolis, Minnesota, United States SysMind Tech Full timeAt SysMind Tech, we are seeking a skilled Data Engineer Expert to join our team. As a key member of our engineering department, you will be responsible for designing and implementing scalable data systems that meet the needs of our organization.The ideal candidate will have a strong background in data engineering with experience in structured databases...
-
Senior Data Engineer
2 months ago
Minneapolis, United States Omni Inclusive Full timeJob Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure...
-
Data Engineer
2 months ago
Minneapolis, United States Eateam Full timePrimary : SQL, Azure, Azure Data Factory, Azure DevOps, Azure DataBricks Snowflake, SQL Server, GitHub Secondary: Python, Pyspark Sr Data Engineer with expertise to design and create Data Pipelines in Azure Cloudusing Azure Data factory, ADLS, Azure Databricks, Log Analytics , Application Insight, Azure MonitorExpertise in writing python and SQL...
-
Data Engineer Lead
4 weeks ago
Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in Minneapolis, Minnesota, USA. As a key member of our team, you will be responsible for designing, developing, and implementing data engineering solutions that meet the business needs of our clients.About the RoleDesign, develop, and implement...
-
Data Engineer Specialist
3 weeks ago
Minneapolis, Minnesota, United States Simplicity Group Holdings Full timeAbout the RoleWe are seeking a skilled Data Engineer Specialist to join our team at Simplicity Group Holdings. As a key member of our technology department, you will play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure.This is an exempt position with a base salary ranging from $110,000 to $130,000 per year,...
-
Senior Data Engineer
3 weeks ago
Minneapolis, Minnesota, United States Randstad Full timeSenior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. This individual will play a key role in designing, implementing, and maintaining robust data management systems and processes.Key Responsibilities:Reverse engineer data systems and vendor applications to understand data structures, relationships, and...
-
Senior Data Engineer
2 months ago
Minneapolis, United States Futran Tech Solutions Pvt. Ltd. Full timeRole Data EngineerLocation Minneapolis, Minnesota, United States (Onsite)Roles & QualificationsTechnical: T-SQL / SQL, SSIS, Data anlaysis, health industry, ETL tools ( TWS, Informatica, etc), GitHub, Data Bricks, Data wherehouse,TFS, Soft Sklls:Good communicator, able to work with business parnters, familiar with Agile prodcut development, Inforamatica...
-
Data Engineer
2 months ago
Minneapolis, United States SysMind Tech Full timeMinimum 7+ Yrs of experience required - Experience in structured databases( Oracle, MSSQL) and unstructured databases (Hadoop) - Experience in spark / python (PySpark) / Azure products like Synapse, ADF, Databricks / Autosys - Strong experience on Data warehousing projects - Proficiency in writing and understanding complex SQL Query - Lead data analysis and...
-
Azure Data Engineer
2 months ago
Minneapolis, United States Diverse Lynx Full timeRole: Azure Data Engineer Location: Downtown Minneapolis,MN (Day 1 Onsite) Contract Position Overview We are seeking a Lead Developer with advanced skills in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to develop and manage ETL pipelines and data processing solutions that support AI/ML initiatives. The ideal candidate will have...