Data Engineer
7 days ago
Responsibilities:
• Designing and constructing highly scalable data processing systems.
• Utilizing Apache Kafka, Apache Pig, and Apache Spark to manage data flow and processing.
• Implementing algorithms and data visualization strategies.
• Developing APIs and utilizing AWS technologies for cloud-based solutions.
• Employing SQL for database management and optimization.
• Extracting, transforming, and loading data (ETL) processes.
• Ensuring data quality and security through effective data governance frameworks.
• Utilizing data modeling tools such as ERwin, ER/Studio, PowerDesigner, or similar.
• Managing and cataloging data with metadata management tools.
• Maintaining a solid understanding of relational database concepts and designing optimized database schemas and indexes.• Minimum of 5 years experience in the role of a Data Engineer or similar.
• Proficiency with Apache Kafka, Apache Pig, and Apache Spark.
• Solid understanding and experience with Cloud Technologies.
• Expertise in Data Visualization and Algorithm Implementation.
• Strong background in Analytics and Apache Hadoop.
• Experience in API Development and AWS Technologies.
• Proficiency in SQL - Structured Query Language.
• Demonstrable experience with ETL - Extract Transform Load.
• Strong ability in Data Modeling.
• Prior experience working in the non-profit industry is an advantage.
• Excellent problem-solving skills and attention to detail.
• Ability to work independently and as part of a team.
• Excellent written and verbal communication skills.
-
Manager of Infrastructure Engineering
3 weeks ago
Minneapolis, United States Atomic Data Full timeManager of Infrastructure Engineering Department: Infrastructure Engineering Reports to: Director of Engineering Job Summary The Manager of Infrastructure Engineering is responsible for developing, leading, and motivating a team of Datacenter, and Infrastructure Engineers to deliver excellent technical/non-technical support with outstanding customer...
-
Data Engineer
6 months ago
Minneapolis, United States Saxon Global Full timeClient: Cargill Job Title: Data Engineer Duration: 5/31/2024 Location: Remote Job Description: The Data Engineer III will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment. In this role, you will act as an authority for data access pathways...
-
Data Engineer
3 weeks ago
Minneapolis, United States Brooksource Full timeTitle: Data Engineer Location: Minneapolis, MN3-Month ContractAbout the Role Brooksource is seeking a skilled Data Engineer to support our client in delivering comprehensive technology solutions within the healthcare sector. This role is ideal for candidates with a strong background in data engineering and expertise in healthcare data management,...
-
Data Engineer
5 days ago
Minneapolis, United States CliftonLarsonAllen Full timeCLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...
-
Data Engineer
7 days ago
Minneapolis, United States CliftonLarsonAllen Full timeCLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...
-
Data Engineer
1 week ago
Minneapolis, United States Compunnel Full timeJob Summary: We are looking for a Data Engineer with strong experience in ETL development and cloud automation to support the Finance business unit. The ideal candidate will be responsible for interpreting and analyzing business requirements, designing solutions, and implementing ETL workflows. This position involves working closely with stakeholders to...
-
Data Engineer
1 week ago
Minneapolis, United States Eateam Full timePrimary : SQL, Azure, Azure Data Factory, Azure DevOps, Azure DataBricks Snowflake, SQL Server, GitHub Secondary: Python, Pyspark Sr Data Engineer with expertise to design and create Data Pipelines in Azure Cloudusing Azure Data factory, ADLS, Azure Databricks, Log Analytics , Application Insight, Azure MonitorExpertise in writing python and SQL...
-
Senior Data Engineer
1 week ago
Minneapolis, United States JobRialto Full timeJob Summary The Senior Data Engineer will play a key role in designing, developing, and maintaining scalable data pipelines and data warehouse solutions to support business intelligence and analytics needs. Collaborating closely with cross-functional teams, the engineer will focus on integrating data from various systems, optimizing reporting processes, and...
-
Senior Data Engineer
1 week ago
Minneapolis, United States Omni Inclusive Full timeJob Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure...
-
Sr. Data Engineer
2 months ago
minneapolis, United States On-Demand Group Full timeOn-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....
-
Sr. Data Engineer
2 months ago
Minneapolis, United States On-Demand Group Full timeOn-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....
-
Data Engineering Manager
1 week ago
Minneapolis, United States DataSite Full timeDatasite is where deals are made. We provide the data rooms and SaaS technology used in M&A and other high-value transactions, to deliver projects in more than 170 countries. Carrying that success into the future is all about you. Your useful skills, your unusual experience, your unique ideas. Everyone here brings something unexpected. What's yours? Invest...
-
Data Engineer
1 week ago
Minneapolis, United States SysMind Tech Full timeMinimum 7+ Yrs of experience required - Experience in structured databases( Oracle, MSSQL) and unstructured databases (Hadoop) - Experience in spark / python (PySpark) / Azure products like Synapse, ADF, Databricks / Autosys - Strong experience on Data warehousing projects - Proficiency in writing and understanding complex SQL Query - Lead data analysis and...
-
Data Engineering Specialist
1 week ago
Minneapolis, Minnesota, United States Goli Tech Full timeJob OverviewWe are seeking a highly skilled Data Engineer to join our team at Goli Tech. As a Data Engineer, you will play a crucial role in designing and developing scalable data pipelines for reporting teams.ResponsibilitiesDesign and implement data extracts based on customer reporting needsCollaborate with IT Dev Ops partners to ingest extracts into a...
-
Senior Data Engineer
4 weeks ago
minneapolis, United States Talent Groups Full timeJob Description:We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies,...
-
Senior Data Engineer
4 weeks ago
Minneapolis, United States Talent Groups Full timeJob Description:We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies,...
-
Data Engineer Lead
1 week ago
Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full timeFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Data Engineer Lead to join our team.Job Responsibilities:Lead a team of data engineers in designing, developing, and maintaining large-scale data processing systems.Develop and implement efficient ETL pipelines using Apache Spark and Scala.Collaborate with cross-functional teams to integrate data...
-
Senior Data Engineer
1 week ago
Minneapolis, United States Futran Tech Solutions Pvt. Ltd. Full timeRole Data EngineerLocation Minneapolis, Minnesota, United States (Onsite)Roles & QualificationsTechnical: T-SQL / SQL, SSIS, Data anlaysis, health industry, ETL tools ( TWS, Informatica, etc), GitHub, Data Bricks, Data wherehouse,TFS, Soft Sklls:Good communicator, able to work with business parnters, familiar with Agile prodcut development, Inforamatica...
-
Azure Data Engineer
1 week ago
Minneapolis, United States Diverse Lynx Full timeRole: Azure Data Engineer Location: Downtown Minneapolis,MN (Day 1 Onsite) Contract Position Overview We are seeking a Lead Developer with advanced skills in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to develop and manage ETL pipelines and data processing solutions that support AI/ML initiatives. The ideal candidate will have...
-
Geospatial Data Engineer
1 month ago
Minneapolis, United States The Nature Conservancy Full timeOFFICE LOCATION United States #PDN #LI-REMOTE WHO WE ARE The mission of The Nature Conservancy (TNC) is to conserve the lands and waters upon which all life depends. As a science-based organization, we develop innovative, on-the-ground solutions to the world's toughest environmental challenges so that people and nature can thrive. Our work is guided by our...