Data Engineer

4 weeks ago


Minneapolis, United States STIAOS Technologies Full time
Required :
8+ Years of hands on experience on below skillset
1. Snowflake
2. Azure Databricks
3. Azure Data Factory
4. Pyspark
5. Python
6. SQL

Role and Responsibilities:
Design, implement, and manage Azure cloud solutions for various projects.
• Develop and maintain data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis.
• Configure and manage Azure Data Factory (ADF) to orchestrate data workflows and ETL processes.
• Implement and optimize Azure Data Lake Storage (ADLS) for efficient data storage and retrieval.
• Collaborate with cross-functional teams to design and implement data warehouse solutions.
• Utilize Git for version control and collaboration on codebase.
• Monitor, troubleshoot, and optimize data processes for performance and reliability.
• Implement security best practices and manage access controls using Azure Active Directory (AAD).
• Document technical designs, processes, and procedures.
• Stay updated with the latest Azure cloud technologies and best practices.
Requirements:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience working with Azure cloud services, including Azure Data Lake Storage, Azure Data Factory, and Azure Active Directory.
• Strong proficiency in PySpark and experience with Databricks for data engineering and analytics.
• Hands-on experience with Git for version control and collaboration.
• Familiarity with data warehousing concepts and technologies.
• Experience with SQL and relational databases.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work effectively in a fast-paced, dynamic environment.
• Azure certifications (e.g., Azure Administrator, Azure Data Engineer) are a plus.
  • Data Engineer

    4 days ago


    Minneapolis, United States Noblesoft Technologies Full time

    Job DescriptionJob DescriptionJob Role - Data Engineer Location - Minneapolis, MN(Remote)Responsibilities: * Analyze large and complex datasets to identify trends, patterns, and anomalies. * Use statistical techniques and data mining tools to extract meaningful insights. * Prepare data visualizations (dashboards, reports) to communicate findings effectively....

  • Network Engineer III

    2 weeks ago


    Minneapolis, United States Atomic Data Full time

    Job DescriptionJob DescriptionNetwork Engineer IIIDepartment: Network EngineeringReports to:  Manager of Network Engineering Career path: Network Architect Job SummaryThe Network Engineer III is responsible for the operation, implementation, and maintenance of Atomic Data’s service provider network, as well as supporting all client network...


  • Minneapolis, Minnesota, United States Atomic Data Full time

    Job Overview\We are seeking a highly skilled Manager of Infrastructure Engineering to join our team at Atomic Data. As a key member of our organization, you will be responsible for developing and leading a team of Datacenter and Infrastructure Engineers to deliver exceptional technical support and outstanding customer service.

  • Data Engineer

    7 months ago


    Minneapolis, United States Saxon Global Full time

    Client: Cargill Job Title: Data Engineer Duration: 5/31/2024 Location: Remote Job Description: The Data Engineer III will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment. In this role, you will act as an authority for data access pathways...


  • Minneapolis, Minnesota, United States Icario Full time

    We are seeking a talented Data Operations Engineer to join our Data Engineering team at Icario, a leading technology company dedicated to improving healthcare member engagement. This is an excellent opportunity for a creative problem solver and self-starter who enjoys working in a fast-paced, rapidly changing environment.About UsIcario is committed to making...

  • Data Engineer

    1 month ago


    Minneapolis, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Data Engineer

    2 months ago


    Minneapolis, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in the non-profit sector. Located in Minneapolis, Minnesota, this role involves working within a team to drive the development and optimization of our data systems.Responsibilities:• Designing and constructing highly scalable data processing systems.• Utilizing...

  • Sr Data Engineer

    2 weeks ago


    Minneapolis, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionOverviewThe Senior Data Engineer plays a crucial role in building and maintaining the data infrastructure essential for driving decision-making processes in the organization. This position is vital in ensuring that data sources are robust, reliable, and scalable to support complex analytical processes. The Senior Data Engineer...


  • Minneapolis, Minnesota, United States Omni Inclusive Full time

    Omni Inclusive is offering a highly competitive salary of $250,000 - $300,000 per year for this Senior Data Engineer role. The position requires a strong background in developing and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our...

  • Data Engineer Lead

    4 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is looking for a skilled Data Engineer Lead to join their team in Minneapolis, MN. As a key member of the data engineering team, you will design and build complex data processing pipelines using ADF and Airflow. You will work closely with cross-functional teams to ensure seamless integration with cloud databases like SQL. The...


  • Minneapolis, United States K&K Global Talent Solutions Inc. Full time

    Job DescriptionJob DescriptionJob Description:Client wants to integrate data quality with metadata management to enable top tier data governance and self-service data analytics.Job Summary: The Data Integrity Engineer will combine the responsibilities of a visualization developer, data engineer and data analyst. This role involves building visualizations and...

  • Data Engineer Expert

    4 weeks ago


    Minneapolis, Minnesota, United States SysMind Tech Full time

    At SysMind Tech, we are seeking a skilled Data Engineer Expert to join our team. As a key member of our engineering department, you will be responsible for designing and implementing scalable data systems that meet the needs of our organization.The ideal candidate will have a strong background in data engineering with experience in structured databases...

  • Senior Data Engineer

    2 months ago


    Minneapolis, United States Omni Inclusive Full time

    Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure...

  • Data Engineer

    2 months ago


    Minneapolis, United States Eateam Full time

    Primary : SQL, Azure, Azure Data Factory, Azure DevOps, Azure DataBricks Snowflake, SQL Server, GitHub Secondary: Python, Pyspark Sr Data Engineer with expertise to design and create Data Pipelines in Azure Cloudusing Azure Data factory, ADLS, Azure Databricks, Log Analytics , Application Insight, Azure MonitorExpertise in writing python and SQL...

  • Data Engineer Lead

    4 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in Minneapolis, Minnesota, USA. As a key member of our team, you will be responsible for designing, developing, and implementing data engineering solutions that meet the business needs of our clients.About the RoleDesign, develop, and implement...


  • Minneapolis, Minnesota, United States Simplicity Group Holdings Full time

    About the RoleWe are seeking a skilled Data Engineer Specialist to join our team at Simplicity Group Holdings. As a key member of our technology department, you will play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure.This is an exempt position with a base salary ranging from $110,000 to $130,000 per year,...

  • Senior Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Randstad Full time

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. This individual will play a key role in designing, implementing, and maintaining robust data management systems and processes.Key Responsibilities:Reverse engineer data systems and vendor applications to understand data structures, relationships, and...

  • Senior Data Engineer

    2 months ago


    Minneapolis, United States Futran Tech Solutions Pvt. Ltd. Full time

    Role Data EngineerLocation Minneapolis, Minnesota, United States (Onsite)Roles & QualificationsTechnical: T-SQL / SQL, SSIS, Data anlaysis, health industry, ETL tools ( TWS, Informatica, etc), GitHub, Data Bricks, Data wherehouse,TFS, Soft Sklls:Good communicator, able to work with business parnters, familiar with Agile prodcut development, Inforamatica...

  • Data Engineer

    2 months ago


    Minneapolis, United States SysMind Tech Full time

    Minimum 7+ Yrs of experience required - Experience in structured databases( Oracle, MSSQL) and unstructured databases (Hadoop) - Experience in spark / python (PySpark) / Azure products like Synapse, ADF, Databricks / Autosys - Strong experience on Data warehousing projects - Proficiency in writing and understanding complex SQL Query - Lead data analysis and...

  • Azure Data Engineer

    2 months ago


    Minneapolis, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Downtown Minneapolis,MN (Day 1 Onsite) Contract Position Overview We are seeking a Lead Developer with advanced skills in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to develop and manage ETL pipelines and data processing solutions that support AI/ML initiatives. The ideal candidate will have...