Senior Data Engineer

2 days ago


minneapolis, United States Talent Groups Full time

Job Description:

We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies, and collaborating with cross-functional teams.

Key Responsibilities:

  • ETL Development & Data Processing: Design, implement, and maintain efficient ETL pipelines and data processing solutions to support AI/ML models and data analysis needs.
  • Azure Cloud Expertise: Utilize Azure services (Data Factory, SQL Pools, Spark Pools, Synapse) to build scalable and secure data workflows.
  • Data Warehouse Management: Architect and maintain data warehousing solutions on Azure to ensure optimized data storage and retrieval.
  • CI/CD Integration: Implement and manage CI/CD processes for data engineering pipelines, ensuring smooth and consistent deployments.
  • Cross-Functional Collaboration: Work closely with data scientists, engineers, and other stakeholders to understand data needs and align solutions to business goals.

Qualifications:

  • Technical Expertise:
  • Advanced skills in Python and Apache Spark for data processing.
  • Proficiency with Azure Data Engineering services, including Synapse, Data Factory, SQL Pools, Spark Pools, and ADLS Gen2.
  • Strong SQL knowledge and experience with data warehousing on Azure.
  • Additional Skills:
  • Experience with Data Science and Machine Learning frameworks.
  • Knowledge of Java, Kubernetes, and API development for enhanced data solutions.
  • Soft Skills:
  • Excellent collaboration skills, with experience working in cross-functional teams.
  • Strong problem-solving abilities and a focus on continuous improvement.


  • Senior Data Engineer

    4 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Senior Data EngineerFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Senior Data Engineer to join our team.Job SummaryWe are looking for a talented Data Engineer with expertise in T-SQL, SQL, SSIS, data analysis, and ETL tools. The ideal candidate will have experience working with healthcare data and be familiar with Agile product...

  • Senior Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Senior Data EngineerLocation: Minneapolis, Minnesota, United StatesJob Summary:We are seeking a Senior Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have experience in designing, developing, and maintaining large-scale data systems.Responsibilities:Design and develop data pipelines using T-SQL, SSIS,...

  • Senior Data Engineer

    2 weeks ago


    Minneapolis, Minnesota, United States On-Demand Group Full time

    Job Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to design, build, and maintain data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery.Key Responsibilities:Design, develop, and implement data pipelines using GCP BigQuery for data ingestion, transformation, and loading.Optimize data pipelines for performance,...


  • Minneapolis, Minnesota, United States Innova Solutions Full time

    About the Role:Innova Solutions is seeking a highly skilled Senior Cloud Data Engineer to join our team. As a Senior Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines on cloud-based platforms such as AWS, Azure, or GCP.Key Responsibilities:Design and implement data pipelines using cloud-based...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the RoleWe are seeking a highly skilled Senior Snowflake Engineer to join our team at Associated Bank National. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable data pipelines and architectures using Snowflake and other cloud-based technologies.Key ResponsibilitiesDesign and develop...

  • Senior Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Fairview Health Services Full time

    Job SummaryThe Senior Data Engineer will lead the implementation, maintenance, and architecture of the M Health Fairview data environment. This role involves planning, designing, and deploying enterprise data strategies by analyzing and translating business needs into a long-term data model solution that reduces redundancies, streamlines data movements, and...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job DescriptionFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Senior Data Science Engineer to lead our data science and engineering efforts. The ideal candidate will have a strong background in DevOps, data engineering, and machine learning, with experience in building and maintaining end-to-end CI/CD pipelines.The successful candidate will be...


  • Minneapolis, United States Experis Full time

    Senior IT Manager - Data Engineering Location: · Minneapolis, MN (Hybrid) The Senior Manager of Data Engineering is responsible for day-to-day technical management and delivery of assigned functions, projects, or programs, data infrastructure and pipelines for a key financial system. The senior manager will also lead Technology Modernization, Capability...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Senior Data Engineering and AI Operations LeadJob Summary:Futran Tech Solutions Pvt. Ltd. is seeking a Senior Data Engineering and AI Operations Lead to join our team. As a key member of our data engineering and AI operations team, you will be responsible for designing, building, and maintaining end-to-end (Data/Dev/ML) CI/CD pipelines that...


  • Minneapolis, Minnesota, United States University of Minnesota Full time

    Job SummaryThe University of Minnesota is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Office of Information Technology, you will be responsible for designing and implementing a multi-container Oracle Cloud Infrastructure environment to support our mission-critical applications.Key ResponsibilitiesDevelop and...

  • Senior Data Architect

    3 weeks ago


    Minneapolis, Minnesota, United States Levi Ray & Shoup Inc Full time

    Job Summary:Fulcrum Consulting, an LRS company, is seeking a Senior Data Engineer - Lead to oversee the design, development, and maintenance of our data infrastructure. As the Senior Data Engineer Lead, you will be responsible for leading a team of data engineers, driving best practices in data integration, modeling, and reporting. Your expertise in...


  • Minneapolis, Minnesota, United States Olsson Full time

    Job Title: Senior Mechanical EngineerWe are seeking a highly skilled Senior Mechanical Engineer to join our team at Olsson. As a key member of our engineering team, you will work closely with our clients to design and develop innovative solutions for the data center industry.Key Responsibilities:Design and develop mechanical systems for data centers,...


  • Minneapolis, United States Talent Groups Full time

    Job Description:We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies,...

  • Sr. Data Engineer

    3 weeks ago


    Minneapolis, United States On-Demand Group Full time

    On-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....

  • Sr. Data Engineer

    3 weeks ago


    minneapolis, United States On-Demand Group Full time

    On-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the RoleAssociated Bank is seeking a Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our technology organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities ensuring scalability, reliability, reusability,...

  • Senior Data Architect

    4 weeks ago


    Minneapolis, Minnesota, United States Omni Inclusive Full time

    Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team at Omni Inclusive. The ideal candidate will have a strong background in developing and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.Key Responsibilities:Design and implement scalable data...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the Role:Associated Bank National is seeking a highly skilled Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities ensuring scalability, reliability,...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the RoleAssociated Bank National is seeking a highly skilled Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities ensuring scalability, reliability,...

  • Senior Data Engineer

    4 weeks ago


    Minneapolis, Minnesota, United States Wells Fargo Full time

    About this Role:Wells Fargo is seeking a highly skilled Data Engineer to design and implement ETL processes for large data warehouse projects using Teradata, Ab Initio, and Autosys. As a key member of our technical team, you will work on complex problems to provide troubleshooting and resolving production issues, data research, and fixing defects.You will be...