Data Engineer

3 weeks ago

Minneapolis, United States Marvel Technologies Inc Full time
Job DescriptionJob Description

Location: Minneapolis, MN (Hybrid Role)

Rate: Open - best possible rate

Duration: Long Term.

Start Date: 05.27.2024

Core skills required
Azure Cloud
Azure Data Factory
Databricks
Azure SQL
Python or same/similar scripting for automation

A few things that he did mention that he would like on the "Wish List":
Azure Services/Azure Functions
Azure Purview
Azure Power-Automate
GCP or AWS Cloud atop Azure is nice as well

Business/Technology Initiative

Moving on Prem Automations via Automic & SSIS to Azure cloud technologies

Purpose:
Looking for a team player, with design experience in Azure data tooling. The individual would be someone that preferably has migration experience in any capacity to help in creating the movement of data and processes from on prem solutions to Azure cloud.

Desired Start Date

5/27/2024

Job Description

Data Engineer in the Business Intelligence and Analytics (BIA) team you will report directly to the AVP, BIA Automation Center of Excellence leader, and be responsible for executing on the intelligence & analytics strategy, vison and priorities to support the company's data and automation initiatives.

In this role, you will demonstrate knowledge and experience in the development and maintenance of data, processing, software and databases, and be responsible for collecting, processing and analyzing data to extract valuable insights that support the business decision-making process. This role requires you to collaborate with a team of data engineers, developers, and analysts to develop new systems, processes and procedures to achieve Automation Center of Excellence goals.

This role also works with business stakeholders and power users to improve the user experience by exposing information, creating data sets, running tests and creating data designs that present highly accurate, visible and secure information on a need-to-know basis. This role will assist with executing the Enterprise Data Architecture aligned to the TechOps leadership's overarching data strategy. For this reason, the BIA Data Engineer role requires superb communication and interpersonal skills to engage with the various technology, security and business teams across QCRH.

The BIA Data Engineer will employ business process optimization and automation techniques to mine data, develop data pipelines and extract insights from varying source systems, data warehouses, logs etc. to discover, visualize, monitor and manage data and processes. Proficient use of Robotic Process Automation (RPA) and modeling approaches and solutions to deliver analytics toolsets for users is a requirement.

In this role, you will be required to drive user adoption and improved customer experiences and to foster alignment between technical and business teams to drive scalability, innovation and flexibility that results in greater value creation. The BIA Data Engineer will collaborate cross-functionally to drive data governance, foster a culture of process excellence and innovation, leverage effective use of business process optimization tools, analytics, monitoring, and continuous improvement.

ESSENTIAL DUTIES:
Assemble large, complex sets of data that meet functional and non-functional business requirements.
Model and secure data to provide clean and accurate data sets for different users within QCRH, using data to identify business trends, opportunities, connections.
Develop use cases to demonstrate the benefits of various business intelligence tools, as well as testing use cases related to implementing new solutions.
Identify, design and implement internal process improvements that drive greater scalability, optimized delivery and automated processing.
Build methods for optimal extraction, transformation and loading of data from various sources using industry technologies (ex: Azure, SQL).
Leverage and develop analytical tools to expose the data pipeline, providing visible insights into key business performance metrics including operational efficiency.
Review, cleanse, analyze and interpret data, identify patterns and trends, laying the foundation for informed decision making for the key QCRH decision makers.
Ensure data confidentiality, availability, integrity and quality by validating data before publishing it for use by other departments.
Provide training on new business intelligence tools and technologies to users within the organization.
Assist with developing policies and procedures for the use of business intelligence tools within the organization.
Coordinate with TechOps teams to deploy new business intelligence software or system integrations and/or updates to existing software.
Communicate with management regularly to share updates on projects and ensure they are on track.
Transform raw data into meaningful statistics, information, reports and dashboards based on data analysis and providing recommendations for action.
Troubleshoot bugs and issues as they arise.
Provide support for resolution of incidents, ad-hoc analysis and data-based insights for continuous operational improvements.
Identify and track risks and issues as well as managing the execution of mitigation plans.
Follow established standards and procedures for documentation, reporting and communication.
Develop a solid understanding of the business and metrics that drive performance.
Collaboratively monitor data quality and resolve any issues with data stewards/custodians.
Demonstrated critical thinking, attention to detail, problem solving, and teamwork skills is a must.

QUALIFICATIONS:
Bachelor's Degree in Computer Science, Engineering, Math, Physics, Finance, Economics or a related field
At least five years' experience in a similar data engineering role responsible for business, data, reporting or quantitative analysis.
Proficiency with reporting software (ex: Tableau, PowerBI) and a strong understanding of databases and data structures (ex: SQL, Azure).
Proficiency with Robotic Processing Automation tool sets (ex: BluePrism, UIPath, Nice)
Proficiency with deploying new software solutions
Proficient with function and administration of cloud-based tooling; including but not limited to Azure and
Google data tooling (ex: Azure Data Factory/Bricks, Google Big Query).
Excellent written and oral communication skills, with the ability to actively listen and articulate business requirements and your ideas clearly and succinctly.
Analytical, diligent, and rigorous in your approach to problem solving.
Curiosity about data and a passion for finding answers hidden in data sets.
Bonus points for experience in consulting, operations, statistics, predictive analytics, and Azure Purview.
Experience with banking systems conversion(s), data migration processes, system integration, and Internet banking systems are highly desirable.

  • Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Apogee Enterprises Inc Full time

    Apogee Services Inc.Position SummaryApogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics.This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT &...

  • Data Engineer

    2 days ago

    Minneapolis, Minnesota, United States Apogee Enterprises Inc Full time

    Apogee Services Inc.Position SummaryApogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics.This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT &...

  • Data Engineer

    1 week ago

    Minneapolis, Minnesota, United States Apogee Enterprises Inc Full time

    Apogee Services Inc.Position SummaryApogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics.This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT &...

  • Data Engineer

    2 days ago

    Minneapolis, Minnesota, United States Apogee Enterprises Inc Full time

    Apogee Services Inc.Position SummaryApogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics.This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT &...

  • Data Engineer

    1 week ago

    Minneapolis, United States Apogee Enterprises Inc Full time

    Apogee Services Inc. Position Summary Apogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics. This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT...

  • Data Engineer

    2 days ago

    Minneapolis, United States Apogee Enterprises Inc Full time

    Apogee Services Inc. Position Summary Apogee's Data Strategy & Governance organization focuses on implementing processes and solutions for Data Governance, Master Data Management and Data Analytics. This Data Engineer will fill a critical role in enhancing and supporting the Data Analytics environment for prioritized Apogee Data Domains; educating our IT...

  • Data Engineer

    19 hours ago

    Minneapolis, United States Diverse Lynx Full time

    Title: Data Engineer Location- Minneapolis, MN(Onsite) Type: c Minimum 7+ Yrs of experience required - Experience in structured databases( Oracle, MSSQL) and unstructured databases (Hadoop) - Experience in spark / python (PySpark) / Azure products like Synapse, ADF, Databricks / Autosys - Strong experience on Data warehousing projects - Proficiency in...

  • Data Engineer

    2 months ago

    Minneapolis, United States Constellation Full time

    Description About Us Curi is a full-service advisory firm that serves physicians and medical practices. Equal parts fierce physician advocates, smart business leaders, and thoughtful partners, Curi's advisory, capital, and insurance offerings deliver valued advice that is grounded in client priorities and elevated by their outcomes. From data-driven advisory...

  • Data Engineer

    2 months ago

    Minneapolis, Minnesota, United States Constellation Full time

    About UsCuri is a full-service advisory firm that serves physicians and medical practices. Equal parts fierce physician advocates, smart business leaders, and thoughtful partners, Curi's advisory, capital, and insurance offerings deliver valued advice that is grounded in client priorities and elevated by their outcomes. From data-driven advisory services to...

  • Data Engineer

    4 days ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer

    5 days ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer

    1 day ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer

    2 days ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer

    2 days ago

    Minneapolis, United States Associated Bank National Full time

    At Associated Bank we strive to create an inclusive culture where different perspectives are valued and recognized as strengths critical to our success. If you thrive in an environment where your growth and development are encouraged and supported, then Associated Bank may be the right place for you. The Data Engineer works with application developers to...

  • Senior Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Expleo Group Full time

    OverviewTrissential is a trusted partner for end-to-end quality services and management consulting. As a part of our parent company Expleo, we have a footprint in 30+ countries. Our Mission is to have a positive impact on every person who interacts with Trissential. Clients love us because we are service focused. Employees love us because they are valued and...

  • Senior Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Senior Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Senior Data Engineer

    2 days ago

    Minneapolis, Minnesota, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Sr. Data Engineer

    2 days ago

    Minneapolis, United States Improving Full time

    Sr. Data Engineer (Cloud) Description As a Data Engineer, you'll be working with the latest cloud and technology stacks to help clients implement and mature their modern data architecture. You will work with tools/platforms like Kafka, Snowflake, and Databricks to help clients get the most out of their data that may be in systems like Salesforce, SAP, SQL...

  • Big Data Engineer

    5 hours ago

    Minneapolis, United States Chewy Full time

    Our Opportunity: Chewy is hiring a Big Data Engineer in Boston, MA, Minneapolis, MN or Plantation, FL for our HR System Integrations team. The ideal candidate will have extensive and diverse experience building and maintaining cloud databases, ingesting data using a variety of methods (including non-SQL technologies like SOAP and REST) and working on joining...