Data Engineer

4 weeks ago

Saint Paul, United States TechNix LLC Full time
Job DescriptionJob Description

Position: Data Engineer

Duration: 2 Years

Location: St. Paul, Minnesota (Onsite from Day 1)

Sample Tasks

  • Build creates, maintain and optimize data pipeline from development to production for uses cases,
  • Drive Automation through effective metadata management: responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Use modern data preparation, integration and AI-enabled metadata management tools and techniques.
  • Tracking data consumption patterns.
  • Performing intelligent sampling and caching.
  • Monitoring schema changes.
  • Recommending - or sometimes even automating - existing and future integration flows.
  • Proposing appropriate (and innovative) data ingestion, preparation, integration and operationalization techniques in optimally addressing these data requirements.
  • Train counterparts such as [data scientists, data analysts, users or any data consumers] in these data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Ensure data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives. Provide knowledge transfer

Qualifications

  • Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management
  • Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
  • Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies.
  • These should include ETL/ELT, data replication/CDC, message-oriented data movement, API design and access and upcoming data ingestion and integration technologies such as stream data integration, CEP and data virtualization.
  • Strong experience and collaboration supporting and working with cross-functional teams in a dynamic business and IT environment.
  • Highly creative and collaborative working with both business and IT teams to define the business problem, refine the requirements, and design and develop data deliverables accordingly.
  • Ability to interface with, and gain the respect of, stakeholders at all levels and roles within the company.
  • Good judgment, a sense of urgency and has demonstrated commitment to high standards of ethics, regulatory compliance, customer service and business integrity.

  • Lead, Data Engineer

    3 weeks ago

    Saint Paul, United States Arch Capital Group Full time

    With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠. Job Summary Lead Data Engineers provide strategic...

  • Data Engineer

    1 day ago

    Saint Paul, Minnesota, United States Randstad USA Full time

    job summary: Job Description: We are seeking a highly skilled and motivated Data Engineer to own our organizations data impact and architecture. This individual will play a pivotal role in designing, implementing, and maintaining robust data management systems and processes. Leveraging your expertise in data architecture, integration, and governance, you...

  • Lead Data Engineer

    1 day ago

    Saint Paul, Minnesota, United States ECOLAB Full time

    The Lead Data Engineer is part of the EDO - focused on Institutional division's Global Business Intelligence & Analytics and is responsible for leading and supporting development of information and reporting systems which create value and insight. This requires in-depth development experience with Ecolab's cloud technologies (Azure, Snowflake, Power BI,...

  • Lead Data Engineer

    1 day ago

    Saint Paul, Minnesota, United States ECOLAB Full time

    The Lead Data Engineer is part of the EDO - focused on Institutional division's Global Business Intelligence & Analytics and is responsible for leading and supporting development of information and reporting systems which create value and insight. This requires in-depth development experience with Ecolab's cloud technologies (Azure, Snowflake, Power BI,...

  • Lead Data Engineer

    2 days ago

    Saint Paul, United States Ecolab Full time

    Job DescriptionThe Lead Data Engineer is part of the EDO – focused on Institutional division’s Global Business Intelligence & Analytics and is responsible for leading and supporting development of information and reporting systems which create value and insight. This requires in-depth development experience with Ecolab’s cloud technologies (Azure,...

  • Senior Data Engineer

    1 day ago

    Saint Paul, Minnesota, United States Securian Full time

    Position Summary:Design, deploy, and manage the organization's data architecture. Collaborate with technology and management teams to understand structural requirements and define standards for how data will be stored, consumed, integrated, and managed across the organization and translate into a usable blueprint. Build an inventory of data needed to...

  • Integration Engineer

    3 days ago

    St Paul, United States People, Data & Solutions Full time

    Integrations Engineer Remote (Minnesota Based) The Senior Integration Engineer is responsible for designing, implementing, and maintaining integration solutions, leveraging deep knowledge of integration technologies and best practices. This role will incorporate a balanced workload across strategic thinking, solution design, timeline estimation, technical...

  • Data Security Consultant

    6 days ago

    Saint Paul, United States The Methodical Group Full time

    Job DescriptionJob DescriptionSample Tasks:Assist with evaluation of architecture interfacing with other state/federal/local systems.Assist with assessing the security of any equipment needed.Assist with the evaluation of data integrity and data security.Assist with ensuring all background check compliance is met for all project team members.Assist with...

  • Mailroom Scan Operator

    8 hours ago

    Saint Paul, United States Smart Data Solutions LLC Full time

    Job DescriptionJob DescriptionDo you have strong attention to detail and a can-do attitude? If so, this may be the job for you!As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for...

  • Data Visualization Developer

    1 day ago

    Saint Paul, Minnesota, United States Affinity Plus Federal Credit Union Full time

    Position Overview:A Data Visualization Developer is part of the Enterprise Digital Intelligence (Edi) team and is responsible for the design, development, implementation, and enhancements of high value enterprise analytics solutions within a cloud environment. This role requires advanced knowledge of data visualization techniques and applicability to...

  • Data Security Consultant

    2 weeks ago

    Saint Paul, United States Quetica, LLC Full time

    Job DescriptionJob DescriptionQuetica is seeking a part-time Data Security Consultant and Local Agency Security Officer resource to work with the Minnesota Department of Public Safety (DPS) and Driver and Vehicle Services (DVS) to conduct comprehensive audits of data systems including its infrastructure, policies and procedures, to assure: 1) all data meets...

  • Human Resource Manager

    2 days ago

    Saint Paul, United States Smart Data Solutions LLC Full time

    Job DescriptionJob DescriptionAs a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients which reduces costs, streamlines workflows, and improves overall customer experience....

  • Data Governance Platform Administrator

    1 day ago

    Saint Paul, Minnesota, United States Affinity Plus Federal Credit Union Full time

    Position Overview:The Data Governance Platform Administrator is part of the Enterprise Digital Intelligence (Edi) team and is responsible for administrating Data Governance Platform and on-going adoption of our data governance framework. This role plays a crucial role in ensuring the Affinity Plus data is well-managed, governed, and utilized effectively to...

  • Data Engineer

    2 weeks ago

    Saint Louis, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: Tekwissen Group, is a workforce management provider throughout the USA and many other countries in the world. This client is a German multinational Pharmaceutical and biotechnology company and one of the largest pharmaceutical companies in the world, headquartered in Leverkusen, and areas of business include...

  • data modeler

    1 day ago

    Saint Paul, Minnesota, United States ECOLAB Full time

    Join the innovative and dynamic One Customer project, at the forefront of technological advancement; revolutionizing data management and analytics solutions and empowering our organization to harness the full potential of their data, enterprise wide. As part of our team, you'll collaborate with talented individuals dedicated to driving impactful change...

  • Lead Data Engineer

    7 hours ago

    St. Paul, United States ECOLAB Full time

    The Lead Data Engineer is part of the EDO - focused on Institutional division's Global Business Intelligence & Analytics and is responsible for leading and supporting development of information and reporting systems which create value and insight. This requires in-depth development experience with Ecolab's cloud technologies (Azure, Snowflake, Power BI,...

  • Lead Data Engineer

    2 days ago

    St Paul, United States Ecolab Full time

    The Lead Data Engineer is part of the EDO – focused on Institutional division’s Global Business Intelligence & Analytics and is responsible for leading and supporting development of information and reporting systems which create value and insight. This requires in-depth development experience with Ecolab’s cloud technologies (Azure, Snowflake, Power...

  • Data Security Consultant: MN: Remote

    2 weeks ago

    Saint Paul, United States NextRow Digital Full time

    Job DescriptionJob DescriptionResource Title: Data Security ConsultantLocation: St Paul, MN (Remote) Duration: Long Term ContractSample TasksAssist with evaluation of architecture interfacing with other state/federal/local systems.Assist with assessing the security of any equipment needed.Assist with the evaluation of data integrity and data security.Assist...

  • Senior Engineer

    1 month ago

    Saint Joseph, United States LECO Corporation Full time

    Job DescriptionJob DescriptionSenior Engineer - DATAFor over 80 years, LECO has been a leader in the development and production of world class laboratory instruments delivering state of the art products nationwide and across the globe. Located in St. Joseph, Michigan, LECO continues to be a family-owned company that understands the value of shared interests,...

  • Mechanical Engineer

    6 days ago

    Saint Paul, United States Caztek Full time

    Job DescriptionJob DescriptionPosition Overview: Caztek Engineering is an innovative Engineering and Product Development company. We develop products for a wide variety of industries including medical, aerospace, industrial, and consumer markets. We have a dynamic, creative, project-based environment, working on many cutting-edge and new product designs. As...