Senior Data Engineer

4 weeks ago

Saint Paul, United States Robert Half Full time
Job DescriptionJob Description

We are offering a contract employment opportunity for a proficient as a Senior Data Engineer. In this role, you will be instrumental in ensuring the smooth integration of data from various sources to facilitate robust analytics and business intelligence within the Information Technology sector. You will be working in a team-oriented environment, playing a pivotal role in designing, developing, and supporting our data ingestion pipelines.


Responsibilities:

• Develop, optimize, and maintain data processing scripts and applications using Python to support big data ingestion tasks.

• Utilize cloud data warehouses, such as Snowflake and AWS, to ensure optimal performance, security, and scalability of data pipelines.

• Assist in architecting and implementing Extract-Load-Transform (ELT) processes, including Fivetran, HVR, and AWS Lambda functions, to ensure efficient and accurate data loading between systems.

• Utilize Snowflake's functionality of tasks, streams, stored procedures, dynamic tables, and dbt (data build tool) to model raw data into a consumable format for data engineers, analysts, and scientists.

• Understand business processes, data flows, and strategies, working collaboratively to meet data needs.

• Produce, maintain, and encourage high-quality documentation to ensure transparency and understanding of data ingestion pipelines and solutions.

• Understand, monitor, and enhance data ingestion flows to enable reporting and insights development, including tracking data and job statuses.

• Mentor and guide other team members, advising on best practices around data ingestion pipelines and procurement of data based on use-cases for structured, semi-structured, and unstructured data.

• Foster a culture of continuous learning and development within the team.

• Must possess strong documentation and reporting skills.
• Proficiency in data analytics is required.
• Must have a deep understanding of quality assurance in data engineering.
• Should be able to handle task scheduling efficiently.
• Capable of creating and delivering effective presentations.
• Familiarity with the concept of 'About Time' is necessary.
• Must exhibit strong leadership skills.
• Proficiency in data security and procurement is required.
• Must have a solid background in engineering practices.
• Excellent communication skills are a must.
• Optimization skills are necessary, particularly in the context of data engineering.
• Must be proficient in SQL and Python.
• Experience with cloud technologies is a must.
• Must have familiarity with monitoring tools.
• Understanding of best practices in programming is required.
• Should be capable of providing oversight on complex data engineering projects.
• Bachelor's degree in computer sciences or a related field is a must.
• Must understand business process functions.
• Experience with AWS technologies is highly desirable.
• Must be able to work effectively within a business unit.

  • Senior Data Engineering Manager

    2 weeks ago

    Saint Paul, Minnesota, United States Metropolitan Council Full time

    Job SummaryThe Senior Data Engineer will work closely with technology and business stakeholders to determine data needs, design, develop, and maintain data solutions for operations, reporting, and analytics. This role requires strong programming skills, data modeling expertise, and experience with database administration and security.

  • Senior Data Engineer

    23 hours ago

    Saint Paul, United States Minnesota City Jobs Full time

    Metropolitan Council is now accepting applications for Senior Data Engineer (Database Administrator 2).The Senior Data Engineer designs, develops, and maintains data solutions. This includes databases, data platforms, data lakes, data warehouses, and data marts, as well as data movement (data pipelines/ETL/ELT – extracting, transforming, and loading data)....

  • Senior Data and Reporting Professional

    16 hours ago

    Saint Paul, United States CenterWell Full time

    CenterWell Senior Data and Reporting Professional Saint Paul, Minnesota Apply NowBecome a part of our caring community and help us put health firstThe Senior Data and Reporting Professional generates ad hoc reports and regular datasets or report information for end-users using system tools and database or data warehouse queries and scripts. The Senior Data...

  • Senior Campaign Development Engineer

    21 hours ago

    Saint Paul, United States Humana Full time

    Become a part of our caring community and help us put health firstThe Senior Campaign Development Engineer solves complex business campaign related problems and issues using data from internal sources to build, evaluate, and test population lists against design expectations of measure owners. The Senior Campaign Engineer will demonstrate what is possible...

  • Senior Data Engineer

    2 days ago

    Saint Louis, United States Grimco Full time

    Job DescriptionJob DescriptionSENIOR DATA ENGINEERDo you want to work for a company where the people are the purpose? Joining our dynamic data engineering team means more than just a job - it's an opportunity to be a vital part of our success story. Your role will be pivotal in designing, building, and maintaining our data infrastructure. Your expertise...

  • Senior Entra ID/Active Directory Engineer

    22 hours ago

    Saint Paul, United States Minnesota City Jobs Full time

    Metropolitan CouncilWe are seeking a highly skilled and experienced Senior Entra ID / Active Directory Engineer to join our team. This role is critical in administering and securing a complex IT environment containing CJIS Data, PCI, HIPAA, and PII data. The ideal candidate will have extensive experience in managing hybrid on-premises and cloud identity...

  • Senior Mechanical Engineer

    2 weeks ago

    Saint Paul, Minnesota, United States KFI Engineers PC Full time

    Job OverviewKFI Engineers PC, a renowned industry leader in facility infrastructure design and performance, seeks an experienced Senior Mechanical Engineer to join its Medical & Clean Manufacturing Group. Reporting to the Senior Project Manager, this individual will provide technical and engineering excellence, ensuring successful project execution and...

  • Data Platform Architect

    2 weeks ago

    Saint Paul, Minnesota, United States Metropolitan Council Full time

    About the PositionWe are seeking a highly skilled Senior Data Engineer to join our team at the Metropolitan Council. This role is responsible for designing, developing, and maintaining data solutions that support our organization's goals.

  • Senior Azure Data Solutions Engineer

    1 month ago

    Saint Paul, Minnesota, United States Dreamforce Services, Inc Full time

    At Dreamforce Services, Inc, we're seeking a highly skilled Azure Data Solutions Engineer to join our team. In this role, you'll be responsible for designing, implementing, and managing scalable and secure Azure cloud solutions. Your expertise in Azure networking, including hybrid connectivity solutions, disaster recovery routing, and private access to Azure...

  • Senior Electrical Engineer

    3 weeks ago

    Saint Paul, United States Cynet Systems Full time

    Job DescriptionJob DescriptionWe are looking for Senior Electrical Engineer for our client in Saint Paul, MNJob Title: Senior Electrical EngineerJob Location: Saint Paul, MNJob Type: ContractJob Description:Responsibilities:Support electrical hardware development, integration, and testing for capital systems and Ureteroscopes.Collaborating with...

  • Systems Engineer

    2 weeks ago

    Saint Paul, United States Smart Data Solutions LLC Full time

    As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients which reduces costs, streamlines workflows, and improves overall customer experience. Looking to the future, Smart Data...

  • Systems Engineer

    2 weeks ago

    Saint Paul, United States Smart Data Solutions LLC Full time

    As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients which reduces costs, streamlines workflows, and improves overall customer experience. Looking to the future, Smart Data...

  • Senior Systems Administrator

    4 weeks ago

    Saint Paul, United States Smart Data Solutions LLC Full time

    As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients which reduces costs, streamlines workflows, and improves overall customer experience. Looking to the future, Smart Data...

  • Senior Automation Engineer

    2 weeks ago

    Saint Paul, Minnesota, United States Powermation Full time

    Power/mation is seeking a Senior Automation Engineer to join our Solutions Engineering Team in St. Paul.About the JobThis full-time position involves designing, implementing and managing automation projects for industrial clients across Minnesota, Wisconsin, Illinois, Iowa, Nebraska, and the Dakotas. The ideal candidate will have 5+ years of experience...

  • Data Engineering II

    11 hours ago

    Saint Paul, United States Travelers Full time

    Who Are We?Taking care of our customers, our communities and each other. That’s the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what...

  • Senior Engineering Professional

    2 weeks ago

    Saint Paul, Minnesota, United States KFI Engineers PC Full time

    KFI Engineers PC is a dynamic and collaborative company that values innovation and customer satisfaction. We are seeking an experienced Senior Engineering Professional to join our team.This individual will be responsible for providing technical and engineering support to other departments and disciplines. A strong understanding of Architectural, Electrical,...

  • Senior Data Engineer

    13 hours ago

    St Paul, United States Metropolitan Council Full time

    Senior Data Engineer (Database Administrator 2) Print (https://www.governmentjobs.com/careers/metrocouncil/jobs/newprint/4605204) Apply  Senior Data Engineer (Database Administrator 2) Salary See Position Description Location 390 Robert St. N St. Paul, MN Job Type Full-Time Job Number 2024-00313 Division Regional...

  • Data Engineer Leader

    1 week ago

    Vineuil-Saint-Firmin, Hauts-de-France, United States Capital One Full time

    About Capital One:We are a big group of makers, breakers, doers and disruptors who solve real problems and meet real customer needs.Job Overview:This is an exciting opportunity to join our team as a Senior Data Engineer. You will be responsible for designing, developing, testing, implementing and supporting technical solutions in full-stack development tools...

  • Senior Building Performance Engineer

    2 weeks ago

    Saint Paul, Minnesota, United States KFI Engineers PC Full time

    Job OverviewKFI Engineers PC is a leading industry expert in facility infrastructure design and performance. We are seeking a highly skilled Senior Building Performance Engineer to support successful execution of commissioning, re/retro-commissioning, and energy audit projects.About the RoleThis senior-level position plays a critical role in providing...

  • Senior Data Migration Specialist

    2 weeks ago

    Saint Paul, Minnesota, United States Performix Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Migration Specialist to join our team at Performix. This is a challenging role that requires expertise in project management, data analysis, and system implementation.The successful candidate will be responsible for planning and executing the migration of client data from their current Immunization...