Senior Data Engineer

3 weeks ago


Minneapolis, Minnesota, United States On-Demand Group Full time

Job Title: Senior Data Engineer

We are seeking a skilled Senior Data Engineer to design, build, and maintain data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery.

Key Responsibilities:

  • Design, develop, and implement data pipelines using GCP BigQuery for data ingestion, transformation, and loading.
  • Optimize data pipelines for performance, scalability, and cost-efficiency.
  • Ensure data quality through data cleansing, validation, and monitoring processes.
  • Develop and maintain data models and schemas in BigQuery to support various data analysis needs.
  • Automate data pipeline tasks using scripting languages like Python and tools like Dataflow.
  • Collaborate with data analysts and data scientists to understand their data requirements and translate them into technical solutions.
  • Comfortable with DevOps to ensure seamless integration of data pipelines with CI/CD workflows.
  • Monitor and troubleshoot data pipelines and infrastructure to identify and resolve issues.
  • Stay up-to-date with the latest advancements in GCP BigQuery and related technologies.
  • Document data pipelines and technical processes for future reference and knowledge sharing.

Requirements:

  • Bachelor's degree or equivalent experience in Computer Science, Mathematics, Information Technology or related field.
  • 5+ years of experience as a data engineer or a similar role.
  • Strong understanding of data warehousing concepts and data modeling principles.
  • Proven experience with designing and implementing data pipelines using GCP BigQuery.
  • Strong SQL and scripting languages like Python (or similar) skills.
  • Experience with data quality tools and techniques.
  • Excellent communication and collaboration skills.
  • Ability to work independently and as part of a team.
  • Strong problem-solving and analytical skills.
  • Passion for data and a desire to learn and adapt to new technologies.
  • Experience with other GCP services like Cloud Storage, Dataflow, and Pub/Sub.
  • Experience with cloud deployment and automation tools like Terraform.
  • Experience with data visualization tools like Tableau or Power BI or Looker.
  • Experience with healthcare data.
  • Experience with machine learning, artificial intelligence and data science concepts.
  • Experience with data governance and healthcare PHI data security best practices.

Benefits:

On-Demand Group provides employee benefits which includes healthcare, dental, and vision insurance.



  • Minneapolis, Minnesota, United States Innova Solutions Full time

    About the Role:Innova Solutions is seeking a highly skilled Senior Cloud Data Engineer to join our team. As a Senior Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines on cloud-based platforms such as AWS, Azure, or GCP.Key Responsibilities:Design and implement data pipelines using cloud-based...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Senior Data Engineering and AI Operations LeadJob Summary:Futran Tech Solutions Pvt. Ltd. is seeking a Senior Data Engineering and AI Operations Lead to join our team. As a key member of our data engineering and AI operations team, you will be responsible for designing, building, and maintaining end-to-end (Data/Dev/ML) CI/CD pipelines that...

  • Senior Data Architect

    4 weeks ago


    Minneapolis, Minnesota, United States Levi Ray & Shoup Inc Full time

    Job Summary:Fulcrum Consulting, an LRS company, is seeking a Senior Data Engineer - Lead to oversee the design, development, and maintenance of our data infrastructure. As the Senior Data Engineer Lead, you will be responsible for leading a team of data engineers, driving best practices in data integration, modeling, and reporting. Your expertise in...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the RoleAssociated Bank is seeking a Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our technology organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities ensuring scalability, reliability, reusability,...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About the Role:Associated Bank National is seeking a highly skilled Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities ensuring scalability, reliability,...


  • Minneapolis, Minnesota, United States Allianz Full time

    Job SummaryThe Senior Manager of Data Engineering is responsible for the day-to-day technical management and delivery of assigned functions, projects, or programs, data infrastructure and pipelines for various insurance policy administration systems and other supporting applications.Key ResponsibilitiesProviding day-to-day work direction, including...


  • Minneapolis, Minnesota, United States DataSite Full time

    Data Engineering ManagerAt Datasite, we're looking for a skilled Data Engineering Manager to join our team. As a key member of our data engineering team, you will be responsible for architecting complex data problems, developing data pipelines, and making quality data available at scale.Key Responsibilities:- Lead data teams and develop data pipelines to...


  • Minneapolis, Minnesota, United States Experis Full time

    Job Title:Data Governance Engineer / Data ModelerLocation:Minneapolis, MN (Hybrid)Client Industry:Insurance/ Asset Management]Term:Contract-To-HireData Governance Engineer / Data Modeler| HybridWe are seeking a highly skilled Data Governance Engineer / Data Modeler to play a crucial role in shaping data architecture and driving data modeling best practices...


  • Minneapolis, Minnesota, United States Omni Inclusive Full time

    Job SummaryOmni Inclusive is seeking a highly skilled Sr Data Engineer to design, implement, and manage Azure cloud solutions for various projects. The ideal candidate will have a strong background in data engineering, cloud computing, and Azure services.Key Responsibilities Design and implement data pipelines using Databricks (PySpark) for data ingestion,...

  • Senior Data Scientist

    4 weeks ago


    Minneapolis, Minnesota, United States Associated Banc-Corp Full time

    About the Role:We are seeking a highly skilled Senior Data Scientist to join our team at Associated Banc-Corp. As a Senior Data Scientist, you will be responsible for guiding and influencing a team of data scientists, business intelligence analysts, and data engineers to solve complex business problems.Key Responsibilities:Analyze large, structured, and...

  • Senior Data Architect

    3 weeks ago


    Minneapolis, Minnesota, United States Insight Global Full time

    At Insight Global, we're on a mission to create diverse and inclusive environments where individuals can bring their authentic selves to work every day. As a Senior Data Architect for our healthcare platform provider organization, you'll play a pivotal role in designing, building, and optimizing data pipelines in GCP BigQuery.With a strong background in SQL...


  • Minneapolis, Minnesota, United States Atomic Data Full time

    Job Summary: The Manager of Infrastructure Engineering is responsible for leading a team of Datacenter and Infrastructure Engineers to deliver excellent technical and non-technical support with outstanding customer service, satisfaction, and timeliness within the organization's budget. This position has frequent contact with clients, direct reports, peers,...

  • Senior Data Scientist

    4 weeks ago


    Minneapolis, Minnesota, United States Associated Banc-Corp Full time

    About the Role:Associated Banc-Corp is seeking a highly skilled Senior Data Scientist to join our team. As a Senior Data Scientist, you will be responsible for guiding and influencing a team of data scientists, business intelligence analysts, and data engineers to solve complex business problems.Key Responsibilities:Analyze large, structured, and...

  • Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Valere Full time

    Job SummaryWe are seeking a highly skilled Data Engineer for our client in MN. This is a long-term contract position.The role is a part of the Treasury Services' Data Engineering team for a large-scale program.

  • Senior Civil Engineer

    4 weeks ago


    Minneapolis, Minnesota, United States WSP Full time

    Job SummaryWe are seeking a highly skilled Senior Consultant Civil Engineer to join our Transportation and Infrastructure team at WSP USA. The ideal candidate will have a strong background in civil engineering, project management, and transportation planning, with a proven track record of delivering high-quality projects on time and within budget.Key...

  • Senior Data Architect

    4 weeks ago


    Minneapolis, Minnesota, United States Pyramid Consulting Full time

    Job Title: Senior Data ArchitectJob Summary:We are seeking a highly skilled Senior Data Architect to join our team at Pyramid Consulting. As a Senior Data Architect, you will be responsible for designing and implementing data management solutions that meet the needs of our clients.Key Responsibilities:Design and implement data management solutions using...


  • Minneapolis, Minnesota, United States Wipro Full time

    About WiproWipro Limited (NYSE:WIT,BSE:507685,NSE:WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs.We leverage our holistic portfolio of capabilities in consulting, design, engineering, operations, and emerging technologies to help clients...


  • Minneapolis, Minnesota, United States IRIS Consulting Corporation Full time

    Job Summary:The Senior Full Stack Software Engineer is a pivotal role within our Technology Team. This position serves as a senior technical resource and subject matter expert, acting as a senior resource working throughout all phases of technology delivery.As a Senior Full Stack Software Engineer, you will possess a deep passion for the entire engineering...


  • Minneapolis, Minnesota, United States Cirtec Medical Full time

    Job Summary:The Senior Quality Engineer will be responsible for developing, establishing, and maintaining quality engineering methodologies, systems, and practices that meet customer and regulatory requirements. This role will provide quality engineering support for engineering product development and sustained manufacturing.Key Responsibilities:Provide...

  • Senior Data Modeler

    4 weeks ago


    Minneapolis, Minnesota, United States Pyramid Consulting, Inc Full time

    Job Opportunity: Senior Data ModelerWe are seeking a skilled Senior Data Modeler to join our team at Pyramid Consulting, Inc. This is a contract opportunity with long-term potential and is located in a hybrid setting.Key Responsibilities:Design and implement data models using ErwinDevelop and maintain metadata management systemsCollaborate with...