Sr Data Engineer

3 weeks ago


Harrisburg, United States D&H Distributing Full time

SUMMARY

​The Sr Data Engineer will need to be analytical, technically inclined, detail-oriented, visually focused, and a self-learner. As a Subject Matter Expert in technical requirements, this role is critical in supporting and implementing data projects and solutions, and effectively engaging with users and other IT staff. As a member of the Business Intelligence team, the individual will be able analyze the existing data warehouse database to ensure the efficiency and accuracy to business functions and operational reporting, as well as modify the ETL processes for a complex and maturing data warehouse. They should also:

  • Have an understanding of data modeling, have excellent analytical skills, and the ability to identify solutions to complex data problems.
  • Have an understanding or working experience with BI tools such as Cognos or Tableau
  • Be able to communicate appropriately with the team leadership.
  • Be able to interpret business requests and create technical requirements, including mapping documents to support the data ingestion and pipeline development process, and the execution of ETL jobs.

ESSENTIAL DUTIES AND RESPONSIBILITIES

  • ​Interpret business requests and create technical requirements, including mapping documents to support the data ingestion and pipeline development process, and the execution of ETL jobs.
  • Supporting, optimizing and monitoring current data warehousing, data modeling, data integration, business intelligence and ETL processes on NETEZZA platform with CTAS, CBT, zone map and work-load management.
  • Provide assistance in troubleshooting and resolving data and system issues, stepping in when necessary to address outages and challenges.
  • Develops ETL’s using mostly DataStage with some flavors of SSIS to facilitate Extraction, Transformation and Data Load from disparate systems.
  • Maintain methods and procedures for tracking data quality, completeness, redundancy, and improvement.
  • Develop and maintain SQL stored procedures and views as part of a star database schema on NETEZZA using WinSQL, NZLOAD, NZSQL and NZBACKUP utilities.
  • Need to have the ability to analyze and trouble issues across various applications from Access Tools(Cognos, Tableau and Excel), Data warehouse/Data Marts on Netezza Platform.
  • Knowledge of wrapper scripts for Netezza Loader (i.e. NZLOAD) and reporting using Shell scripting, PERL and NZSQL.
  • Have an understanding of scheduling tools such as: Active Batch, Tidal or similar
  • Troubleshoot issues such as connections, failed jobs, application errors, server alerts, space thresholds, etc. within predefined SLAs.
  • Actively participate in design discussions, code reviews, and project-related team meetings.
  • Develop processes that facilitate data transformation, manage data structures, metadata, dependencies, and workload management.
  • Collaborate with business users to understand functional and data requirements, contributing to the enhancement of data models and pipelines.
  • Apply expert-level analytical and problem-solving skills to troubleshoot and resolve technical issues.
  • Develop, maintain, and continuously enhance scalable data pipelines, while also developing new data source integrations to support the growing volume and complexity of data.
  • Proactively maintain and tune SQL code.
  • Identify and capture lessons learned, best practices, and information gained during performance of tasks.
  • Be part of a 24x7 on-call rotation for after hour and weekend production support.

EDUCATION and/or EXPERIENCE

Education

  • ​Bachelor’s degree (B. A.) from four-year college or university; or one to two years related experience and/training; or equivalent combination of education and experience.

Experience

  • ​5-7 years’ experience extracting and summarizing data from a variety of data source types using ETL tools
  • ​Experience in writing complex SQL using Netezza and SQL Server with a strong competency in T-SQL
  • Experience interfacing with business users and understanding their requirements
  • Experience with DataStage, QualityStage, DataDirector, SSIS, SSRS, Powershell, Active Batch
  • Experience with Tableau and Cognos a plus


  • Software Engineer

    2 days ago


    Harrisburg, United States Global Data Consultants Full time

    Overview GDC IT Solutions is currently seeking a Software Engineerin the Harrisburg, PAarea. Position Overview: This position provides application and database administration, system design, installation, and upgrade support at a moderate level. It will support various commercial software products. This role is skilled and works on projects with medium...

  • Software Engineer

    10 hours ago


    Harrisburg, United States Global Data Consultants Full time

    Overview GDC IT Solutions is currently seeking a Software Engineerin the Harrisburg, PAarea. Position Overview: This position provides application and database administration, system design, installation, and upgrade support at a moderate level. It will support various commercial software products. This role is skilled and works on projects with medium...

  • Software Engineer

    6 days ago


    Harrisburg, United States Global Data Consultants Full time

    Overview GDC IT Solutions is currently seeking a Software Engineerin the Harrisburg, PAarea. Position Overview: This position provides application and database administration, system design, installation, and upgrade support at a moderate level. It will support various commercial software products. This role is skilled and works on projects with medium...

  • Software Engineer

    1 week ago


    Harrisburg, United States Global Data Consultants Full time

    Overview GDC IT Solutions is currently seeking a Software Engineerin the Harrisburg, PAarea. Position Overview: This position provides application and database administration, system design, installation, and upgrade support at a moderate level. It will support various commercial software products. This role is skilled and works on projects with medium...

  • Sr Project Engineer

    4 weeks ago


    Harrisburg, United States Hiring Now! Full time

    Project Scope/Scope of Responsibility: Leverages engineering knowledge, judgment, creativity and experience to lead multiple disciplined engineering initiatives of high complexity and long duration. Develops the business case, technical feasibility, and plan for customer (plant) acceptance. Provides technical direction to multiple teams in the development of...


  • Harrisburg, United States UPMC Full time

    **Purpose:** The Sr. Clinician is a highly developed role model of professional nursing practice with focused expertise and accountabilities in one or more of the following: expert clinical practice, teaching/development, and/or evidence based practice. This senior role leads the unit through difficult and complex EBP, process improvement to advance their...


  • Harrisburg, United States University of Pittsburgh Medical Center Full time

    Purpose: The Sr. Clinician is a highly developed role model of professional nursing practice with focused expertise and accountabilities in one or more of the following: expert clinical practice, teaching/development, and/or evidence based practice. This senior role leads the unit through difficult and complex EBP, process improvement to advance their...


  • Harrisburg, United States Focused HR Solutions LLC Full time

    Must be on site one day a month in Harrisburg, PA Our direct client has an opening for a Sr. Business Analyst 726139This contract is up to 6 months, and the client is located in Harrisburg, PA WE CAN WORK CORP TO CORP OR W2If you are interested, please submit the followingYOUR CURRENT RESUMEYOUR HOURLY RATEBusiness analysis experience. Required 5...

  • SR Failure Analysis

    1 month ago


    Harrisburg, Pennsylvania, United States TE Connectivity Full time

    At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world. ​Job Overview TE Connectivity is seeking an engineer to join our Harrisburg Failure Analysis and Reliability Engineering (HFAR) group. The position reports to the manager of the HFAR group. The...


  • Harrisburg, United States D&H Distributing Full time

    SUMMARY​The Sr Data Engineer will need to be analytical, technically inclined, detail-oriented, visually focused, and a self-learner. As a Subject Matter Expert in technical requirements, this role is critical in supporting and implementing data projects and solutions, and effectively engaging with users and other IT staff. As a member of the Business...


  • Harrisburg, United States D&H Distributing Full time

    SUMMARY Please make an application promptly if you are a good match for this role due to high levels of interest. ​The Sr Data Engineer will need to be analytical, technically inclined, detail-oriented, visually focused, and a self-learner. As a Subject Matter Expert in technical requirements, this role is critical in supporting and implementing data...


  • Harrisburg, United States D&H Distributing Full time

    SUMMARY ?The Sr Data Engineer will need to be analytical, technically inclined, detail-oriented, visually focused, and a self-learner. As a Subject Matter Expert in technical requirements, this role is critical in supporting and implementing data projects and solutions, and effectively engaging with users and other IT staff. As a member of the Business...


  • Harrisburg, United States Prime AE Group Full time

    PRIME AE Group, Inc. (www.primeeng.com), a multi-faceted and rapidly growing architectural and engineering firm with 20 office locations and over 475 employees throughout the Midwest, Mid-Atlantic, Southeast, and Northeast areas, is seeking a qualified candidate to serve as a TSMO | Senior Traffic Engineer in one of our Transportation offices (Jacksonville,...


  • Harrisburg, United States Focused HR Solutions LLC Full time

    Job is 100% remote. Must be local to PA. The candidate must physically report to the 5th floor of The Keystone Building in Harrisburg, PA in order for first day processing, possible badging (this may take a few days for completion) and to pick up commonwealth-issued equipment.*** Our direct client has an opening for a Sr. Java Developer 706938 This position...

  • Sr. Designer

    2 days ago


    Harrisburg, United States KCI Technologies Full time

    Overview Join us as we Rise to the Challenge At KCI, we’re building an enduring community that provides unparalleled value to our employee-owners. We make our mark designing and delivering our world-class solutions, so we invest deeply in supporting and developing our team. We reward integrity and commitment, and when we do well, you do well. Our...


  • Harrisburg, United States e-Primary Full time

    Verbal & written communication. Title: Data & Analytics Architect Location: Harrisburg, PA (Remote) Duration: 10 months Position Summary: The Data & Analytics Architect actively participates in providing the overall direction of architecture across the entire Data and Analytics platform focused on the following four key verticals: Acquire and Ingest, Store...


  • Harrisburg, United States University of Pittsburgh Medical Center Full time

    Are you a Registered Respiratory Therapist looking to join a dynamic working and learning environment? UPMC is looking to hire a full-time, Sr. Registered Respiratory Therapist to join our team of Life Changers! Shift is 7:00am-5:30pm (4-10-hour shifts) Will travel between campuses which is about 25% of the time. Manager will discuss further during...


  • Harrisburg, United States UPMC Full time

    Are you a Registered Respiratory Therapist looking to join a dynamic working and learning environment? UPMC is looking to hire a full-time, Sr. Registered Respiratory Therapist to join our team of Life Changers! Shift is 7:00am-5:30pm (4-10-hour shifts) Will travel between campuses which is about 25% of the time. Manager will discuss further during...


  • Harrisburg, Pennsylvania, United States tapwage Full time

    At Trane TechnologiesTM and through our businesses including Trane and Thermo King, we create innovative climate solutions for buildings, homes, and transportation that challenge what's possible for a sustainable world. We're a team that dares to look at the world's challenges and see impactful possibilities. We believe in a better future when we uplift...


  • Harrisburg, United States tapwage Full time

    At Trane TechnologiesTM and through our businesses including Trane® and Thermo King®, we create innovative climate solutions for buildings, homes, and transportation that challenge what’s possible for a sustainable world. We're a team that dares to look at the world's challenges and see impactful possibilities. We believe in a better future when we...