Sr. (Lead) Data Engineer I (II)

3 weeks ago


Norristown, United States PJM Inc Full time
Flexible Work Arrangement - Hybrid

The Sr. (Lead) Data Engineer is responsible for designing and implementing methods to improve data: reliability, security and quality across the enterprise. They combine raw information from different sources to create consistent and machine-readable formats. They also develop, test and build algorithms, architectures and infrastructure that enable data extraction and transformation for various modeling needs for example predictive or prescriptive modeling. Other functions can include organizing large datasets.

Essential Functions:
  • Analyze and organize raw data, cataloging fields and entities
  • Building data architectures, and data pipelines to collectively bring together data
  • Analyzing, planning, and defining data architecture framework(s), including security, reference data, metadata, and master data
  • Participation in analyzing business needs and objectives with analysts, data Architects and engineers, developers, report writers and report consumers
  • Inform and support the organizations data strategy
  • Conduct complex data analysis and collaboration with analysts, developers and
  • Prepare data for prescriptive and predictive modeling
  • Build algorithms and prototypes to support data integration and other data related functions
  • Identify opportunities for data acquisition and determine data update velocity
  • Collaborating with other teams within the organization to devise and implement data strategies, build models, and assess customers needs and goals
  • Work with Data Architects in developing and supporting patterns that data engineers, developers and others can follow
  • Support and inform data governance practices
  • Creating and implementing data management processes and procedure
Characteristics & Qualifications:
Required:
  • BS degree in Computer Engineering, Information Systems, Statistics, Informatics or at least 5 years of experience Data Engineer or Architect role
  • At least 5 years of experience Strong knowledge of SQL
  • Experience with data pipeline and workflow management tools
  • Experience in Azure data engineering and cloud data processing services
  • Knowledge of Programming e.g. SAS, Python, PySpark, R, Oracle PL/ SQL
  • Experience in one or more of the following: C, C++, Java, Python, Go, Perl or Ruby.
  • Experience with algorithms, data structures, complexity analysis and software design.
  • Experience with managing database infrastructure (particular emphasis on Oracle and Sql Server)
  • Experience with configuration management tools like Puppet, Chef
  • Experience with Unix, AIX, Debian, Windows operating systems, containers, container orchestrators
  • Experience with git based code repositories.
  • Experience using and administering JEE application servers including JBoss, WebSphere, or WebLogic
Preferred:
  • MS degree in Computer Science, Information Systems, Statistics or Informatics
  • At least 5 years of work experience
  • Experience with SAS development tools and datasets (e.g. SAS Grid, SAS Display manager, SAS Studio )
  • Hands on experience in Data Warehousing and ETL tools
  • Experience in Big Data technologies (e.g. Spark, Databricks,) Experience building and optimizing 'big data' data pipelines, architectures, and data sets
  • Performance/security-oriented data design, including partitions, different types of indexes, views, and most effective data management practices.
  • Experience with Azure Synapse Analytics, Azure DevOps
  • Experience with Purview, PowerBI, Alteryx, Qlik, or Tableau Experience with NoSQL
  • Experience with PJM operations, markets, and planning functions


  • Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: HybridThe Market Design Specialist will work directly with the Manager of Market Design to support the development of significant market design enhancements across all of PJM's markets. The Market Design Specialist will be responsible for leading cross-divisional teams in the development of such enhancements, offering subject...


  • Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: Hybrid The Market Design Specialist will work directly with the Manager of Market Design to support the development of significant market design enhancements across all of PJM's markets. The Market Design Specialist will be responsible for leading cross-divisional teams in the development of such enhancements, offering subject...


  • Norristown, United States PJM Inc Full time

    Flexible Work Arrangement: Hybrid The Sr. (Lead) Business Solution Architect is responsible for developing the vision and leading project teams to design, develop and implement PJM's business solutions based on business requirements and technical strategy. This position will be responsible for providing architectural skills and experience in the areas of...


  • Norristown, United States PJM Inc Full time

    Flexible work arrangement: Hybrid In this role as a member of PJM's Risk Underwriting Team, you will be accountable for the credit and liquidity risk management of an increasing portfolio of counterparts engaged in the PJM markets. Individuals in this role perform analytical modeling to assess and minimize PJM's exposure to credit risk, perform counterparty...


  • Norristown, United States PJM Inc Full time

    Flexible Work Arrangement: Hybrid The (Sr.) HR Business Partner will provide daily general HR support to defined client groups. Business Partner support will include coaching, consulting, employee relations, organizational effectiveness and development, performance management, recruiting/staffing and front line support for compensation and benefits (Total...


  • Norristown, United States PJM Search Full time

    Assess long term transmission system adequacy and reliability. Evaluate and recommend bulk transmission system expansion or enhancement options needed to address the changing resource mix. Collaborate with skilled engineers that perform transmission Systems Engineer, Power, Engineer, Systems, Lead, Transmission, Technology


  • Norristown, United States PJM Inc Full time

    Assess long term transmission system adequacy and reliability. Evaluate and recommend bulk transmission system expansion or enhancement options needed to address the changing resource mix. Collaborate with skilled engineers that perform transmission expansion analysis supporting the development of the Long Term Regional Transmission Expansion Plan. Develop...


  • Norristown, United States ECS Corporate Services, LLC Full time

    Oversee full lifecycle of geotechnical engineering projects. Develop project scopes, budgets, schedules, and plans. Perform geotechnical analysis and engineering calculations. Supervise field exploration programs and interpret geotechnical data from Project Engineer, Technical, Senior, Technical Engineer, Civil Engineer, Business Development, Technology

  • Senior Engineer

    2 weeks ago


    Norristown, United States HBK Engineering Full time

    Job Description Job Description HBK Engineering is seeking a Licensed Professional Civil Engineer with project management experience. HBK is transforming essential infrastructure to achieve a sustainable future and empower the communities where we live and work. Since first opening our doors in 1998, HBK Engineering has quickly emerged as a leader in the...

  • Engineer - Civil

    2 weeks ago


    Norristown, United States HBK Engineering, LLC Full time

    Job DescriptionJob DescriptionHBK Engineering is seeking Licensed Professional Engineers with project management experience, who have an interest in working in the energy and telecommunication sectors. HBK is transforming essential infrastructure to achieve a sustainable future and empower the communities where we live and work. Since first opening our...

  • Sr. J2EE Developer

    3 weeks ago


    Norristown, United States CareerBuilder Full time

    JPC is looking for an Application Developer that will be responsible for understanding the requirements of the business units and supporting the project and support teams by developing technical systems based on those requirements. In support of that responsibility, the Application Developer will work with the project and support teams, as necessary, to...

  • Senior Engineer

    2 weeks ago


    Norristown, United States HBK Engineering, LLC Full time

    Job DescriptionJob DescriptionHBK Engineering is seeking a Licensed Professional Civil Engineer with project management experience. HBK is transforming essential infrastructure to achieve a sustainable future and empower the communities where we live and work. Since first opening our doors in 1998, HBK Engineering has quickly emerged as a leader in the...

  • Project Engineer

    2 weeks ago


    Norristown, United States HBK Engineering Full time

    Job Description Job Description HBK Engineering is seeking a Licensed Professional Engineer with project management experience. HBK is transforming essential infrastructure to achieve a sustainable future and empower the communities where we live and work. Since first opening our doors in 1998, HBK Engineering has quickly emerged as a leader in the utility...

  • Project Engineer

    2 weeks ago


    Norristown, United States HBK Engineering, LLC Full time

    Job DescriptionJob DescriptionHBK Engineering is seeking a Licensed Professional Engineer with project management experience. HBK is transforming essential infrastructure to achieve a sustainable future and empower the communities where we live and work. Since first opening our doors in 1998, HBK Engineering has quickly emerged as a leader in the utility...


  • Norristown, United States MRO Full time

    MRO Software Engineer Interns partner with an aligned Scrum Team to gain experience in build products leveraged across our organization. MRO is shaping the future of Clinical Data within the healthcare ecosystem. We are looking for interns enthusiastic about solving problems as we continue to drive innovation within the healthcare ecosystem. We are looking...


  • Norristown, United States TriMech Services Full time

    Job DescriptionJob DescriptionRefrigeration EngineerDescription:Refrigeration system focus: spearhead the development and optimization of mechanical refrigeration systems, applying expertise in thermodynamics, heat transfers and fluid dynamics.Must be familiar with different refrigerants, evaporator coil design, condensing coil design, mechanical methods to...

  • Lead Administrator

    7 days ago


    Norristown, United States Wipro Limited Full time

    Overview: **_Role Purpose_** - The purpose of this role is to provide significant technical expertise in architecture planning and design of the concerned tower (platform, database, middleware, backup etc) as well as managing its day-to-day operations _ **_Do_** - **Provide adequate support in architecture planning, migration & installation for new projects...

  • Power System Engineer

    3 weeks ago


    Norristown, United States Synkriom Full time

    Job DescriptionJob Description ***HYBRID**** 2-3 days on site Strong powerflow experience using PSS/E, MUST, TARA or equivalent. Electrical Engineering Degree required 1-3 years experience in planning / powerflow / pss/e and the ability to communicate proficiently Company DescriptionFounded in 2015 and backed by two decades of hands-on experience, our strong...


  • Norristown, United States Montgomery County Pennsylvania Full time

    SUMMARY The Montgomery County Department of Health and Human Services' Office of Mental Health/Developmental Disabilities/Early Intervention (MH/DD/EI) is committed to promoting a vision of wellness, recovery, and resiliency by contracting for services to support the recovery journeys of its residents who experience mental health challenges. The Weekend...

  • Project Manager

    3 weeks ago


    Norristown, United States HBK Engineering, LLC Full time

    Job DescriptionJob DescriptionHBK Engineering is seeking a Project Manager. This position offers the opportunity to lead a project team consisting of engineers, designers, and field personnel involved in the design, modification, analysis, and constructability of new and existing utility systems.HBK is transforming essential infrastructure to achieve a...