Sr. (Lead) Data Engineer I (II)

1 week ago


Norristown, United States PJM Interconnection Full time
Flexible Work Arrangement - Hybrid

The Sr. (Lead) Data Engineer is responsible for designing and implementing methods to improve data: reliability, security and quality across the enterprise. They combine raw information from different sources to create consistent and machine-readable formats. They also develop, test and build algorithms, architectures and infrastructure that enable data extraction and transformation for various modeling needs for example predictive or prescriptive modeling. Other functions can include organizing large datasets.

Essential Functions:
  • Analyze and organize raw data, cataloging fields and entities
  • Building data architectures, and data pipelines to collectively bring together data
  • Analyzing, planning, and defining data architecture framework(s), including security, reference data, metadata, and master data
  • Participation in analyzing business needs and objectives with analysts, data Architects and engineers, developers, report writers and report consumers
  • Inform and support the organizations data strategy
  • Conduct complex data analysis and collaboration with analysts, developers and
  • Prepare data for prescriptive and predictive modeling
  • Build algorithms and prototypes to support data integration and other data related functions
  • Identify opportunities for data acquisition and determine data update velocity
  • Collaborating with other teams within the organization to devise and implement data strategies, build models, and assess customers needs and goals
  • Work with Data Architects in developing and supporting patterns that data engineers, developers and others can follow
  • Support and inform data governance practices
  • Creating and implementing data management processes and procedure
Characteristics & Qualifications:
Required:
  • BS degree in Computer Engineering, Information Systems, Statistics, Informatics or at least 5 years of experience Data Engineer or Architect role
  • At least 5 years of experience Strong knowledge of SQL
  • Experience with data pipeline and workflow management tools
  • Experience in Azure data engineering and cloud data processing services
  • Knowledge of Programming e.g. SAS, Python, PySpark, R, Oracle PL/ SQL
  • Experience in one or more of the following: C, C++, Java, Python, Go, Perl or Ruby.
  • Experience with algorithms, data structures, complexity analysis and software design.
  • Experience with managing database infrastructure (particular emphasis on Oracle and Sql Server)
  • Experience with configuration management tools like Puppet, Chef
  • Experience with Unix, AIX, Debian, Windows operating systems, containers, container orchestrators
  • Experience with git based code repositories.
  • Experience using and administering JEE application servers including JBoss, WebSphere, or WebLogic
Preferred:
  • MS degree in Computer Science, Information Systems, Statistics or Informatics
  • At least 5 years of work experience
  • Experience with SAS development tools and datasets (e.g. SAS Grid, SAS Display manager, SAS Studio )
  • Hands on experience in Data Warehousing and ETL tools
  • Experience in Big Data technologies (e.g. Spark, Databricks,) Experience building and optimizing 'big data' data pipelines, architectures, and data sets
  • Performance/security-oriented data design, including partitions, different types of indexes, views, and most effective data management practices.
  • Experience with Azure Synapse Analytics, Azure DevOps
  • Experience with Purview, PowerBI, Alteryx, Qlik, or Tableau Experience with NoSQL
  • Experience with PJM operations, markets, and planning functions


  • Norristown, United States PJM Search Full time

    Flexible Work Arrangement - Hybrid. The Sr. (Lead) Analyst/ Engineer will support the Day Ahead Market Operations Department mission by operating and supporting the Day Ahead and Real Time Energy Market. Essential Functions:Ability to understand the Engineer, Analyst, Operations, Technology, Support

  • (Sr.) Engineer I

    1 month ago


    Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: Hybrid The transmission planning department is responsible for the development of transmission expansion plan in the PJM interconnection. The (Sr.) Engineer will be working closely and collaboratively with a group of highly skilled team that performs transmission expansion analysis supporting the development of the Regional...

  • (Sr.) Engineer I

    1 week ago


    Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: Hybrid The transmission planning department is responsible for the development of transmission expansion plan in the PJM interconnection. The (Sr.) Engineer will be working closely and collaboratively with a group of highly skilled team that performs transmission expansion analysis supporting the development of the Regional...


  • Norristown, United States PJM Interconnection Full time

    Flexible Work Arrangement - Hybrid The Sr. (Lead) Process Engineering Analyst is responsible for collaborating with business units in ITS and its business partners to understand how current processes are functioning, identify improvements, develop new, and lead implementation of processes. The Lead Process Engineering Analyst will also be responsible for...


  • Norristown, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • (Sr.) Engineer I

    4 weeks ago


    Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: HybridThis position offers the unique opportunity to join a diverse and successful team of PJM engineers and business analysts to support the PJM Generation Interconnection process that is driven by system generation needs, including state renewable integration policies, through the evaluation of generation interconnection...

  • (Sr.) Engineer I

    3 weeks ago


    Norristown, United States PJM Inc Full time

    Flexible Work Arrangements: HybridThis position offers the unique opportunity to join a diverse and successful team of PJM engineers and business analysts to support the PJM Generation Interconnection process that is driven by system generation needs, including state renewable integration policies, through the evaluation of generation interconnection...

  • (Sr.) Engineer I

    2 weeks ago


    Norristown, United States PJM Interconnection Full time

    Flexible Work Arrangements: Hybrid This position offers the unique opportunity to join a diverse and successful team of PJM engineers and business analysts to support the PJM Generation Interconnection process that is driven by system generation needs, including state renewable integration policies, through the evaluation of generation interconnection...

  • (Sr.) Engineer I

    4 weeks ago


    Norristown, United States PJM Search Full time

    Flexible Work Arrangements: Hybrid. This position offers the unique opportunity to join a diverse and successful team of PJM engineers and business analysts to support the PJM Generation Interconnection process that is driven by system generation nee Engineer, Technical Support, Transmission, Business Analyst, Operations, Power


  • NORRISTOWN, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, United States PJM Search Full time

    Flexible Work Arrangement: Hybrid. The Resource Adequacy Planning Department is primarily responsible for the reliable, economic, and coordinated operation of the PJM Interconnection in accordance with PJM Planning principles and standards, and the a Engineer, Analyst, Technical Support, Operations, Liability, Reliability, Technology


  • Norristown, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, PA, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Norristown, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Analyst I

    1 week ago


    Norristown, United States PJM Interconnection Full time

    Flexible Work Arrangement: Hybrid The Analyst will work directly with the Sr. Manager of Market Design to support the development of significant market design enhancements across all of PJM's markets. Support the Market Design team with responsibility for supporting such market design enhancements in the stakeholder process and before the Federal Energy...


  • Norristown, United States PJM Inc Full time

    Flexible work arrangement: Hybrid In this role as a member of PJM's Risk Underwriting Team, you will be accountable for the credit and liquidity risk management of an increasing portfolio of counterparts engaged in the PJM markets. Individuals in this role perform analytical modeling to assess and minimize PJM's exposure to credit risk, perform counterparty...

  • Sr. Software Engineer

    2 weeks ago


    Norristown, United States Hiring Now! Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, were making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...