Data Engineering Lead

2 weeks ago

Warrendale, United States Fullsight Full time
JOB SUMMARY

We are seeking a Data Engineering Lead to spearhead the agile development of our data platform, which is crucial for our company's digital transformation. This role involves leading the data engineering team, administering Databricks environments, crafting and executing ETL processes through a Medallion architecture, and ensuring the seamless integration of data into our Neo4j knowledge graph. The Data Engineering Lead will play a pivotal role in our data-driven initiatives reporting to the Senior Data Manager and working closely with the Data Analytics Lead.

ESSENTIAL FUNCTIONS

  • Data Platform Development: Build and maintain a robust data platform, ensuring timely access to high-quality data.
  • Pipeline Construction: Architect and uphold data pipelines from various sources, including internal databases and SaaS applications.
  • Code Excellence: Write clean, efficient, and maintainable code. Embrace and implement the DataOps philosophy to promote operational excellence in data management.
  • System Expansion: Strategically plan and implement system enhancements to support business growth and analytical demands.
  • Best Practices: Champion data engineering best practices, focusing on improving data quality, efficiency, and value.
  • Code Standards: Elevate and enforce coding standards, focusing on maintainability and performance. Guide the team in creating merge requests and managing issues effectively.
  • Independent Delivery: Lead by example, delivering medium to large features independently and fostering a culture of accountability and innovation within the team.
MINIMUM REQUIREMENTS
  • Experience: At least 6 years of hands-on experience in deploying production-quality code, with a strong preference for experience in Python, Java, or Scala for data processing (Python preferred).
  • Technical Proficiency: Advanced knowledge of data-related Python packages and a profound understanding of SQL and Databricks.
  • Graph Database Expertise: Solid grasp of Cypher and experience with graph databases like Neo4j.
  • ETL/ELT Knowledge: Proven track record in implementing ETL (or ELT) best practices at scale and familiarity with data pipeline tools.
PREFERRED QUALIFICATIONS
  • Professional experience using Python, Java, or Scala for data processing (Python preferred)
WORKING CONDITIONS AND PHYSICAL REQUIREMENTS
  • Ability to work for long periods at a computer/desk
  • Standard office environment


ABOUT THE ORGANIZATION

Fullsight is an integrated brand of our three primary affiliate companies - SAE Industry Technologies Consortia, SAE International and Performance Review Institute - and their subsidiaries. As a collective, Fullsight enables a robust resource of innovative programs, products and services for industries, their engineers and technical experts to work together on traditional and emergent complex issues that drive their future progress.

SAE IndustryTechnologies Consortia® (SAE ITC)enables organizations to define and pilot best practices. SAE ITC industry stakeholders are able to work together to effectively solve common problems, achieve mutual benefit for industry, and create business value.

The Performance Review Institute® (PRI)is the world leader in facilitating collaborative supply chain oversight programs, quality management systems approvals, and professional development in industries where safety and quality are shared values.

SAE International® (SAEI)is a global organization serving the mobility sector, predominantly in the aerospace, automotive and commercial-vehicle industries, fostering innovation, and enabling engineering professionals. Since 1905, SAE has harnessed the collective wisdom of engineers around the world to create industry-enabling standards. Likewise, SAE members have advanced their knowledge and understanding of mobility engineering through our information resources, professional development, and networking.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)

  • Principal Hardware Engineer

    2 weeks ago

    Warrendale, United States Westinghouse Electric Company Full time

    Reference #: 17945 Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the...

  • Data Analyst

    2 weeks ago

    Warrendale, United States beBee S US Full time

    ​​ Retail Decision Technology – Partnering Art & AI to Build a Better World About First Insight 💡 First Insight is the global leader in Voice of the Customer/AI retail solutions, transforming concept to conversion decision-making and business performance through actionable consumer insights and AI. Our platform enables retailers and brands to...

  • Data Analyst

    7 days ago

    Warrendale, United States First Insight, Inc. Full time

    Retail Decision Technology – Partnering Art & AI to Build a Better WorldAbout First Insight 💡First Insight is the global leader in Voice of the Customer/AI retail solutions, transforming concept to conversion decision-making and business performance through actionable consumer insights and AI. Our platform enables retailers and brands to boost revenues...

  • Data Analyst

    1 month ago

    Warrendale, United States First Insight, Inc. Full time

    Retail Decision Technology – Partnering Art & AI to Build a Better WorldAbout First Insight First Insight is the global leader in Voice of the Customer/AI retail solutions, transforming concept to conversion decision-making and business performance through actionable consumer insights and AI. Our platform enables retailers and brands to boost revenues and...

  • Data Analyst

    2 months ago

    Warrendale, United States First Insight, Inc. Full time

    Retail Decision Technology – Partnering Art & AI to Build a Better WorldAbout First Insight 💡First Insight is the global leader in Voice of the Customer/AI retail solutions, transforming concept to conversion decision-making and business performance through actionable consumer insights and AI. Our platform enables retailers and brands to boost revenues...

  • Director of Sales and Marketing

    3 weeks ago

    Warrendale, United States ADP - Automatic Data Processing, Inc Full time

    Basic InformationJob Category: Sales Location: Warrendale, Pennsylvania, United States Date published: 15-Apr-2024 Job type: Full Time Description and RequirementsAbout the role We are actively seeking a Director of Sales and Marketing to join the team. Reports to: Managing Director of Americas & Asia Hours/Schedule: Full-time, Monday to Friday (Must be...

  • Director of Sales and Marketing

    4 weeks ago

    Warrendale, United States ADP - Automatic Data Processing, Inc Full time

    Basic InformationJob Category: Sales Location: Warrendale, Pennsylvania, United States Date published: 15-Apr-2024 Job type: Full Time Description and RequirementsAbout the role We are actively seeking a Director of Sales and Marketing to join the team. Reports to: Managing Director of Americas & Asia Hours/Schedule: Full-time, Monday to Friday (Must be...

  • Process Engineer

    2 months ago

    Warrendale, United States System One Full time

    Provide design, calculations, and other activities related to process engineering. Requirements: Process Flow Diagrams, equipment specifications, data sheets, Piping and Instrumentation Diagrams (P&IDs). Perform/review material and energy balances, tank and vessel sizing, drain and vent sizing, heat loss, pipe pressure loss, pump and compressor...

  • Process Engineer

    1 month ago

    Warrendale, United States System One Holdings, LLC Full time

    Provide design, calculations, and other activities related to process engineering.Requirements: Process Flow Diagrams, equipment specifications, data sheets, Piping and Instrumentation Diagrams (P&IDs). Perform/review material and energy balances, tank and vessel sizing, drain and vent sizing, heat loss, pipe pressure loss, pump and compressor sizing....

  • Hardware Engineer

    1 week ago

    Warrendale, United States Westinghouse Electric Company Full time

    ***WTSS Contract to Hire Opportunity*** Are you interested in being part of an innovative team that supports reputable organizations across multiple industries? At WECTEC Staffing Services, a wholly owned subsidiary of Westinghouse Electric Company LLC, we recognize that our employees are our most valuable asset, and we seek to identify, attract and recruit...

  • Process Engineer

    5 days ago

    Warrendale, United States System One Full time

    Provide design, calculations, and other activities related to process engineering. Requirements: Process Flow Diagrams, equipment specifications, data sheets, Piping and Instrumentation Diagrams (P&IDs). Perform/review material and energy balances, tank and ves...

  • Principal Test Engineer

    1 month ago

    Warrendale, United States CareerBuilder Full time

    Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace....

  • Process Engineer

    1 month ago

    warrendale, United States System One Full time

    Provide design, calculations, and other activities related to process engineering.Requirements:Process Flow Diagrams, equipment specifications, data sheets, Piping and Instrumentation Diagrams (P&IDs).Perform/review material and energy balances, tank and ves...

  • Hardware Engineer

    2 weeks ago

    Warrendale, Pennsylvania, United States Westinghouse Electric Co Full time

    ***WTSS Contract to Hire Opportunity***Are you interested in being part of an innovative team that supports reputable organizations across multiple industries? At WECTEC Staffing Services, a wholly owned subsidiary of Westinghouse Electric Company LLC, we recognize that our employees are our most valuable asset, and we seek to identify, attract and recruit...

  • Principal Hardware Engineer

    6 days ago

    Warrendale, United States Westinghouse Electric Company Full time

    Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace....

  • Senior Electrical Engineer

    4 weeks ago

    Warrendale, United States Westinghouse Electric Company Full time

    Reference #: 16662 Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the...

  • Product Engineer

    7 days ago

    Warrendale, United States Aegion Full time

    Product Engineer, Quality Assurance Pittsburgh PA, Hybrid Underground Solutions, Inc. ("UGSI"), an Aegion Company, has an opening for a Product Engineer to support our PVC fusion and pipe technologies. Underground Solutions, Inc. is one of the most dynamic and fastest growing companies in the water infrastructure and electrical conduit market with a...

  • Senior Hardware Engineer

    6 days ago

    Warrendale, United States Komatsu Full time

    Komatsu is an indispensable partner to the construction, mining, forestry, forklift, and industrial machinery markets, maximizing value for customers through innovative solutions. With a diverse line of products supported by our advanced IoT technologies, regional distribution channels, and a global service network, we tap into the power of data and...

  • Senior Electrical Engineer

    2 weeks ago

    Warrendale, United States Westinghouse Electric Company Full time

    Westinghouse Electric Company Senior Electrical Engineer Warrendale , Pennsylvania Apply Now Reference #: 16662Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit...

  • Staff Engineer

    2 days ago

    Warrendale, United States Fullsight Full time

    THE ESSENTIAL FUNCTIONS OF THE POSITION INCLUDE, BUT ARE NOT LIMITED TO THE FOLLOWING: Conduct audit reviews (achieve & maintain delegation) with strict confidentiality and compliance with procedural and regulatory requirements Task Group Support: Manage/assist supporting a Task Group Facilitate Task Group meetings and lead Task Group projects Facilitate...