Data Engineer
3 weeks ago
The Data Engineer participates in the design and build of modern data products that comprise of raw data stores (data lakes) and cleansed data repositories, populated by batch or streaming data pipelines. The Data Engineer works with a team to create a robust, sustainable and flexible design and leads the technical delivery using Agile delivery frameworks like Scrum or Kanban.
Responsibilities
- Developing and managing data processes to ensure that data is available and usable
- Creation and automation of data pipelines and platforms
- Managing and monitoring data quality via automated testing frameworks (Data Driven Testing, TDD, etc.)
- Working closely with Architects, Data Scientists, and DevOps to design, build, test, deliver, and maintain sustainable and highly scalable data solutions
- Researching data acquisition and evaluating suitability
- Integration of data management solutions into client environment
- Actively managing risks to data and ensuring there is a data recovery plan
- Building data repositories such as: data warehouses, data lakes, and operational data stores, etc.
- 4+ years relevant professional work experience
- Experience and expertise in the following:
- Creating robust and extensible data pipelines for production systems
- Prefer 2 years experience working with Azure Data Factory
- Experience with Azure Data Lake
- Creating secure, performant, and well-modeled data stores
- Common analytical platform architectural patterns (Star Schema, data integration patterns, ABAC, data quality frameworks etc.)
- Data lake design patterns and technology options (schema on read, metadata capture, search framework)
- Use of scripting languages, preferably Python
- Familiarity with NoSQL databases
- Source code version control management using git
- Project experience using the Scrum or Kanban framework.
- Professionalism; to include written and oral communication - the ability to communicate collaboratively in front of a whiteboard. An ability to understand your audience and adjust your communication style to fit
- Aptitude and desire for learning new technologies.
- Technically savvy, entrepreneurial spirit who thrives in environments that reward self-initiative and resourcefulness.
-
ML Engineer
21 hours ago
Muhlenberg Twp, United States Penske Truck Leasing Full timePosition Summary: As the Machine Learning Engineer working in Penske’s Advanced Analytics team, you will be in a high impact role. You will be supporting multiple businesses and functions within Penske with their data science initiatives. You will play a key role in maturing the AI/ML Ops at Penske organization. This is a great opportunity for someone who...
-
Solutions Engineer II- Process Automation
2 weeks ago
Lawrence Park Twp, United States Process and Data Automation LLC Full timePROCESS AND DATA AUTOMATION LLC Solutions Engineer II- Process Automation / $75K-$91K per year / ERIE, PA Must Haves: Education:Bachelors Degree Why Us: Job Description: Job Summary/Objective/Role The Solutions Specialist Level 2 will be responsible for analyzing the needs of users and assisting project managers in the development of high-level custom...
-
Global Data Governance Analytics Manager
2 weeks ago
Cranberry Twp, United States PPG Industries Full timeGlobal Data Governance Analytics Manager - JR2413591 DESCRIPTION/RESPONSIBILITIES: As Global Data Governance Analytics Manager , you are responsible for Master Data integrity and adherence to governance standards. This role requires closely working with end-users, business units, and other resources in all stages of daily MDM operations with a strong focus...
-
Global Data Conversion Specialist
2 weeks ago
Cranberry Twp, United States PPG Industries Full timeGlobal Data Conversion Specialist - JR2416612, JR2416611, JR2416608 & JR2416610 DESCRIPTION/RESPONSIBILITIES: As a Global Data Conversion Specialist , and as part of the Connect PPG program you will work with: * Business process owners * Site data experts * Global process owners * IT data conversion experts in coordinating data conversion, cleansing and...
-
Global Data Conversion Specialist
2 days ago
Cranberry Twp, United States PPG Industries Full timeGlobal Data Conversion Specialist - JR2416612, JR2416611, JR2416608 & JR2416610 DESCRIPTION/RESPONSIBILITIES: As a Global Data Conversion Specialist , and as part of the Connect PPG program you will work with: * Business process owners * Site data experts * Global process owners * IT data conversion experts in coordinating data conversion, cleansing and...
-
Principal Automation Engineer
5 days ago
Branchburg Twp, United States Eli Lilly Full timeAt Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...
-
Principal Automation Engineer
1 day ago
Branchburg Twp, United States Eli Lilly Full timeAt Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...
-
Lawrence Twp, United States WSP Full timeThis Opportunity WSP is currently seeking a Geotechnical/Pavement Engineer to join our Morristown, NJ office. The position will provide geotechnical and pavement engineering support to technical staff, engineers, and project managers for design, and construction of infrastructure projects and systems in the public and private sector. Tasks may include basic...
-
Extrusion Process Engineer
1 week ago
Cranberry Twp, United States Kawneer Company, Inc. Full timeJob DescriptionArconic is currently in search of an Extrusion Process Engineer to join our Kawneer - Building and Construction Systems business in Cranberry Township, PA. At Arconic, we are looking for people who share our values of integrity, inclusion, and diversity, and who demonstrate agility, results commitment, and the capability to grow themselves and...
-
Field Engineer
4 weeks ago
Branchburg Twp, United States Ferreira Construction Co Inc Full timeFerreira Construction is a first-rate civil construction company built on a foundation of integrity. We have experience and expertise in all facets of civil construction: Underground Utilities (Gas, Water, Sewer, Fiber Optic, Electrical), Foundations, Bridges, Highways, Airports, Sitework; Power/Utility: Substations, Power Plants, Transmission &...
-
R&D Test Engineer Internship
2 weeks ago
Lawrence Twp, United States Datacolor Full timeDatacolor, a global leader in color management solutions, provides software, instruments and services to improve the precision, performance and efficiency of your color workflow. For over five decades, Datacolor has earned our reputation as a trusted leader by delivering unmatched capabilities that rapidly address the full spectrum of color challenges in...
-
R&D Test Engineer Internship
1 day ago
Lawrence Twp, United States Datacolor Full timeDatacolor, a global leader in color management solutions, provides software, instruments and services to improve the precision, performance and efficiency of your color workflow. For over five decades, Datacolor has earned our reputation as a trusted leader by delivering unmatched capabilities that rapidly address the full spectrum of color challenges in...
-
Software & Automation Engineer
2 weeks ago
Cranberry Twp, United States Westinghouse Electric Company Full timeReference #: 14767 Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the...
-
Software & Automation Engineer
2 days ago
Cranberry Twp, United States Westinghouse Electric Company Full timeReference #: 14767 Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the...
-
Senior Data Scientist
19 hours ago
Clinton Twp, United States Agoda Full timeAbout Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees representing 90+ nationalities foster a work environment rich in diversity,...
-
Co-Op: Verification Engineering
3 days ago
Cranberry Twp, United States MSA - The Safety Company Full timeOverview For more than 100 years, our passionate mission of safety empowers us to protect lives. MSA Safety is a global leader in the development of safety equipment and pioneering technology that helps protect people and facility infrastructures around the world. We are committed to providing the latest in innovative, best-in class safety solutions that...
-
Co-Op: Verification Engineering
2 days ago
Cranberry Twp, United States MSA - The Safety Company Full timeOverview For more than 100 years, our passionate mission of safety empowers us to protect lives. MSA Safety is a global leader in the development of safety equipment and pioneering technology that helps protect people and facility infrastructures around the world. We are committed to providing the latest in innovative, best-in class safety solutions that...
-
Engineering - Equipment Engineer
1 week ago
Stafford Twp, United States TechDigital Corporation Full time100% onsite PURPOSE AND SCOPE OF POSITION: The LSM Equipment Engineer supports the successful operation of laboratory and clinical manufacturing operations at their home sites through interaction with internal team members and internal customers, and external service providers. The incumbent conducts tasks assigned by the management independently or with...
-
Engineering - Equipment Engineer
1 week ago
Stafford Twp, United States HonorVet Technologies Full timeJob Description: 100% onsite PURPOSE AND SCOPE OF POSITION: The LSM Equipment Engineer supports the successful operation of laboratory and clinical manufacturing operations at their home sites through interaction with internal team members and internal customers, and external service providers. The incumbent conducts tasks assigned by the management...
-
Quality Process Engineer
2 weeks ago
Branchburg Twp, United States Air Liquide Full timeThe science of electronics is transforming exponentially through innovation and connectivity around the planet. Every day, breakthroughs are making technologies - from micro-processors, memory chips and flat panels to photovoltaic cells - even smaller and more powerful, opening up countless new possibilities in how the world lives, works and connects. Air...