Data Engineer Lead
3 weeks ago
Job Description :
Responsibilities:
- Monitor production jobs for P1 system (Data Management and Reporting DMR).
- Debug and restart in the event of production failures.
- Acknowledge, respond and resolve production issues.
- Understand change requests / enhancements requests.
- Design and developed data loading strategies.
- Build, develop, testing shared components that will be used across modules.
- Extract source data files, stage, transform and load into EERA system ( PostGres SQL)
- Ingest data from Mainframe system using Kafka and load into EERA.
- Extract source data files, stage, transform and load into BDS system (Hive based)
- Use Apache Spark for large data processing integrated with functional programming language Sca la
- Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email.
- On call support during weekend
- Handshake with offshore team on daily / need basis.
- Scala, Spark, Hadoop, Kafka
- Postgres SQL
- Hive
- Airflow (or Control M / Oozie)
- Kubernetes (or equivalent containerization tool)
- Agile
- Strong architecture, design & coding skills
- Experience in production operations and support
- Experience in distributed databases
Nice to have skills
Java as some of the UI applications are built in Java. Resource should know Java fundamentals.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
-
Data Engineer
13 hours ago
Basking Ridge, United States Insight Global Full timeMust be able to go onsite 2x/week in Basking Ridge, NJ6 month contract + extensionsJob Requirements:Bachelor’s or higher degree in Computer Science or a related discipline5+ years’ experience in Informatica Developer using disparate data sources such as flat files, databases, xml files and/or unstructured data & web services.5 + years’ experience with...
-
Data Engineer
9 hours ago
Basking Ridge, United States Daiichi Sankyo Full timeJoin a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 120 years of scientific expertise and a...
-
Geospatial Data Engineer Remote
1 week ago
Basking Ridge, United States Stefanini Full timeJob Description Job Description Reference #56943 Stefanini Group is looking for a Geospatial Data Engineer (Remote) **** for a globally recognized company! For interested applicants, click the apply button or you may reach out Micah Andres at (248) 386 -7399/Micah.Andres@Stefanini.com for faster processing. Thank you! Position Overview: We are seeking an...
-
Informatica Data Governance Engineer
2 days ago
Basking Ridge, United States Saxon Global Full timeJOB SUMMARY The Data Governance Engineer supports all organization-wide data governance activities and will be responsible for deploying key Data Governance processes that pertain to the sourcing, management, development and consumption of data assets across the enterprise. The position will focus on establishing and ensuring adherence to an enterprise...
-
Data Operations Engineer
5 hours ago
Basking Ridge, United States Daiichi Sankyo Full timeJoin a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...
-
Data and Software Engineering Group Lead
2 days ago
Oak Ridge, United States Oak Ridge National Laboratory Full timeRequisition Id 11429 Overview: The Cyber and Applied Data Analytics division in the National Security Sciences Directorate at Oak Ridge National Laboratory (ORNL) is seeking a senior scientist to lead a world-class applied research and development group. The Data and Software Engineering Group includes data scientists and software engineers carrying out...
-
Test Lead
4 days ago
Basking Ridge, United States Cognizant Full time**Cognizant Technology Solutions** is looking for “**Test Lead**" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you! **About Cognizant’s QEA Practice**: We are the largest Quality...
-
Director, Digital Biomarker Lead
9 hours ago
Basking Ridge, United States Regeneron Pharmaceuticals Full timeWe envision a future where innovative digital biomarker endpoints accelerate the translation of Regeneron’s breakthrough discoveries to novel treatments that enhance patient lives. As a Digital Biomarker Lead reporting to Head of Digital Health Technologies you will be play a pivotal role in developing and incorporating digital biomarkers within clinical...
-
Test Lead
3 days ago
Basking Ridge, United States Cognizant Full timeCognizant Technology Solutions is looking for “Test Lead" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you! About Cognizant’s QEA Practice:We are the largest Quality Assurance Practice...
-
Manager, External Data Management
1 day ago
Basking Ridge, New Jersey, United States Daiichi Sankyo Full timeJoin a Legacy of Innovation 110 Years and CountingCompany is committed to diversity and inclusion. We are an equal opportunity employer including veterans and people with disabilities.Summary The Manager External Data Management, is accountable for an end-to-end delivery of External data in Daiichi Sankyo R&D collaborating with Clinical and Medical teams,...
-
Manager, External Data Management
2 hours ago
Basking Ridge, United States Daiichi Sankyo Full timeJoin a Legacy of Innovation 110 Years and Counting!Company is committed to diversity and inclusion. We are an equal opportunity employer including veterans and people with disabilities.Summary The Manager External Data Management, is accountable for an end-to-end delivery of External data in Daiichi Sankyo R&D collaborating with Clinical and Medical teams,...
-
Associate Director, Data Management
19 hours ago
Basking Ridge, United States Daiichi Sankyo Full timeJob Description Join a Legacy of Innovation 110 Years and Counting! Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific...
-
Test Lead
4 days ago
Basking Ridge, New Jersey, United States Cognizant Full timeCognizant Technology Solutions is looking for "Test Lead" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you About Cognizant's QEA Practice:We are the largest Quality Assurance Practice...
-
Associate Director, Data Management
20 hours ago
Basking Ridge, United States Daiichi Sankyo Inc. Full time**Join a Legacy of Innovation 110 Years and Counting!** Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...
-
Associate Director, Data Management
1 day ago
Basking Ridge, United States BioSpace Full timeJob DetailsJoin a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise...
-
I/C Elecrical Engineer
1 month ago
Basking Ridge, United States Spencer Ogden Full timeSummary The Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After Market...
-
I/C Elecrical Engineer
1 month ago
Basking Ridge, New Jersey, United States Spencer Ogden Full timeSummaryThe Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After Market...
-
I/C Elecrical Engineer
1 month ago
Basking Ridge, United States Spencer Ogden Full timeSummary The Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After...
-
Manager, Data Governance Stewardship
7 hours ago
Basking Ridge, United States Daiichi Sankyo Full timeJoin a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...
-
Clinical Study Lead
5 days ago
Basking Ridge, United States Shiftcode Analytics, Inc Full timeCLINICAL STUDY LEAD 6 MONTHS CONTRACT BASKING RIDGE, NJ / TARRYTOWN, NY HYBIRD (3 DAYS/WEEK) VISA- NO CPT/H1B The Temp Senior Clinical Study Lead (CSL) Clinical Experimental Sciences Operations (CES Ops) is accountable for the execution of assigned clinical studies/research collaborations from study design, through execution, to study close out....