Data Engineer Lead

3 weeks ago


Basking Ridge, United States Diverse Lynx Full time
Title Data Engineer Lead (Bigdata Production support) Rate Duration 9+ month Location Baskin, NJ (Day 1 onsite) - Pls share candidate consent of day 1 onsite. Mandatory Skills Provide on-call support between 5 PM and 9 PM EST. No of Open Positions 1
Job Description :
Responsibilities:
  • Monitor production jobs for P1 system (Data Management and Reporting DMR).
  • Debug and restart in the event of production failures.
  • Acknowledge, respond and resolve production issues.
  • Understand change requests / enhancements requests.
  • Design and developed data loading strategies.
  • Build, develop, testing shared components that will be used across modules.
  • Extract source data files, stage, transform and load into EERA system ( PostGres SQL)
  • Ingest data from Mainframe system using Kafka and load into EERA.
  • Extract source data files, stage, transform and load into BDS system (Hive based)
  • Use Apache Spark for large data processing integrated with functional programming language Sca la
  • Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email.
  • On call support during weekend
  • Handshake with offshore team on daily / need basis.
Mandatory Skills:
  • Scala, Spark, Hadoop, Kafka
  • Postgres SQL
  • Hive
  • Airflow (or Control M / Oozie)
  • Kubernetes (or equivalent containerization tool)
  • Agile
  • Strong architecture, design & coding skills
  • Experience in production operations and support
  • Experience in distributed databases

Nice to have skills
Java as some of the UI applications are built in Java. Resource should know Java fundamentals.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Data Engineer

    13 hours ago


    Basking Ridge, United States Insight Global Full time

    Must be able to go onsite 2x/week in Basking Ridge, NJ6 month contract + extensionsJob Requirements:Bachelor’s or higher degree in Computer Science or a related discipline5+ years’ experience in Informatica Developer using disparate data sources such as flat files, databases, xml files and/or unstructured data & web services.5 + years’ experience with...

  • Data Engineer

    9 hours ago


    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 120 years of scientific expertise and a...


  • Basking Ridge, United States Stefanini Full time

    Job Description Job Description Reference #56943 Stefanini Group is looking for a Geospatial Data Engineer (Remote) **** for a globally recognized company! For interested applicants, click the apply button or you may reach out Micah Andres at (248) 386 -7399/Micah.Andres@Stefanini.com for faster processing. Thank you! Position Overview: We are seeking an...


  • Basking Ridge, United States Saxon Global Full time

    JOB SUMMARY The Data Governance Engineer supports all organization-wide data governance activities and will be responsible for deploying key Data Governance processes that pertain to the sourcing, management, development and consumption of data assets across the enterprise. The position will focus on establishing and ensuring adherence to an enterprise...


  • Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...


  • Oak Ridge, United States Oak Ridge National Laboratory Full time

    Requisition Id 11429 Overview: The Cyber and Applied Data Analytics division in the National Security Sciences Directorate at Oak Ridge National Laboratory (ORNL) is seeking a senior scientist to lead a world-class applied research and development group. The Data and Software Engineering Group includes data scientists and software engineers carrying out...

  • Test Lead

    4 days ago


    Basking Ridge, United States Cognizant Full time

    **Cognizant Technology Solutions** is looking for “**Test Lead**" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you! **About Cognizant’s QEA Practice**: We are the largest Quality...


  • Basking Ridge, United States Regeneron Pharmaceuticals Full time

    We envision a future where innovative digital biomarker endpoints accelerate the translation of Regeneron’s breakthrough discoveries to novel treatments that enhance patient lives. As a Digital Biomarker Lead reporting to Head of Digital Health Technologies you will be play a pivotal role in developing and incorporating digital biomarkers within clinical...

  • Test Lead

    3 days ago


    Basking Ridge, United States Cognizant Full time

    Cognizant Technology Solutions is looking for “Test Lead" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you! About Cognizant’s QEA Practice:We are the largest Quality Assurance Practice...


  • Basking Ridge, New Jersey, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and CountingCompany is committed to diversity and inclusion. We are an equal opportunity employer including veterans and people with disabilities.Summary The Manager External Data Management, is accountable for an end-to-end delivery of External data in Daiichi Sankyo R&D collaborating with Clinical and Medical teams,...


  • Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Company is committed to diversity and inclusion. We are an equal opportunity employer including veterans and people with disabilities.Summary The Manager External Data Management, is accountable for an end-to-end delivery of External data in Daiichi Sankyo R&D collaborating with Clinical and Medical teams,...


  • Basking Ridge, United States Daiichi Sankyo Full time

    Job Description Join a Legacy of Innovation 110 Years and Counting! Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific...

  • Test Lead

    4 days ago


    Basking Ridge, New Jersey, United States Cognizant Full time

    Cognizant Technology Solutions is looking for "Test Lead" to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you About Cognizant's QEA Practice:We are the largest Quality Assurance Practice...


  • Basking Ridge, United States Daiichi Sankyo Inc. Full time

    **Join a Legacy of Innovation 110 Years and Counting!** Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...


  • Basking Ridge, United States BioSpace Full time

    Job DetailsJoin a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise...


  • Basking Ridge, United States Spencer Ogden Full time

    Summary The Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After Market...


  • Basking Ridge, New Jersey, United States Spencer Ogden Full time

    SummaryThe Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After Market...


  • Basking Ridge, United States Spencer Ogden Full time

      Summary The Senior Electrical Engineer I&C will provide Instrumentation and Controls (I&C) and Electrical engineering supports to proposal and contract project operation across Boiler, Selective Catalytic Reduction System (SCR), Air Quality Control Systems (AQCS), Wastewater Spray Dryer (WSD), Flue Gas Desulfurization Systems (FGD), Turbine and After...


  • Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • Clinical Study Lead

    5 days ago


    Basking Ridge, United States Shiftcode Analytics, Inc Full time

    CLINICAL STUDY LEAD 6 MONTHS CONTRACT BASKING RIDGE, NJ / TARRYTOWN, NY HYBIRD (3 DAYS/WEEK) VISA- NO CPT/H1B The Temp Senior Clinical Study Lead (CSL) Clinical Experimental Sciences Operations (CES Ops) is accountable for the execution of assigned clinical studies/research collaborations from study design, through execution, to study close out....