See more Collapse

Data Engineer Lead

2 months ago

Basking Ridge, United States Diverse Lynx Full time
Title Data Engineer Lead (Bigdata Production support) Rate Duration 9+ month Location Baskin, NJ (Day 1 onsite) - Pls share candidate consent of day 1 onsite. Mandatory Skills Provide on-call support between 5 PM and 9 PM EST. No of Open Positions 1
Job Description :
Responsibilities:
  • Monitor production jobs for P1 system (Data Management and Reporting DMR).
  • Debug and restart in the event of production failures.
  • Acknowledge, respond and resolve production issues.
  • Understand change requests / enhancements requests.
  • Design and developed data loading strategies.
  • Build, develop, testing shared components that will be used across modules.
  • Extract source data files, stage, transform and load into EERA system ( PostGres SQL)
  • Ingest data from Mainframe system using Kafka and load into EERA.
  • Extract source data files, stage, transform and load into BDS system (Hive based)
  • Use Apache Spark for large data processing integrated with functional programming language Sca la
  • Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email.
  • On call support during weekend
  • Handshake with offshore team on daily / need basis.
Mandatory Skills:
  • Scala, Spark, Hadoop, Kafka
  • Postgres SQL
  • Hive
  • Airflow (or Control M / Oozie)
  • Kubernetes (or equivalent containerization tool)
  • Agile
  • Strong architecture, design & coding skills
  • Experience in production operations and support
  • Experience in distributed databases

Nice to have skills
Java as some of the UI applications are built in Java. Resource should know Java fundamentals.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

We have other current jobs related to this field that you can find below

  • Data Engineer

    3 weeks ago

    Basking Ridge, New Jersey, United States Daiichi Sankyo Full time

    Exciting Opportunity as a Data Engineer at Daiichi Sankyo GroupDaiichi Sankyo Group, with over a century of experience in the pharmaceutical industry, is committed to delivering innovative therapies to enhance healthcare standards globally. Operating in more than 20 countries with a team of 16,000 employees worldwide, we strive to leverage cutting-edge...

  • Data Engineer

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 120 years of scientific expertise and a...

  • Informatica Data Governance Engineer

    2 months ago

    Basking Ridge, United States Saxon Global Full time

    JOB SUMMARY The Data Governance Engineer supports all organization-wide data governance activities and will be responsible for deploying key Data Governance processes that pertain to the sourcing, management, development and consumption of data assets across the enterprise. The position will focus on establishing and ensuring adherence to an enterprise...

  • Manager, External Data Management

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting! Company is committed to diversity and inclusion. We are an equal opportunity employer including veterans and people with disabilities.   Summary The Manager External Data Management, is accountable for an end-to-end delivery of External data in Daiichi Sankyo R&D collaborating with Clinical...

  • SQL Engineer

    2 weeks ago

    Basking Ridge, United States Net2Source Inc. Full time

    Position: SQL EngineerLocation: Basking Ridge, NJ 07920 (twice a week onsite)Duration: 12+ Months (Extendable)Position Notes:1) Accepting H1 Transfer candidates. No C2C.2) Application to position includes completing 1 online technical assessment and 1 onsite assement as part of interview process.3) Considering Candidates local to New Jersey only as the...

  • Manager, Data Governance Stewardship

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • Manager, Data Governance Stewardship

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting! Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • Artificial Intelligence Engineer

    4 weeks ago

    Basking Ridge, United States InfoVision Inc. Full time

    ·Bachelor’s degree or above in Computer Science/Engineering or other related areas.·Four or more years of work experience in computer software development related jobs.·At least two years are in AI / ML Engineering areas with reasonably good understanding of Data Science and AIML practices/workflows.·Strong expertise in RTML model serving arena and/or...

  • Manager, Data Programming

    4 weeks ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting! Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • Manager, Clinical Data Management

    4 hours ago

    Basking Ridge, New Jersey, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and CountingDaiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a presence...

  • Manager, Clinical Data Management

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • NAM-IQE-ECS-Technical Test Lead

    1 month ago

    Basking Ridge, New Jersey, United States Infosys Limited Full time

    Infosys is seeking a Technical Test Lead with Automation Testing experience,In the role of Technical Test Lead - Automation, you will act as an expert and single point of contact for creating test cases, test plans, Monitoring, Analysis, reporting and troubleshooting. You will conduct required tests, create reports and plan, design and lead execution to...

  • Senior Software Engineer

    1 month ago

    Basking Ridge, United States Optum Full time

    Job DescriptionOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and...

  • Early Asset Lead, Global Clinical Science

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • QA Automation Engineer

    6 days ago

    Basking Ridge, United States Tekgence Inc Full time

    We are looking for Strong QA Automation engineer who Develop and Build the Automation test scrips not someone who executed it.Strong exp in Selenium , Python & Cypress is Must.Qualifications:Proven experience in automation testing using Java, Selenium, Cypress, and Cucumber.Strong understanding of BDD principles and frameworks.Strong experience in Python...

  • Senior Software Engineer-Large Scale Data Management

    2 months ago

    Oak Ridge, United States ITR Full time

    Job DescriptionJob DescriptionSenior Software Engineer, Large-Scale Data ManagementOverview:East Tennessee company is seeking a senior software engineer focused on large-scale data management and storage. Position can be remote and candidates need to be able to obtain a federal security clearance. Company operates several simulation and experimental...

  • Associate Director, Tech Management Lead mAb

    2 months ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...

  • Signal Processing Chief Scientist

    2 months ago

    Basking Ridge, United States International Staff Consulting Full time

    Signal Processing Chief Scientist Red Bank, NJ, Basking Ridge, NJ, Bedford, NH, or Silver Spring, MD Active Secret Clearance required. Algorithm Development Python, Matlab They are more than a research lab; they are an innovation hub. They have an entrepreneurial spirit molding technology of the future. They are involved in cybersecurity, data analytics,...

  • Associate Director, Companion Diagnostics Lead

    2 weeks ago

    Basking Ridge, New Jersey, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and CountingDaiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a presence...

  • Associate Director, Companion Diagnostics Lead

    1 month ago

    Basking Ridge, United States Daiichi Sankyo Full time

    Join a Legacy of Innovation 110 Years and Counting!Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address diversified, unmet medical needs of people globally by leveraging our world-class science and technology. With more than 100 years of scientific expertise and a...