Lead Data Platform Engineer

3 days ago


Harrisburg, Pennsylvania, United States J&J Family of Companies Full time
Job Title: Lead Data Platform Engineer

We are seeking a highly skilled Lead Data Platform Engineer to join our dynamic team at J&J Family of Companies. As a key member of our data platform team, you will design, build, and maintain scalable data platform technologies that support our AI, machine learning, GenAI, and data science teams' work.

Key Responsibilities:

  • Work as a critical technical leader on our data platform team to design, develop, and operate an end-to-end data platform that drives pharmaceutical research & development across our business.
  • Innovate and shape our platform strategy and innovation with our business to enable new areas of science within our research & development group.
  • Work with Data Product Owners to design, develop, and maintain data pipelines using Snowflake or Databricks, Airflow, DBT, and Streamsets.
  • Collaborate with data product owners, data scientists, analysts, and other partners to understand data requirements and deliver high-quality data platforms and solutions.
  • Implement data integration, transformation, and validation processes to ensure data accuracy and consistency.
  • Optimize data workflows for performance, scalability, and reliability.
  • Monitor and solve data pipeline issues, ensuring timely resolution.

Qualifications:

  • Bachelor's degree, or equivalent experience, in Computer Science, Engineering, or a related field.
  • 3-5 years of experience in data engineering or a similar role.
  • Expertise in Snowflake or Databricks, Airflow, DBT, and Streamsets.
  • Familiarity with agile methodologies, test automation, and DevOps practices.

Experience and Skills:

  • 3-5 years of experience as a Data Engineer with a proven track record of architecting, designing, and building scalable data platforms and data solutions using leading cloud services and next generation technologies.
  • Skilled in using AWS, Azure, GCP, Snowflake, and Databricks to deliver Data Warehouses, sophisticated data analytics pipelines, and Data Visualization and Reporting solutions while working with structured and unstructured datasets at large scale.
  • Experience in fine tuning and optimizing enterprise-grade distributed data solutions for batch processing and streaming processing using open-source services like Apache Spark, Apache Kafka, Spark Streaming, and Apache Airflow.
  • Authority in Data Modeling, Data Migration, Data Cleansing, and ETL Processes, with hands-on experience with a variety of cloud data warehouses (AWS Redshift, Snowflake & BigQuery) and using DBT & Tableau tools along with automating CI/CD pipelines.

Preferred:

  • Experience with machine learning and artificial intelligence solution development.
  • Proficient in Python and SQL programming.
  • Proficiency in test automation and continuous integration/continuous deployment (CI/CD) practices.
  • Experience with DataOps development and automation.
  • Strong understanding of DevOps principles and tools.
  • Experience working in healthcare or a regulated industry.
  • Excellent problem-solving and analytical skills.
  • Experience working in agile software development teams.
  • Effective communication and collaboration skills.

Other:

  • Less than 10%- domestic or international travel.


  • Harrisburg, Pennsylvania, United States Comcast Full time

    Job SummaryComcast is seeking a highly skilled Lead Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing and building scalable data pipelines to support our business needs.Job DescriptionWe are looking for a talented Lead Software Engineer to lead the development of our data platform. The...


  • Harrisburg, Pennsylvania, United States J&J Family of Companies Full time

    We are seeking a talented Senior Data Platform Engineer to lead the design, development, and maintenance of scalable data platform technologies to support our pharmaceutical research & development business.This role involves collaborating with various teams, innovating platform strategy, and implementing data integration processes to ensure accuracy and...

  • Product Owner

    2 weeks ago


    Harrisburg, Pennsylvania, United States Evolent Health Full time

    About Evolent HealthEvolent Health is a healthcare company that partners with health plans and providers to achieve better outcomes for people with complex and costly health conditions. We work across specialties and primary care to connect the pieces of the fragmented healthcare system and ensure people receive the same level of care and compassion we would...

  • Data Engineer

    5 days ago


    Harrisburg, Pennsylvania, United States cyberThink Full time

    Job Description:CyberThink is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and maintaining robust data pipelines that perform well on big data sets.You will work closely with our cross-functional teams to translate data requirements into technical specifications...


  • Harrisburg, Pennsylvania, United States Lincoln Financial Group Full time

    Job SummaryWe are seeking an experienced Senior Platform Reliability Engineer to join our dynamic team, focusing on platform management, Site Reliability Engineering (SRE), observability, and infrastructure architecture. The ideal candidate will have 7+ years of experience across these domains, with a deep understanding of AWS services and best practices.Key...


  • Harrisburg, Pennsylvania, United States Cleveland Brothers Full time

    Data Engineering Internship OpportunityCleveland Brothers, a leading Cat dealer in Pennsylvania, northern West Virginia, and western Maryland, is seeking a highly motivated Data Engineering Intern to join our dynamic data and analytical team.Job SummaryThis internship is a unique opportunity for a career-minded individual to gain hands-on experience in...


  • Harrisburg, Pennsylvania, United States Cleveland Brothers Full time

    Cleveland Brothers, the largest Cat dealer in Pennsylvania, northern West Virginia, and western Maryland, is seeking a highly motivated Data Engineering Intern to join our team at our Murrysville, PA or Harrisburg, PA corporate office.The ideal candidate will work closely with our business analysts, business leaders, and data engineers to create data...


  • Harrisburg, Pennsylvania, United States Lumen Full time

    About LumenLumen is a global technology company that delivers innovative solutions to help businesses, governments, and communities thrive in the digital age. With a vast network of over 450,000 route fiber miles, we provide a secure and reliable platform for applications and data to drive human progress.Our mission is to harness the power of technology to...

  • SAP HR Data Lead

    2 days ago


    Harrisburg, Pennsylvania, United States The Baer Group Full time

    Job Summary Baer is seeking a highly skilled SAP HR Data Lead to lead data migration and implementation projects for SAP Employee Central and S/4 HANA systems. The ideal candidate will have a strong background in data governance, data quality management, and HR processes, with experience in leading cross-functional teams and managing projects. Key...


  • Harrisburg, Pennsylvania, United States Koch Industries Full time

    About the RoleWe are seeking a highly skilled Automation Platform Technician to join our team in Shippensburg, PA. As a key member of our Automation & Robotics Center of Excellence, you will be responsible for maintaining and repairing our Automated Guided Vehicle (AGV) system.Key ResponsibilitiesPerform regular preventive maintenance on AGV platforms to...

  • Big Data Engineer

    4 weeks ago


    Harrisburg, Pennsylvania, United States Stellar Professionals Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Stellar Professionals. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.Key Responsibilities:Develop applications using...

  • Data Engineer

    3 weeks ago


    Harrisburg, Pennsylvania, United States Innova Solutions Full time

    Job Title: Data Engineer - SQL and Power BIInnova Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems using SQL and Power BI.Key Responsibilities:Design and develop data warehouses and data marts using SQL Server and SSISDevelop...


  • Harrisburg, Pennsylvania, United States Eaton Corporation Full time

    About the RoleEaton's ES AMER DIG division is currently seeking a skilled Embedded Platform IoT Architect to join our team. This is a hybrid work schedule position that can be located at one of our Eaton locations: Raleigh NC, Pittsburgh PA (Moon Twp.), or Greater Milwaukee Wisconsin area (Menomonee Falls WI). Relocation assistance is offered for this...


  • Harrisburg, Pennsylvania, United States CVS Health Full time

    Transforming Healthcare with Conversational AICVS Health is seeking a seasoned Conversational AI Delivery Lead to drive the user experience for our Conversational AI platform. As a key member of our Data, Digital, Analytics, Technology (DDAT) organization, you will lead the design and implementation of conversational AI solutions that deliver a seamless user...


  • Harrisburg, Pennsylvania, United States WITF Full time

    Job Title: Data Analytics LeadThe Pennon Organization is seeking a seasoned data analytics professional to lead our data and analytics efforts as our new Data Analytics Lead.This role requires a deep understanding of data analytics and business acumen to help drive strategic decision-making and foster a culture of data-driven insights across the...


  • Harrisburg, Pennsylvania, United States Oracle Full time

    Job DescriptionOracle's Construction and Engineering GBU product development organization is seeking a highly skilled Senior Implementation Engineer to join our team. As a key member of our implementation team, you will be responsible for integrating our TexturaLink platform with clients' ERP systems, ensuring seamless and efficient data...


  • Harrisburg, Pennsylvania, United States Oracle Full time

    Job DescriptionOracle's Construction and Engineering GBU product development organization is seeking a highly skilled Senior Implementation Engineer to join our team. As a key member of our implementation team, you will be responsible for integrating our TexturaLink platform with clients' ERP systems, ensuring seamless and efficient data...


  • Harrisburg, Pennsylvania, United States Comcast Full time

    Job Title: Lead Software EngineerComcast is seeking a highly skilled Lead Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying software applications that meet the needs of our customers.Job SummaryThe Lead Software Engineer will lead a team of software engineers in the...


  • Harrisburg, Pennsylvania, United States Sargent & Lundy Full time

    Job Title: Lead Electrical EngineerThis is a remote position with travel/onsite support at Three Mile Island Nuclear Generating Station.Job Summary:We are seeking a highly experienced Lead Electrical Engineer to lead our team in designing and implementing electrical engineering systems for power plants. The successful candidate will have a strong background...

  • Data Engineer

    3 weeks ago


    Harrisburg, Pennsylvania, United States Innova Solutions Full time

    Software Engineer Position at Innova SolutionsWe are seeking a highly skilled Software Engineer to join our team at Innova Solutions. As a key member of our team, you will be responsible for designing, developing, and implementing software solutions that meet the needs of our clients.Key Responsibilities:Design and develop software applications using a...