Data Engineer

4 weeks ago

Blue Bell, United States PMA Companies Full time
Back Data Engineer #4399 Multiple Locations Apply Apply for this job now Apply Job Description:

We are seeking a Data Engineer to join our IT department. This role will focus on leveraging Databricks, Azure Data Factory and related tool sets to enhance our systems integration capabilities within the commercial insurance domain. The ideal candidate will have strong technical problem-solving skills, a deep understanding of Databricks, and a strong understanding of data.

Data Pipeline Development:

    • Design, develop, and maintain scalable data pipelines using Databricks.
    • Ensure data quality, integrity, and consistency across all data pipelines.

Data Integration:

    • Integrate data from multiple sources, including Azure Data Lake, SQL databases, and any APIs.
    • Leveraging Databricks to integrate with different Large and Small Language Models.
    • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

ETL Processes:

    • Develop and maintain ETL (Extract, Transform, Load) processes using Azure Databricks.
    • Implement Data Quality and Audit, Balance and Control to the data workflows.
    • Maintain and optimize data workflow performance.

Collaboration and Communication:

    • Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.
    • Provide technical support and guidance to team members and stakeholders.

Performance Optimization:

    • Optimize data processing performance on Azure Databricks.
    • Implement best practices for data storage, processing, and retrieval.
  • Security and Compliance:
    • Ensure data security and compliance with industry standards and regulations.
    • Implement data governance policies and procedures.
  • Documentation and Reporting:
    • Document data engineering processes, workflows, and best practices.
    • Generate reports and dashboards to provide insights into data pipeline performance and data quality.
  • Continuous Improvement:
    • Stay updated with the latest industry trends and technologies in data engineering and Azure Databricks.
    • Identify opportunities for process improvements and implement best practices
    • Demonstrate commitment to Company's Code of Business Conduct and Ethics, and apply knowledge of compliance policies and procedures, standards and laws applicable to job responsibilities in the performance of work.

Requirements:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer with a focus on Azure Databricks.
  • Strong knowledge of Azure Databricks and its ecosystem.
  • Experience with data pipeline and workflow management tools.
  • Proficiency in programming languages such as PySpark, Python, Scala, or SQL.
  • Familiarity with big data technologies (e.g., Spark).
  • Experience with Azure services such as Azure Data Lake, Azure SQL Database, and analytics capabilities available in Azure.
  • Knowledge of data warehousing concepts and best practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced, dynamic environment.

  • Data Engineer Position

    1 week ago

    Blue Bell, Pennsylvania, United States PMA Companies Full time

    PMA Companies is seeking an experienced Data Engineer to join our IT department. The ideal candidate will have strong technical problem-solving skills and a deep understanding of Azure Databricks.The role focuses on leveraging Databricks, Azure Data Factory, and related tool sets to enhance our systems integration capabilities within the commercial insurance...

  • Commercial Insurance Data Expert

    1 week ago

    Blue Bell, Pennsylvania, United States PMA Companies Full time

    This role requires a skilled Data Engineer with expertise in designing, developing, and maintaining scalable data pipelines using Azure Databricks. The ideal candidate will have strong technical problem-solving skills, a deep understanding of Databricks, and experience working with data pipeline and workflow management tools.Job Responsibilities:Design,...

  • Data Systems Architect

    3 weeks ago

    Blue Bell, Pennsylvania, United States PMA Companies Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at PMA Companies. This role will focus on designing, developing, and maintaining scalable data pipelines using Azure Databricks.

  • Electrical Commissioning Engineer

    1 month ago

    Blue Bell, United States IPS-Integrated Project Services, LLC Full time

    Reference #: 8970 Job Description At IPS, we apply our knowledge, skills, and passion to make a difference in the lives of people, solving complex challenges related to life sciences. We are looking for a dedicated Electrical Commissioning Engineer to join our talented Mission Critical Data Center Team. The Data Center Electrical Commissioning Engineer...

  • SCADA Engineer

    1 week ago

    Blue Bell, Pennsylvania, United States JSAT AUTOMATION INC Full time

    **Job Description:** We are seeking a highly skilled SCADA Engineer to join our team at JSAT AUTOMATION INC. As a SCADA Engineer, you will be responsible for designing, developing, and implementing SCADA systems to meet the needs of our clients.The ideal candidate will have a strong background in automation control systems, experience with selecting,...

  • Electrical Commissioning Engineer

    6 days ago

    Blue Bell, United States IPS-Integrated Project Services, LLC Full time

    Job Description At IPS, we apply our knowledge, skills, and passion to make a difference in the lives of people, solving complex challenges related to life sciences. We are looking for a dedicated Electrical Commissioning Engineer to join our talented Mission Critical Data Center Team. The Data Center Electrical Commissioning Engineer plays a critical role...

  • Structural Engineer, Dams

    3 days ago

    Blue Bell, United States Ramboll US Corporation Full time

    Company Description STRUCTURAL ENGINEER - DAMS & WATERFRONT We invite you to bring your energy, experience, and professionalism into play as you contribute to innovative and high-quality design solutions. To succeed in this role, you must have structural engineering experience in dams and appurtenant hydraulic structures, waterfront structures, or heavy...

  • Structural Engineer, Dams

    4 days ago

    Blue Bell, United States Ramboll Full time

    Company DescriptionSTRUCTURAL ENGINEER - DAMS & WATERFRONT We invite you to bring your energy, experience, and professionalism into play as you contribute to innovative and high-quality design solutions. To succeed in this role, you must have structural engineering experience in dams and appurtenant hydraulic structures, waterfront structures, or heavy civil...

  • Data Catalog Engineer

    1 month ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    Data Catalog EngineerLeadStack Inc., a certified minority-owned staffing services provider, seeks a highly skilled Data Catalog Engineer to contribute to the development and maintenance of its data catalog platform.Key Responsibilities:Configure and customize the data catalog platform to accurately represent the organization's data landscape.Implement and...

  • MES Automation Engineer

    2 days ago

    Blue Bell, United States JSat Automation Inc Full time

    Job Description Job Title: MES Automation Engineer. Job Description: We are looking for MES Automation Engineer, to provide engineering and technical support for manufacturing execution systems and digital systems in the Bio-pharmaceutical Operations facility. Evaluate and develop technology, plan and implement modifications, troubleshoot and support...

  • Validation Engineer

    2 days ago

    Blue Bell, United States IPS-Integrated Project Services, LLC Full time

    Reference #: 8770 Job Description At IPS, we apply our knowledge, skills, and passion to make a difference in the lives of people, solving complex challenges related to life sciences. We are looking for a dedicated Validation Engineer to join our talented team at our office located in Blue Bell, PA. In this role, you will perform cGMP compliance-based...

  • Senior Process Engineer

    2 days ago

    Blue Bell, United States IPS-Integrated Project Services, LLC Full time

    Job Description At IPS, you will apply your knowledge, skills, and passion to make a difference in the lives of people by solving complex challenges related to pharmaceutical, biotech, and animal health research and manufacturing facilities. We are looking for a dedicated Senior Process Engineer to join our talented team at our office located in Vaughan,...

  • RF Engineer Intern

    7 hours ago

    Blue Bell, United States KGPCo Full time

    RF Engineer InternJob Locations US-PA-Blue BellRequisition ID 2025-2730Category (Portal Searching) EngineeringJob Post Information* : Posted Date 2 hours ago(1/3/2025 10:34 AM)Company OverviewCircet USA is the leading provider of Network Services in North America, and we're looking for talented professionals to join our team. We specialize in engineering...

  • Early-Career Environmental Engineer or Scientist

    1 month ago

    Blue Bell, United States CV Library Full time

    Overview:Do you want to build an impactful career to change the world for the better? Geosyntec has an exciting opportunity for an Early-Career Environmental Engineer or Scientist as part of our contaminated site assessment and remediation practice in our Blue Bell, PA, Pennington or Lyndhurst, NJ office.  The position will have the opportunity to apply...

  • Assistant Vice President, Geotechnical Engineer

    1 week ago

    Blue Bell, United States WSP Full time

    Our Business We are a global leader in environmental consulting - made stronger with the recent acquisition of Wood’s Environment & Infrastructure business and Golder - with world-class expertise in environmental, social and governance (ESG), climate resiliency & sustainability (CRS), and earth sciences. Combined we have over 20,000 multidisciplinary...

  • Process Engineer II

    2 days ago

    Blue Bell, United States IPS-Integrated Project Services, LLC Full time

    Job Description At IPS, we apply our knowledge, skills, and passion to make a difference in the lives of people, solving complex challenges related to life sciences. We are looking for a dedicated Process Engineer II to join our talented team at our office located in Vaughan, Ontario, or Vancouver, British Colombia. In this role, you will assist and support...

  • Senior Software Engineer, Customer Enablement

    5 hours ago

    Blue Bell, United States CVS Health Full time

    Bring your heart to CVS Health. Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced human-centric health care for a rapidly changing world. Anchored in our brand — with heart at its center — our purpose sends a personal message that how we...

  • MES Automation Engineer

    2 days ago

    Blue Bell, United States JSat Automation Inc Full time

    Job Description: We are looking for MES Automation Engineer, to provide engineering and technical support for manufacturing execution systems and digital systems in the Bio-pharmaceutical Operations facility. Evaluate and develop technology, plan and implement modifications, troubleshoot and support manufacturing execution systems and other digital solutions...

  • Data Engineer Level 3

    2 weeks ago

    Blue Ash, United States Aditi Consulting Full time

    Payrate: $75 - $80/hr. Summary: As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a...

  • SCADA - Ignition Support Engineer

    1 week ago

    Blue Bell, United States JSat Automation Inc Full time

    About JSat Automation At JSat Automation we believe that by providing our customers with the resources they need to overcome obstacles in their quest for scientific discovery and change, we can more broadly improve the daily lives of everyone in our world. It is our mission to provide our clients with a strategic, efficient cost-effective approach to...