Data Engineer

1 week ago

philadelphia, United States PSI (Proteam Solutions) Full time

Job Description:

Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data solutions using modern cloud technologies and best practices.

Essential functions and responsibilities

  • Design and implement end-to-end ETL pipelines using Databricks and Azure Synapse Analytics
  • Develop and maintain data workflows using Scala in Databricks environment
  • Create and optimize data models for analytical and operational use cases
  • Collaborate with cross-functional teams using Azure DevOps for project management and version control
  • Write clean, maintainable code following team standards and best practices
  • Participate in code reviews and technical design discussions
  • Implement and maintain CI/CD pipelines in Azure DevOps
  • Work independently while contributing effectively to team objectives
  • Break down and execute on User Stories within sprint cycles
  • Provide production support on a rotating basis, including occasional non-business hours

Required Skills:

  • 5+ years of hands-on experience with Databricks, including ETL pipeline development
  • 3+ years of experience with Azure Synapse Analytics and Azure cloud services
  • Demonstrated experience working in Azure DevOps environment
  • Strong understanding of data modeling and data warehouse concepts
  • Experience working with Agile methodologies and executing User Stories
  • Proven track record of successful team collaboration on data engineering projects
  • Excellent problem-solving and analytical skills
  • Strong verbal and written communication abilities

Required Experience:

  • Bachelor’s Degree in computer science, Information Technology, or related fields
  • 3+ years of experience developing data/database systems and integrating with third-party solutions.
  • 3+ years of Extract, Transform and Load (ETL) experience
  • 2+ years of experience architecting data/database solutions and designing the integration with third party solutions.
  • 3+ years of experience working in a hybrid agile development methodology

Preferred Experience

  • Experience with Python and/or R programming
  • Familiarity with AI/ML workflows in Databricks
  • Experience with Delta Lake and Spark optimization
  • Knowledge of data governance and security best practices
  • Experience with Scala
  • Cloud certifications (Azure Data Engineer, Databricks, etc.)

  • Data Engineer

    2 weeks ago

    Philadelphia, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract to permanent employment opportunity for a Data Engineer in Philadelphia, Pennsylvania. As a Data Engineer, you will work in the healthcare industry, focusing on designing, developing, and delivering data solutions to support enterprise analytics. This role involves a strong emphasis on SQL and data...

  • Data Engineer

    3 weeks ago

    Philadelphia, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract to permanent employment opportunity for a Data Engineer in Philadelphia, Pennsylvania. As a Data Engineer, you will work in the healthcare industry, focusing on designing, developing, and delivering data solutions to support enterprise analytics. This role involves a strong emphasis on SQL and data...

  • Data Engineer

    4 weeks ago

    Philadelphia, United States VySystems Full time

    Job Description:We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position...

  • Project Manager

    4 weeks ago

    Philadelphia, Pennsylvania, United States Data Intelligence, LLC Full time

    Job Title: Project ManagerData Intelligence, LLC is seeking a highly skilled Project Manager to support our government clients in Philadelphia, PA. This is a full-time position that may be remote.Job Responsibilities:Develop and execute project plans to ensure timely completion of tasksAssess resource requirements and estimate costsCreate project schedules...

  • Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Mondo Full time

    Job OverviewMondo is seeking a highly skilled Data Engineer to join our experienced data engineering team. As a key contributor, you will design and develop enterprise-level applications using Snowflake and AWS tools.Key ResponsibilitiesDesign and develop scalable data applications using Snowflake and AWS tools.Take ownership of new data connection...

  • Data Engineer

    1 week ago

    Philadelphia, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Data Engineer

    1 day ago

    philadelphia, United States PSI (Proteam Solutions) Full time

    Job Description:Position summary: We are seeking a mid-level Data Engineer with strong expertise in Databricks and Azure technologies. The ideal candidate will be responsible for designing, implementing, and maintaining robust data pipelines, while collaborating effectively within an Agile team environment. This role focuses on delivering scalable data...

  • Senior Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States ARCADIS Full time

    Role OverviewAs a Senior Data Engineer at Arcadis, you will play a key role in designing and developing data solutions that drive business value. You will work closely with cross-functional teams to deliver high-quality data migration and integration projects, leveraging your expertise in data architecture, data modeling, and data engineering.Key...

  • Data Engineer, Services

    3 weeks ago

    Philadelphia, Pennsylvania, United States Penn Interactive Full time

    About the RolePenn Interactive is seeking a highly skilled Data Engineer to join our team. As a key member of our Data Engineering team, you will collaborate with Data Science, Reporting, Analytics, and other engineering teams to build data pipelines, infrastructure, and tooling to support business initiatives.You will oversee the design and maintenance of...

  • Data Analytics Engineer

    4 weeks ago

    Philadelphia, Pennsylvania, United States Generis Tek Inc Full time

    Job Title: Data Analytics EngineerWe are seeking a highly skilled Data Analytics Engineer to join our team at Generis Tek Inc. As a Data Analytics Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and analytics solutions.Key Responsibilities:Design and develop data architectures and analytics solutions...

  • Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    About Us:We're a financial technology company dedicated to creating inclusive financial products that help our members improve their financial futures. Our mission is to build simple and accessible financial solutions that promote healthy financial habits and economic stability.Our Products:We've developed innovative products like Perpay Marketplace,...

  • Senior Data Engineer, Data Lake

    5 months ago

    Philadelphia, United States PENN Interactive Full time

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersive interactive gaming experience that is responsible, innovative, and fun. We...

  • Data Engineering Lead

    3 weeks ago

    Philadelphia, Pennsylvania, United States Pronix Inc Full time

    Job Title: AWS Data EngineerLocation: PADuration: 12 MonthsResponsibilitiesExperience - 10+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to...

  • Senior Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Diverse Lynx Full time

    Job Title: Senior Data EngineerLocation: Onsite role from Day 1Duration: Full Time/PermanentJob Description: We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. The ideal candidate will have a strong background in data engineering, with experience in designing and implementing large-scale data pipelines using Scala,...

  • Data Engineer

    2 weeks ago

    Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    About the RoleWe are seeking a talented Junior Data Engineer to join our team at Perpay. As a key member of our data engineering team, you will be responsible for building and maintaining our data pipelines and architectures, supporting our data products and insights.With the launch of our credit card, the need for effective data engineering resources has...

  • Senior Data Engineer

    3 weeks ago

    philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsResponsibilitiesExperience - 10+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to...

  • Senior Data Engineer

    3 weeks ago

    philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsResponsibilitiesExperience - 10+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to...

  • Data Engineering Manager

    4 weeks ago

    Philadelphia, Pennsylvania, United States Publicis Health Media Full time

    Job Title: Data Engineering ManagerPublicis Health Media is seeking a highly skilled Data Engineering Manager to join our Technology and Data Department. As a key member of our team, you will be responsible for overseeing the processing and maintenance of all data that flows into our organization.Key Responsibilities:Lead a portfolio of data projects across...

  • Frontend React Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of skilled engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud, data, and applications.Job DescriptionWe are seeking a Software Engineer / Frontend React Engineer to design, develop, test, and deploy software solutions for customer-facing web apps. The ideal candidate will have...

  • Data Systems Engineer

    4 weeks ago

    Philadelphia, Pennsylvania, United States System Soft Technologies Full time

    Big Data EngineerSystem Soft Technologies is seeking a highly skilled Big Data Engineer to join our team.Job Summary:We are looking for a talented Big Data Engineer to design, develop, and support database applications for data systems. The ideal candidate will have experience with Linux shell scripts and Python for batch processing, as well as design...