Lead Databricks Data Engineer

3 days ago


Philadelphia, United States US Tech Solutions Full time


Role: Lead Databricks Data Engineer
Location: Philadelphia, PA
Duration: Months

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities:
Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.
Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.
Collaborate with Data Platform Architects and Client Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.
Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.
Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
Implement secure and scalable data capture and ingestion workflows.
Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

Qualifications:
Bachelor’s degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred
+ years of experience in designing and delivering secure cloud solutions.
+ years of experience with Databricks
+ years of experience with Agile Methodology
Strong problem-solving, analytical, and communication skills.

About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit .

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

  • Lead Data Engineer

    11 hours ago


    philadelphia, United States Softcrylic Full time

    Who We Are For more than 20 years, we have been working with organizations large and small to help solve business challenges through technology. We bring a unique combination of engineering and strategy to Make Data Work for organizations. Our clients range from the travel and leisure industry to publishing, retail and banking. The common thread between our...

  • Lead Data Engineer

    7 days ago


    Philadelphia, United States Softcrylic Full time

    Who We Are For more than 20 years, we have been working with organizations large and small to help solve business challenges through technology. We bring a unique combination of engineering and strategy to Make Data Work for organizations. Our clients range from the travel and leisure industry to publishing, retail and banking. The common thread between our...

  • Lead Data Engineer

    3 days ago


    Philadelphia, Pennsylvania, United States Softcrylic Full time

    About the RoleWe are seeking a highly skilled Technical Lead - Data Engineering with a strong background in building and optimizing data pipelines and transformation processes using Azure Databricks, Python, and Spark.The ideal candidate will have the ability to understand and convert Scala programs to PySpark within Databricks and possess hands-on...

  • Lead Data Engineer

    2 days ago


    Philadelphia, Pennsylvania, United States Cadent Full time

    Cadent Powers the Evolution of TV Brand AdvertisingCadent is a leading provider of data-driven solutions for buying and selling TV advertising. Our technology improves efficiencies and boosts the results of linear, addressable, and cross-screen campaigns.We are seeking a self-motivated and talented Lead Data Engineer to join our team responsible for...

  • Databricks Architect

    2 weeks ago


    Philadelphia, United States Hire IT People Full time

    Job Title: Databricks Architect Location: Philadelphia, PA (Onsite) Start: Immediate Duration: Long term Primary Responsibilities: Utilize consulting and technical skills to be able to work in a client-facing project environment independently. Be responsible for your own execution and often others' on client projects, communicating directly with internal...

  • Data Engineer

    24 hours ago


    Philadelphia, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract to permanent employment opportunity for a Data Engineer in Philadelphia, Pennsylvania. As a Data Engineer, you will work in the healthcare industry, focusing on designing, developing, and delivering data solutions to support enterprise analytics. This role involves a strong emphasis on SQL and data...

  • Data Engineering Lead

    4 weeks ago


    Philadelphia, Pennsylvania, United States Avance Consulting Full time

    Job DescriptionAvance Consulting is seeking a highly skilled Technical Lead to join our team.Key Responsibilities:Design and implement data pipelines using Azure Databricks, leveraging Python and Spark.Develop data transformation processes in ADB.Convert Scala programs to PySpark programs.Understand and work with Scala programs in DataBricks.Secondary...


  • Philadelphia, Pennsylvania, United States Publicis Health Media Full time

    Job Title: Associate Director, Data Engineering, Technology and DataAt Publicis Health Media, we're seeking an experienced Associate Director, Data Engineering, Technology and Data to join our team. As a key member of our data engineering team, you will play a critical role in designing and developing big data solutions built on the Databricks and Azure...

  • Senior Data Engineer

    2 weeks ago


    Philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsJob Description:Responsibilities:Experience - 12+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other...

  • Senior Data Engineer

    2 weeks ago


    Philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsJob Description:Responsibilities:Experience - 12+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other...

  • Senior Data Engineer

    2 weeks ago


    philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsJob Description:Responsibilities:Experience - 12+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other...

  • Senior Data Engineer

    12 hours ago


    philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsResponsibilitiesExperience - 10+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to...

  • Senior Data Engineer

    3 hours ago


    philadelphia, United States Pronix Inc Full time

    Job Title: AWS Data Engineer Location: PADuration: 12 MonthsResponsibilitiesExperience - 10+Yrs of Overall IT ExperienceDesign, develop, and optimize data pipelines and workflows using Databricks.Implement and manage Unity Catalog to ensure data governance, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to...

  • Senior Data Engineer

    3 weeks ago


    Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    Job Title: Senior Data EngineerComcast Corporation is seeking a highly skilled Senior Data Engineer to join our team in Philadelphia. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data platforms using Neo4j and other technologies.Key Responsibilities:Design and develop big data ETL pipelines using...

  • Data Engineer

    5 days ago


    Philadelphia, United States VySystems Full time

    Job Description:We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position...

  • Data Engineer

    4 weeks ago


    Philadelphia, United States Codebase Inc Full time

    Job Title : Azure Data Engineer/Purview Developer Location : Philadelphia , PA (Onsite) Job DetailsOverall 8+ years of experience as a software developer or data engineer and 2+ years as Azure Purview Developer.Hands on experience with Microsoft Purview (formerly Azure Information Protection and Microsoft Cloud App Security) Proficient in C#, PowerShell, and...

  • Data Engineer

    2 months ago


    Philadelphia, United States Codebase Inc Full time

    Job Title : Azure Data Engineer/Purview Developer Location : Philadelphia , PA (Onsite) Job DetailsOverall 8+ years of experience as a software developer or data engineer and 2+ years as Azure Purview Developer.Hands on experience with Microsoft Purview (formerly Azure Information Protection and Microsoft Cloud App Security) Proficient in C#, PowerShell, and...

  • Data Engineer

    4 weeks ago


    philadelphia, United States Codebase Inc Full time

    Job Title : Azure Data Engineer/Purview Developer Location : Philadelphia , PA (Onsite) Job DetailsOverall 8+ years of experience as a software developer or data engineer and 2+ years as Azure Purview Developer.Hands on experience with Microsoft Purview (formerly Azure Information Protection and Microsoft Cloud App Security) Proficient in C#, PowerShell, and...


  • Philadelphia, Pennsylvania, United States Comcast Corporation Full time

    Job Title: Senior Data EngineerComcast Corporation is seeking a highly skilled Senior Data Engineer to join our team in Philadelphia. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and applications.Key Responsibilities:Design and develop big data ETLs using Python, Spark, and SQLPresent...


  • Philadelphia, Pennsylvania, United States Avance Consulting Full time

    Job OverviewAvance Consulting is seeking a highly skilled Technical Azure Data Architect to lead our data engineering team. As a key member of our team, you will be responsible for designing and implementing data pipelines using Azure Databricks, leveraging Python and Spark.Key ResponsibilitiesData Engineering Expertise: Min. 10+ years of experience in data...