Lead Data Engineer with PySpark

6 days ago

Mt Laurel, NJ, United States Infinity Outsourcing Full time

About the job Lead Data Engineer with PySpark

Requisition Title :Lead Data Engineer with PySpark ( 1 Day Onsite)

Locations Mt Laurel, NJ & Charlotte, NC

Visa Status: GC/USC/H4 EAD

Client : TD Bank

Duration: Full Time /C2H

Salary pay rate to candidates : $49-$56/hr W2

Experience : 12+ Years

Primary Tech skills = Pyspark, Databricks (Hands-on experience mandatory)

Secondary Tech skills = Azure, SAS, Synapse, Databricks

MUST HAVE SKILLS :

  • Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.
  • Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.
  • Ability to drive more than one project in parallel.
  • Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
  • Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling
  • Hands-on experience in Pyspark is a must.
  • Experience working with structured and unstructured data.
  • Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
  • Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
  • Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
  • Experience with Orchestration tools and GitHub
  • Experience to own end-to-end development, including coding, testing, debugging and deployment.
  • Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill
  • Need to be an individual performer as well as a Lead.

  • Azure Data Engineer

    1 week ago

    Mt Laurel, NJ, United States Diverse Lynx Full time

    Role Description: Core Engineering 8 years in data engineering with strong hands-on in Apache Spark (Databricks) and Python (PySpark).Production experience with Kafka (Confluent), Snowflake, SQL Server, and Azure SynapseAzure SQL.Hands-on experience on Azure Cosmos DB is mandatory.Azure Ecosystem Practical knowledge of Azure Databricks, Azure Data Factory,...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Information Technology_USA

    2 weeks ago

    Mt Laurel, NJ, United States SysMind Tech Full time

    **Please strictly adpersone to the following resume naming convention: ALL CAPS, NO SPACES B/T UNDERSCORES PTN_US_GBAMSREQID_CandidateBeelineID i.e. PTN_US_9999999_SKIPJOHNSON0413 MSP Owner: Amy Johnson Location: MOUNT LAUREL, NJ Duration: 6 months GBaMS ReqID:10493527 Role Description: Core Engineering 8 years in data engineering with strong hands-on in...

  • Information Technology_USA

    2 weeks ago

    Mt Laurel, NJ, United States SysMind Tech Full time

    **Please strictly adpersone to the following resume naming convention: ALL CAPS, NO SPACES B/T UNDERSCORES PTN_US_GBAMSREQID_CandidateBeelineID i.e. PTN_US_9999999_SKIPJOHNSON0413 MSP Owner: Amy Johnson Location: MOUNT LAUREL, NJ Duration: 6 months GBaMS ReqID:10493527 Role Description: Core Engineering 8 years in data engineering with strong hands-on in...