Lead Data Engineer with PySpark

2 weeks ago

Mt Laurel, NJ, United States Infinity Outsourcing Full time

About the job Lead Data Engineer with PySpark

Requisition Title :Lead Data Engineer with PySpark ( 1 Day Onsite)

Locations Mt Laurel, NJ & Charlotte, NC

Visa Status: GC/USC/H4 EAD

Client : TD Bank

Duration: Full Time /C2H

Salary pay rate to candidates : $49-$56/hr W2

Experience : 12+ Years

Primary Tech skills = Pyspark, Databricks (Hands-on experience mandatory)

Secondary Tech skills = Azure, SAS, Synapse, Databricks

MUST HAVE SKILLS :

  • Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.
  • Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.
  • Ability to drive more than one project in parallel.
  • Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
  • Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling
  • Hands-on experience in Pyspark is a must.
  • Experience working with structured and unstructured data.
  • Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
  • Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
  • Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
  • Experience with Orchestration tools and GitHub
  • Experience to own end-to-end development, including coding, testing, debugging and deployment.
  • Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill
  • Need to be an individual performer as well as a Lead.

  • Azure Data Engineer

    1 week ago

    Mt Laurel, NJ, United States Diverse Lynx Full time

    Role Description: Core Engineering 8 years in data engineering with strong hands-on in Apache Spark (Databricks) and Python (PySpark).Production experience with Kafka (Confluent), Snowflake, SQL Server, and Azure SynapseAzure SQL.Hands-on experience on Azure Cosmos DB is mandatory.Azure Ecosystem Practical knowledge of Azure Databricks, Azure Data Factory,...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Big Data Engineer

    2 weeks ago

    Mt Laurel, NJ, United States Princeton IT Services, Inc Full time

    Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data...

  • Information Technology_USA

    2 weeks ago

    Mt Laurel, NJ, United States SysMind Tech Full time

    **Please strictly adpersone to the following resume naming convention: ALL CAPS, NO SPACES B/T UNDERSCORES PTN_US_GBAMSREQID_CandidateBeelineID i.e. PTN_US_9999999_SKIPJOHNSON0413 MSP Owner: Amy Johnson Location: MOUNT LAUREL, NJ Duration: 6 months GBaMS ReqID:10493527 Role Description: Core Engineering 8 years in data engineering with strong hands-on in...

  • ETL QA

    2 weeks ago

    Mt Laurel, NJ, United States HMG America LLC Full time

    HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for ETL QA in Mount Laurel NJ. Below is the detailed job description. Title: ETL QA Location: Mount Laurel NJ (Onsite)...