Current jobs related to PySpark Data Reconciliation Specialist - Jersey City, New Jersey - Photon

  • PySpark Data Reconciliation Specialist

    2 months ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title: PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data...

  • PySpark Data Reconciliation Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. With over 20 years of experience in powering Digital Experiences for the Fortune 500, we are now looking for a talented individual to help us drive innovation and growth.About UsPhoton has a rich history of...

  • Data Reconciliation Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    Data Reconciliation EngineerWe're seeking a skilled Data Reconciliation Engineer to drive the development of robust data reconciliation solutions within our financial systems. As a key member of our team, you will be responsible for designing, implementing, and maintaining PySpark-based applications to perform complex data reconciliations, identify and...

  • Pyspark Data Reconciliation Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    We are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon.About UsPhoton has been a leading provider of Digital Experiences for the Fortune 500 for over 20 years. Our team of 4000+ members across the globe is dedicated to Digital Modernization.Key ResponsibilitiesThe successful candidate will have:12+...

  • Data Reconciliation Specialist

    3 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. The ideal candidate will have a strong understanding of data reconciliation principles, techniques, and best practices.Key Responsibilities:Design, develop, and test PySpark-based applications to automate data...

  • Data Reconciliation Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are Photon, a leading Digital Platform Engineering company that combines strategy consulting, creative design, and technology services to deliver innovative solutions to our clients.As a high-growth organization serving over 40% of Fortune 100 companies, we believe that our people are the key to making a difference for our clients and our...

  • Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data EngineerPhotonFull-time role8 positions availableWe are seeking a skilled PySpark Data Engineer to drive the development of robust data processing and transformation solutions within our data platform at Photon. As a key member of our team, you will be responsible for designing, implementing, and maintaining PySpark-based applications to handle...

  • Java Data Reconciliation Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title:Java Data Reconciliation EngineerJob Summary:We are seeking a skilled Java Data Reconciliation Engineer to drive the development of robust data reconciliation solutions within our financial systems.Key Responsibilities:Design, develop, and test Java-based applications to automate data reconciliation processes across various financial data...

  • Senior Data Engineering Specialist

    3 weeks ago

    Jersey City, New Jersey, United States Saxon Global Full time

    Key Responsibilities:As a Senior Data Engineering Specialist at Saxon Global, you will be responsible for designing and implementing large-scale data engineering solutions on Azure. With 10+ years of experience in data engineering, you will lead the development of data and analytics platforms focused on Azure data and analytics solutions. Your expertise in...

  • Java Data Reconciliation Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title: Java Data Reconciliation EngineerSummary:We're seeking a skilled Java Data Reconciliation Engineer to drive the development of robust data reconciliation solutions within our financial systems. You will be responsible for designing, implementing, and maintaining Java-based applications to perform complex data reconciliations, identify and resolve...

  • Senior Python Developer with PySpark Experience

    3 weeks ago

    Jersey City, New Jersey, United States Synechron Full time

    Job Title: Senior Python Developer with PySpark ExperienceAbout the Role:We are seeking an experienced Python developer with a strong background in PySpark to join our data engineering team. The ideal candidate will have a robust understanding of big data processing, experience with Apache Spark, and a proven track record in Python programming.Key...

  • Senior Python Developer with PySpark Experience

    2 weeks ago

    Jersey City, New Jersey, United States Synechron Full time

    We are seeking an experienced Python developer with a strong background in PySpark to join our data engineering team at Synechron.Key Responsibilities:Design, build, and maintain scalable and efficient data processing pipelines using PySpark.Develop high-performance algorithms, predictive models, and proof-of-concept prototypes.Work closely with data...

  • Senior Java Data Reconciliation Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title:Data Reconciliation Engineer - Java ExpertJob Summary:We're seeking a skilled Data Reconciliation Engineer - Java Expert to drive the development of robust data reconciliation solutions within our financial systems. The ideal candidate possesses strong Java development skills, experience with data reconciliation techniques, and the ability to...

  • Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    We are seeking a skilled Data Engineer to join our team at Photon, a leading Digital Platform Engineering company. The ideal candidate will have strong experience in big data development, preferably with exposure to data-intensive applications.Key Responsibilities:Data Engineering Development:Design, develop, and test PySpark-based applications to process,...

  • Data Scientist

    2 weeks ago

    Jersey City, New Jersey, United States FIRST SOFTSOLUTIONS INC Full time

    Job Title: Data ScientistAbout the Role:We are seeking a highly skilled Data Scientist to join our team at FIRST SOFTSOLUTIONS INC. As a Data Scientist, you will be responsible for designing and developing backend APIs using Pyspark and Python based API frameworks. You will also be working with AWS and implementing robust database connections and...

  • Senior Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Syntricate Technologies Full time

    Job Title: Senior Data Engineer - AWS Migration ExpertAt Syntricate Technologies, we are seeking a highly skilled Senior Data Engineer to lead our AWS migration project. The ideal candidate will have extensive experience in designing and implementing data pipelines using Python and PySpark, as well as a strong understanding of AWS services.**Key...

  • Senior Data Engineering Lead

    3 weeks ago

    Jersey City, New Jersey, United States Diverse Lynx Full time

    Job Summary:Azure Databricks - Build Data Pipelines using ADB, leveraging Python and Spark. Develop Data Transformation in ADB. Convert Scala programs to PySpark programs. Understand the Scala program in Databricks. Key Responsibilities: Azure Data Lake Gen 2 Synapse Analytics (dedicated SQL pool) Experience in Delta Lake PySparkNice to Have: Tidal Scheduler...

  • Data Analyst/Python Specialist

    3 weeks ago

    Jersey City, New Jersey, United States Genesis Corp dba Genesis10 Full time

    Genesis10 is seeking a skilled IT Business Analyst to join our client in the financial industry, located in Jersey City, NJ and Plano, TX.This is a 12+ month contract position that requires expertise in data sourcing, global risk analytics, and data science.Responsibilities:Develop analytics to support risk modeling activities across all lines of...

  • Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States FIRST SOFTSOLUTIONS INC Full time

    Job Title: Data Engineer - Backend API DeveloperWe are seeking a highly skilled Data Engineer to join our team at FIRST SOFTSOLUTIONS INC.Key Responsibilities:* Design and develop scalable backend APIs using Python and Pyspark* Implement robust database connections and transform data between the application and the database* Collaborate with cross-functional...

  • Cloud Data Architect

    4 weeks ago

    Jersey City, New Jersey, United States CyberTec Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at CyberTec. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data architecture, data models, data pipelines, and standards for various Data Integration & Data Lake and Data Warehouse projects in the AWS Cloud.Key...

PySpark Data Reconciliation Specialist

2 months ago

Jersey City, New Jersey, United States Photon Full time
Job Title: PySpark Data Reconciliation Engineer

We're seeking a skilled PySpark Data Reconciliation Engineer to drive the development of robust data reconciliation solutions within our financial systems.

Key Responsibilities:

  • Design, develop, and test PySpark-based applications to automate data reconciliation processes across various financial data sources.
  • Implement efficient data transformation, matching algorithms using PySpark and relevant big data frameworks.
  • Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.

Data Analysis and Matching:

  • Collaborate with business analysts and data architects to understand data requirements and matching criteria.
  • Analyze and interpret data structures, formats, and relationships to implement effective data matching algorithms using PySpark.
  • Work with distributed datasets in Spark, ensuring optimal performance for large-scale data reconciliation.

Rules Engine Integration:

  • Integrate PySpark applications with rules engines or equivalent to implement and execute complex data matching rules.
  • Develop PySpark code to interact with the rules engine, manage rule execution, and handle rule-based decision-making.

Problem Solving and Gap Analysis:

  • Collaborate with cross-functional teams to identify and analyze data gaps and inconsistencies between systems.
  • Design and develop PySpark-based solutions to address data integration challenges and ensure data quality.
  • Contribute to the development of data governance and quality frameworks within the organization.

Requirements:

  • Bachelor's degree in Computer Science or a related field.
  • 5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
  • Strong understanding of data reconciliation principles, techniques, and best practices.
  • Proficiency in PySpark, Apache Spark, and related big data technologies for data processing and integration.
  • Experience with rules engine integration and development.
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
  • Excellent communication and collaboration skills to work effectively with business analysts, data architects, and other team members.