Data Engineer

11 hours ago


Jersey City, New Jersey, United States Photon Full time

We are seeking a skilled Data Engineer to join our team at Photon, a leading Digital Platform Engineering company. The ideal candidate will have strong experience in big data development, preferably with exposure to data-intensive applications.

Key Responsibilities:

Data Engineering Development:

Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources, including relational databases, NoSQL databases, batch files, and real-time data streams.

Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.

Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.

Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.

Data Analysis and Transformation:

Collaborate with data analysts, data scientists, and data architects to understand data processing requirements and deliver high-quality data solutions.

Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.

Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.

Data Integration and ETL:

Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.

Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms.

Qualifications and Skills:

Bachelor's degree in Computer Science, Information Technology, or a related field.

5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.

Strong understanding of data processing principles, techniques, and best practices in a big data environment.

Proficiency in PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration.

Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).

Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.

Excellent communication and collaboration skills to work effectively with data analysts, data architects, and other team members.


  • Data Engineer

    4 weeks ago


    Jersey City, New Jersey, United States Purple Fly Solutions Full time

    Job DescriptionRole: Data Onboarding EngineerLocations: Jersey City, NJDuration: FulltimeNote: We are seeking an experienced ETL Developer to onboard data into a Data Lake.Skills: ETL, Data Engineer, Data Lake, HadoopKey Responsibilities:1. Data Extraction: Design and implement data extraction processes from various sources, including relational databases,...

  • Data Engineering Lead

    19 hours ago


    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryRoyal Bank of Canada seeks a highly skilled Data Engineering Lead to support the development and maintenance of scalable data stores. The ideal candidate will have expertise in designing and developing metadata frameworks for ingestion, profiling, anomaly detection, and data repairs. Additionally, they will have experience with designing data...

  • Data Engineering Lead

    3 weeks ago


    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryRoyal Bank of Canada is seeking a highly skilled Data Engineering Lead to join our team in Jersey City, New Jersey. As a key member of our data engineering team, you will be responsible for designing and developing scalable data stores, meta data frameworks, and distributed computing engines to support our business needs.Key ResponsibilitiesDesign...


  • Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering ExpertiseAt Futran Tech Solutions Pvt. Ltd., we're seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our data engineering practice, you will be responsible for developing, modifying, and adopting tools and processes to support self-service data pipeline management. Your expertise will drive the...

  • AWS Data Engineer

    2 days ago


    Jersey City, New Jersey, United States Norconsulting Global Recruitment Full time

    AWS Data Engineer OpportunityWe are seeking a highly skilled AWS Data Engineer to join our team at Norconsulting Global Recruitment. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop scalable and efficient data pipelines using AWS services such as...

  • Senior Data Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job OpportunityTiger Analytics, a leading advanced analytics consulting firm, is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining data pipelines, data integration processes, and data infrastructure using Dataiku.Key Responsibilities:Design and develop data...


  • Jersey City, New Jersey, United States Lorven technologies Full time

    Job OverviewAt Lorven technologies, we are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in Python development, SQL, and data modeling, with experience in Agile development lifecycle methodology and modern engineering practices.Key ResponsibilitiesDesign and implement data engineering...

  • AWS Data Engineer

    2 days ago


    Jersey City, New Jersey, United States Evolve Esolutions Full time

    Job Title: AWS Data EngineerEvolve Esolutions is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step...

  • Data Quality Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Insight Global Full time

    Job Title: Data Quality EngineerWe are seeking a highly skilled Data Quality Engineer to join our team at Insight Global. As a Data Quality Engineer, you will play a critical role in ensuring the accuracy, completeness, and consistency of our data.Key Responsibilities:Design and implement data quality checks and processes to ensure data accuracy and...


  • Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: Principal Data EngineerAt Tiger Analytics, we're seeking a highly skilled Principal Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data ingestion pipelines, data processing, and data storage solutions using Azure cloud services.Key Responsibilities:Design...

  • Senior Data Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Syntricate Technologies Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python, Spark, and AWS.Key Responsibilities:Design and implement data pipelines using Python,...


  • Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: Principal Data EngineerAt Tiger Analytics, we're seeking a highly skilled Principal Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data ingestion pipelines, data processing, and data storage solutions using Azure cloud services.Key Responsibilities:Design...

  • Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Pyramid Consulting, Inc Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Pyramid Consulting, Inc. in Jersey City, NJ. This is a 12+ months contract opportunity with long-term potential.Job Summary:The successful candidate will have expertise in Hadoop, PySpark, and Python, with a strong background in big data and ecosystem technologies. They...

  • Data Engineering Lead

    3 weeks ago


    Jersey City, New Jersey, United States Mphasis Full time

    Databricks ArchitectLocation: Jersey City, NJSalary: $140K - $150K paJob Summary:Mphasis is seeking a highly skilled Databricks Architect with expertise in AWS to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Databricks and similar cloud databases.Key...


  • Jersey City, New Jersey, United States Sierre Technologies Full time

    Job Title: Snowflake Data EngineerWe are seeking a highly skilled Snowflake Data Engineer to join our team at Sierre Technologies. As a Snowflake Data Engineer, you will be responsible for designing, developing, testing, deploying, and maintaining enterprise-level applications using the Snowflake platform.Key Responsibilities:Design and develop complex data...

  • Azure Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States TEKsystems Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our risk technology team, you will be responsible for developing, deploying, and maintaining data solutions on the Azure platform.Key Responsibilities:Design and implement data pipelines using Azure Databricks and Azure Data LakeDevelop and...

  • Big Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Randstad Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Randstad Digital. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Kafka, Apache Storm, and NoSQL databases.Key Responsibilities:Design and develop scalable data processing systems...


  • Jersey City, New Jersey, United States BCforward Full time

    Data Quality/Meta Data EngineerBCforward is seeking a highly motivated Data Quality/Meta Data Engineer for an opportunity in Jersey City, NJ.Position Title: Data Quality/Meta Data EngineerLocation: Jersey City, NJJob Type: CONTRACT, HybridPay Range: $60 to $68.26/hrPlease note that actual compensation may vary within this range due to factors such as...

  • Senior Data Engineer

    4 weeks ago


    Jersey City, New Jersey, United States US Tech Solutions Full time

    Job DescriptionUS Tech Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our data engineering team, you will be responsible for creating distributed analysis capabilities around a large variety of datasets.Key ResponsibilitiesAt least 7 years of experience in software engineeringAt least 2 years of...

  • Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Opportunity at Tiger AnalyticsTiger Analytics is a leading advanced analytics consulting firm, renowned for its expertise in Data Science, Machine Learning, and AI. As a trusted partner for multiple Fortune 500 companies, we empower businesses to unlock value from their data. Our commitment to excellence has been recognized by market research firms,...