Data Engineer

21 hours ago


Jersey City, New Jersey, United States Purple Fly Solutions Full time
Job Description

Role: Data Onboarding Engineer

Locations: Jersey City, NJ

Duration: Fulltime

Note: We are seeking an experienced ETL Developer to onboard data into a Data Lake.

Skills: ETL, Data Engineer, Data Lake, Hadoop

Key Responsibilities:

1. Data Extraction: Design and implement data extraction processes from various sources, including relational databases, APIs, and flat files.

2. Data Transformation: Develop and maintain data transformation pipelines using Spark to prepare data for analysis and loading.

3. Data Loading: Load data into various target systems, including Hive tables, databases, and data lakes.

4. Spark Expertise: Develop and maintain Spark applications in a cluster environment, including configuration and deployment.

5. Data Quality: Ensure data quality and integrity throughout the data pipeline.

Requirements:

1. Strong foundation in Scala: The primary language for Spark development.

2. Extensive Spark experience: Deep knowledge of Spark core concepts, Spark SQL, and Spark Streaming.

3. Familiarity with Spark cluster deployment: Understanding how to configure and run Spark applications in a cluster environment.

4. ETL Development: Experience with data extraction, transformation, and loading.

5. Data Lake Experience: Experience with loading data into a Data Lake.


  • Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States SoftPathTechnologies Full time

    Job DescriptionJob Type: Full-timeCompany: SoftPathTechnologiesJob Summary:We are seeking a highly skilled Databricks Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on the Databricks platform.Key Responsibilities:Design and implement data pipelines...


  • Jersey City, New Jersey, United States Insight Global Full time

    Job Title: Data Quality EngineerWe are seeking a highly skilled Data Quality Engineer to join our team at Insight Global. As a Data Quality Engineer, you will play a critical role in building and maintaining our Enterprise Data Warehouse.Key Responsibilities:Design and implement data testing strategies to ensure data accuracy and integrityDevelop and...


  • Jersey City, New Jersey, United States US Tech Solutions Full time

    Job DescriptionUS Tech Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our data engineering team, you will be responsible for creating distributed analysis capabilities around a large variety of datasets.Key ResponsibilitiesAt least 7 years of experience in software engineeringAt least 2 years of...

  • Data Engineering Lead

    2 weeks ago


    Jersey City, New Jersey, United States Mphasis Full time

    About the RoleMphasis is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Databricks and AWS.Key ResponsibilitiesDesign and implement data pipelines using Databricks or similar cloud databases.Develop...


  • Jersey City, New Jersey, United States Pyramid Consulting, Inc Full time

    Job DescriptionJob Title: Senior Data EngineerJob Type: ContractLocation: Jersey City, NJ (Hybrid)Job ID: N/APay Range: $69 - $73.50/hourEmployee Benefits:Health insurance (medical, dental, vision)401(k) planPaid sick leave (depending on work location)Key Responsibilities:Design, develop, and deploy large-scale data processing systems using Hadoop, PySpark,...


  • Jersey City, New Jersey, United States Insight Global Full time

    Job DescriptionInsight Global is seeking a highly skilled Data Quality Engineer to join our team of QA/Data Engineers. As a key member of our team, you will play a crucial role in building out our Enterprise Data Warehouse and leading efforts to transition from manual testing to automation testing.Key Responsibilities:Backend data testing and...

  • Data Engineer

    7 days ago


    Jersey City, New Jersey, United States Pyramid Consulting, Inc Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Pyramid Consulting, Inc. in Jersey City, NJ. This is a 12+ months contract opportunity with long-term potential.Job Summary:The successful candidate will have expertise in Hadoop, PySpark, and Python, with a strong background in big data and ecosystem technologies. They...

  • Big Data Engineer

    5 days ago


    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are a leading digital experience provider for the Fortune 500, with a 20-year history of innovation and growth. Our team of over 4000 experts across the globe is dedicated to delivering cutting-edge digital modernization solutions.Key RequirementsWe are seeking a highly skilled Data Engineer with expertise in the Kafka-Yarn-Spark-HDFS...

  • Big Data Engineer

    5 days ago


    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are a leading digital experience provider for the Fortune 500, with a 20-year history of innovation and growth. Our team of over 4000 experts across the globe is dedicated to delivering cutting-edge digital solutions.Key RequirementsWe are seeking a highly skilled Data Engineer with expertise in the Kafka-Yarn-Spark-HDFS ecosystem. The ideal...

  • Big Data Engineer

    2 days ago


    Jersey City, New Jersey, United States Photon Full time

    We are looking for a skilled Data Engineer to join our digital platform team at Photon. Our company has a rich history of powering digital experiences for Fortune 500 companies, and we are now seeking a talented individual to help us drive new initiatives.About PhotonFor over 20 years, we have been a leader in digital modernization, growing from a small team...


  • Jersey City, New Jersey, United States Fidelity Investments Full time

    Job Summary:Senior Quant Data Engineering Team LeadFidelity Investments is seeking a highly experienced Senior Quant Data Engineering Team Lead to join our Asset Management Quant Research Engineering team. As a key member of our team, you will be responsible for leading the development and delivery of high-quality data engineering solutions that support our...


  • Jersey City, New Jersey, United States City National Bank Full time

    Job Title: Head of Wealth Management Data Engineering and AnalyticsWe are seeking a seasoned professional to lead our Wealth Management Data Engineering and Analytics team. As the Head of Wealth Management Data Engineering and Analytics, you will be responsible for developing and executing a comprehensive data strategy that drives business insights and...


  • Jersey City, New Jersey, United States Hudson Data Full time

    Job Title: Senior .Net Software Engineer (Financial Services) Location: Remote Duration: Long Term (W2) H1 Transfer/ GC/ Citizen Job Overview: Department Overview:The primary responsibility of this role is to support, maintain, and enhance a critical application known as STAR. STAR serves as a trade processing platform that manages the deal capture of...

  • Senior Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Citigroup Full time

    About the RoleCitigroup is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our Technology group, you will play a critical role in the development and implementation of our data systems.Key ResponsibilitiesConduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model...


  • Jersey City, New Jersey, United States Citigroup Full time

    Job SummaryCitigroup is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our Technology group, you will play a critical role in the establishment and implementation of new or revised application systems and programs.Key ResponsibilitiesConduct feasibility studies, time and cost estimates, IT planning, risk technology,...

  • AI/ML Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Saransh Inc Full time

    About the RoleWe are seeking a highly skilled AI/ML Engineer to join our team at Saransh Inc. as a key member of our Data Science team.Key ResponsibilitiesDevelop and Implement AI/ML Models: Design, develop, and implement AI/ML models and algorithms to solve complex business problems and drive business growth.Collaborate with Cross-Functional Teams: Work...

  • Data Architect

    2 weeks ago


    Jersey City, New Jersey, United States VDart Inc Full time

    Job DescriptionRole: Data EngineerJob Summary:VDart Inc is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Data Ingestion and Processing: Ensure data is structured for accurate and efficient retrieval, storage, and...

  • Data Architect

    2 weeks ago


    Jersey City, New Jersey, United States Glocomms Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Glocomms. As a key member of our data engineering team, you will play a pivotal role in defining the foundation of our data infrastructure and ensuring its stability and scalability.Key ResponsibilitiesDesign, implement, and deploy software solutions to enhance...


  • Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are Photon, a leading Digital Platform Engineering company that provides a unique combination of Strategy Consulting, Creative Design, and Technology Services to a wide range of customers.As a high growth organization serving over 40% of Fortune 100 companies, we truly believe that our people make the world of difference for our clients and...


  • Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data sources.Key...