Data Engineer

9 hours ago


Jersey City, New Jersey, United States Insurance Services Office Full time
Job Description

We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for developing and maintaining ETL processes using ETL technologies to ensure efficient data integration and transformation workflows.

Key Responsibilities:

  • Develop and maintain ETL processes using ETL technologies
  • Write clean, optimized code to efficiently process large volumes of data
  • Conduct data analysis to troubleshoot and aid in resolving data-related issues
  • Develop and implement data processing systems using SQL, Python, and big data technologies
  • Collaborate with cross-functional teams to understand data requirements and deliver actionable insights
  • Ensure data quality, consistency, and security by implementing data validation, cleansing, and access control mechanisms
  • Continuously monitor and optimize data infrastructure performance, ensuring high availability, scalability, and reliability
  • Conduct SQL querying and analysis to validate and enhance data quality
  • Prepare monthly data quality reports/metrics to track deviations in data

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
  • 2 to 5 years of hands-on experience in data engineering
  • Minimum 2 years of experience with Amazon Web Services (AWS) - EC2, ECS, S3, SQS, Athena, RDS, Dynamo DB, Cloud Watch, IAM, and Lambda
  • Strong proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL)
  • 2+ years of expertise in Python programming and familiarity with data manipulation libraries such as Pandas and NumPy
  • Familiarity with data pipeline orchestration tools like Step Functions, AirFlow, or similar
  • 2+ years of experience with CI/CD, CloudFormation, Changeset execution, and rollback
  • Excellent problem-solving skills and the ability to work independently in a fast-paced environment
  • Experience with entity resolution or similar technology is a plus

About Us:

Verisk is a leading data analytics and technology partner to the global insurance industry. We empower communities and businesses to make better decisions on risk, faster. We value learning, caring, and results and make inclusivity and diversity a top priority.

We're 7,000 people strong and relentlessly pursue innovation. We're looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.


  • Data Engineer

    4 weeks ago


    Jersey City, New Jersey, United States Purple Fly Solutions Full time

    Job DescriptionRole: Data Onboarding EngineerLocations: Jersey City, NJDuration: FulltimeNote: We are seeking an experienced ETL Developer to onboard data into a Data Lake.Skills: ETL, Data Engineer, Data Lake, HadoopKey Responsibilities:1. Data Extraction: Design and implement data extraction processes from various sources, including relational databases,...

  • Data Engineering Lead

    17 hours ago


    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryRoyal Bank of Canada seeks a highly skilled Data Engineering Lead to support the development and maintenance of scalable data stores. The ideal candidate will have expertise in designing and developing metadata frameworks for ingestion, profiling, anomaly detection, and data repairs. Additionally, they will have experience with designing data...

  • Data Engineering Lead

    3 weeks ago


    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryRoyal Bank of Canada is seeking a highly skilled Data Engineering Lead to join our team in Jersey City, New Jersey. As a key member of our data engineering team, you will be responsible for designing and developing scalable data stores, meta data frameworks, and distributed computing engines to support our business needs.Key ResponsibilitiesDesign...


  • Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering ExpertiseAt Futran Tech Solutions Pvt. Ltd., we're seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our data engineering practice, you will be responsible for developing, modifying, and adopting tools and processes to support self-service data pipeline management. Your expertise will drive the...

  • AWS Data Engineer

    2 days ago


    Jersey City, New Jersey, United States Norconsulting Global Recruitment Full time

    AWS Data Engineer OpportunityWe are seeking a highly skilled AWS Data Engineer to join our team at Norconsulting Global Recruitment. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop scalable and efficient data pipelines using AWS services such as...

  • Senior Data Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job OpportunityTiger Analytics, a leading advanced analytics consulting firm, is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining data pipelines, data integration processes, and data infrastructure using Dataiku.Key Responsibilities:Design and develop data...


  • Jersey City, New Jersey, United States Lorven technologies Full time

    Job OverviewAt Lorven technologies, we are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in Python development, SQL, and data modeling, with experience in Agile development lifecycle methodology and modern engineering practices.Key ResponsibilitiesDesign and implement data engineering...

  • AWS Data Engineer

    2 days ago


    Jersey City, New Jersey, United States Evolve Esolutions Full time

    Job Title: AWS Data EngineerEvolve Esolutions is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step...

  • Data Quality Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Insight Global Full time

    Job Title: Data Quality EngineerWe are seeking a highly skilled Data Quality Engineer to join our team at Insight Global. As a Data Quality Engineer, you will play a critical role in ensuring the accuracy, completeness, and consistency of our data.Key Responsibilities:Design and implement data quality checks and processes to ensure data accuracy and...


  • Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: Principal Data EngineerAt Tiger Analytics, we're seeking a highly skilled Principal Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data ingestion pipelines, data processing, and data storage solutions using Azure cloud services.Key Responsibilities:Design...

  • Senior Data Engineer

    3 weeks ago


    Jersey City, New Jersey, United States Syntricate Technologies Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python, Spark, and AWS.Key Responsibilities:Design and implement data pipelines using Python,...


  • Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: Principal Data EngineerAt Tiger Analytics, we're seeking a highly skilled Principal Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data ingestion pipelines, data processing, and data storage solutions using Azure cloud services.Key Responsibilities:Design...

  • Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Pyramid Consulting, Inc Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Pyramid Consulting, Inc. in Jersey City, NJ. This is a 12+ months contract opportunity with long-term potential.Job Summary:The successful candidate will have expertise in Hadoop, PySpark, and Python, with a strong background in big data and ecosystem technologies. They...

  • Data Engineering Lead

    3 weeks ago


    Jersey City, New Jersey, United States Mphasis Full time

    Databricks ArchitectLocation: Jersey City, NJSalary: $140K - $150K paJob Summary:Mphasis is seeking a highly skilled Databricks Architect with expertise in AWS to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Databricks and similar cloud databases.Key...


  • Jersey City, New Jersey, United States Sierre Technologies Full time

    Job Title: Snowflake Data EngineerWe are seeking a highly skilled Snowflake Data Engineer to join our team at Sierre Technologies. As a Snowflake Data Engineer, you will be responsible for designing, developing, testing, deploying, and maintaining enterprise-level applications using the Snowflake platform.Key Responsibilities:Design and develop complex data...

  • Azure Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States TEKsystems Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our risk technology team, you will be responsible for developing, deploying, and maintaining data solutions on the Azure platform.Key Responsibilities:Design and implement data pipelines using Azure Databricks and Azure Data LakeDevelop and...

  • Big Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Randstad Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Randstad Digital. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Kafka, Apache Storm, and NoSQL databases.Key Responsibilities:Design and develop scalable data processing systems...


  • Jersey City, New Jersey, United States BCforward Full time

    Data Quality/Meta Data EngineerBCforward is seeking a highly motivated Data Quality/Meta Data Engineer for an opportunity in Jersey City, NJ.Position Title: Data Quality/Meta Data EngineerLocation: Jersey City, NJJob Type: CONTRACT, HybridPay Range: $60 to $68.26/hrPlease note that actual compensation may vary within this range due to factors such as...

  • Senior Data Engineer

    4 weeks ago


    Jersey City, New Jersey, United States US Tech Solutions Full time

    Job DescriptionUS Tech Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our data engineering team, you will be responsible for creating distributed analysis capabilities around a large variety of datasets.Key ResponsibilitiesAt least 7 years of experience in software engineeringAt least 2 years of...

  • Data Engineer

    9 hours ago


    Jersey City, New Jersey, United States Photon Full time

    We are seeking a skilled Data Engineer to join our team at Photon, a leading Digital Platform Engineering company. The ideal candidate will have strong experience in big data development, preferably with exposure to data-intensive applications.Key Responsibilities:Data Engineering Development:Design, develop, and test PySpark-based applications to process,...