Data Engineer

4 weeks ago

Jersey City, New Jersey, United States Verisk Full time
Job Overview

We are seeking a highly skilled Data Engineer to join our Enterprise Data Management team at Verisk. As a Data Engineer, you will be responsible for developing, maintaining, and optimizing ETL processes using ETL technologies to ensure efficient data integration and transformation workflows.

Key Responsibilities
  • Develop and maintain ETL processes using ETL technologies to ensure efficient data integration and transformation workflows.
  • Write clean, optimized code to efficiently process large volumes of data.
  • Conduct data analysis to troubleshoot and aid in resolving data-related issues.
  • Develop and implement data processing systems using SQL, Python, and big data technologies.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.
  • Ensure data quality, consistency, and security by implementing data validation, cleansing, and access control mechanisms.
  • Continuously monitor and optimize data infrastructure performance, ensuring high availability, scalability, and reliability.
  • Conduct SQL querying and analysis to validate and enhance data quality.
  • Prepare monthly data quality reports / metrics to track deviations in data.
  • Provide afterhours or weekend support for ETL processes and troubleshoot any issues that may arise to ensure data integrity and timely completion of ETL tasks.
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering or a related STEM field.
  • 2 to 5 years of hands-on experience in data engineering.
  • Minimum 2 years of experience with Amazon Web Services (AWS) – EC2, ECS, S3, SQS, Athena, RDS, Dynamo DB, Cloud Watch, IAM and Lambda.
  • Strong proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
  • 2+ years of expertise in Python programming and familiarity with data manipulation libraries such as Pandas and NumPy.
  • Familiarity with data pipeline orchestration tools like Step Functions, AirFlow or similar.
  • 2+ years of experience with CI/CD, CloudFormation, Changeset execution and rollback.
  • Excellent problem-solving skills and the ability to work independently in a fast-paced environment.
  • Experience with entity resolution or similar technology is plus.
About Verisk

Verisk is a leading data analytics and technology partner to the global insurance industry. We empower communities and businesses to make better decisions on risk, faster. At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed.

We're 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.

  • Data Engineering Lead

    4 weeks ago

    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryRoyal Bank of Canada seeks a highly skilled Data Engineering Lead to support the development and maintenance of scalable data stores. The ideal candidate will have expertise in designing and developing metadata frameworks for ingestion, profiling, anomaly detection, and data repairs. Additionally, they will have experience with designing data...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job SummaryTiger Analytics is a leading advanced analytics consulting firm, renowned for its expertise in Data Science, Machine Learning, and AI. As a trusted partner to Fortune 100 companies, we help them unlock business value from data. Our recognition by market research firms like Forrester and Gartner is a testament to our success.We are seeking an...

  • Data Engineering Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering ExpertiseAt Futran Tech Solutions Pvt. Ltd., we're seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our data engineering practice, you will be responsible for developing, modifying, and adopting tools and processes to support self-service data pipeline management. Your expertise will drive the...

  • AWS Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Norconsulting Global Recruitment Full time

    AWS Data Engineer OpportunityWe are seeking a highly skilled AWS Data Engineer to join our team at Norconsulting Global Recruitment. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop scalable and efficient data pipelines using AWS services such as...

  • Senior Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering Opportunities at Futran Tech Solutions Pvt. Ltd.Futran Tech Solutions Pvt. Ltd. is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines to support our business needs.Key Responsibilities:Develop and maintain data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Lorven technologies Full time

    Job OverviewAt Lorven technologies, we are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in Python development, SQL, and data modeling, with experience in Agile development lifecycle methodology and modern engineering practices.Key ResponsibilitiesDesign and implement data engineering...

  • AWS Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Evolve Esolutions Full time

    Job Title: AWS Data EngineerEvolve Esolutions is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step...

  • Data Engineering Specialist

    3 weeks ago

    Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering RoleAt Futran Tech Solutions Pvt. Ltd., we are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering, with experience in developing, modifying, and adopting tools and processes to support self-service data pipeline management.Key Responsibilities: Develop...

  • AWS Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Norconsulting Global Recruitment Full time

    Job Title: AWS Data EngineerLocation: RemoteJob Type: Full-timeCompany: Norconsulting Global RecruitmentAbout the Role:We are seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design, develop, and maintain...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job OverviewTiger Analytics is a leading advanced analytics consulting firm, partnering with Fortune 100 companies to drive business value from data. We're seeking a seasoned Data Engineer to join our team, responsible for designing, building, and maintaining data pipelines, integration processes, and infrastructure using Dataiku.Key Responsibilities:Design...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Verisk Analytics URIX Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Verisk Analytics. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines to support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States TechnoGen Full time

    Job Title:Data Engineer - Lead - (Only 12 plus years candidates)Location:Jersey City, NJ (Day 1 On-site)Duration :Long Term - contractExperience Level: 12+ YearsJob Description :Develops and implements creative software solutions, leveraging expertise in data engineering to drive innovation and improvement.Collaborates with cross-functional teams to design,...

  • Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Photon Full time

    We are seeking a skilled Data Engineer to join our team at Photon, a leading Digital Platform Engineering company. The ideal candidate will have strong experience in big data development, preferably with exposure to data-intensive applications.Key Responsibilities:Data Engineering Development:Design, develop, and test PySpark-based applications to process,...

  • Big Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Worky Full time

    About the Role:We are seeking a highly skilled Big Data Engineer to join our team at Worky. As a key member of our data engineering team, you will be responsible for designing and implementing big data solutions using Java, Spark, and Scala. Your expertise in AWS technologies such as EMR, EKS, and Lambda will be crucial in building scalable and...

  • Senior Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Verisk Analytics URIX Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Verisk Analytics/ URIX. As a key member of our Enterprise Data Management team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures.Key ResponsibilitiesCollaborate with data scientists, analysts, and other...

  • Senior Data Engineering Specialist

    4 weeks ago

    Jersey City, New Jersey, United States Saxon Global Full time

    Key Responsibilities:As a Senior Data Engineering Specialist at Saxon Global, you will be responsible for designing and implementing large-scale data engineering solutions on Azure. With 10+ years of experience in data engineering, you will lead the development of data and analytics platforms focused on Azure data and analytics solutions. Your expertise in...

  • Senior Data Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Verisk Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our Enterprise Data Management team at Verisk. As a key member of our team, you will be responsible for designing, building, and maintaining large-scale data pipelines and dynamic data solutions using cutting-edge tools like Databricks, Python, and Spark.Key...

  • Big Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Della Infotech Full time

    Job Title: Big Data EngineerLocation: RemoteDuration: C2C/FulltimeRequirements:Must have: Java, Spark, Python, Scala. BS degree in computer science, computer engineering or equivalent - 6 years of experience delivering enterprise software solutions Proficient in Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala 3+ years of experience across...

  • Azure Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Saxon Global Full time

    Job SummaryAt Saxon Global, we are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities- Design and implement data pipelines using Azure Data Factory, Azure Synapse...

  • Senior Big Data Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Maintec Technologies Full time

    Job Title: Senior Big Data EngineerJob Summary: Maintec Technologies is seeking a highly skilled Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will be responsible for designing, developing, and implementing scalable data pipelines using Scala, Python, and Apache Spark. You will work closely with our data engineering team to...