Data Engineer

4 weeks ago

Jersey City, United States A.M. Best Full time
Overview

The Data Engineer will build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse. They will develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-architect existing data loading processes and data structures. They will work independently with minimal supervision within the Data Engineering team and will collaborate with other teams in an agile environment. They will have a creative mindset, knack to solve complex problems, passion to work with data, and a positive attitude.

Responsibilities

  • Design and develop ELT / ETL to load data from internal sources into operational data stores, Azure data lake and data warehouse.
  • Create APIs, data structures and schemas to store and retrieve data.
  • Create and maintain data mappings, data definitions, architecture and data flow diagrams.
  • Implement solutions to validate and test data quality.
  • Build proof-of-concepts to determine viability of new processes and technologies.
  • Deploy and manage code in non-prod and prod environments.
  • Troubleshoot data related issues and fix defects.
  • Optimize and performance tune databases and queries.
  • Participate in code reviews and train other team members.
  • Document code and create code templates based on industry best practices.
Qualifications
  • Bachelor's Degree and/or equivalent experience required.
  • Minimum 5 years of experience working as a Data Engineer, ETL Engineer, Data/ETL Architect or similar roles.


Skills

• 5+ years of solid continuous experience in Python.
• 3+ years of continuous experience with Airflow.
• 3+ years of experience with Azure Data Factory (ADF) or similar.
• 3+ years of experience working with relational databases: Oracle, SQL Server, PostgreSQL, or similar.
• 3+ years of experience working with NoSQL databases: MongoDB, Cosmos DB, DocumentDB or similar
• 3+ years of experience writing SQL code.
• 3+ years of experience in Kimball Dimensional Modeling (Star-Schema).
• 2+ years of experience in columnar databases: Snowflake, Azure Synapse, or similar.
• 2+ years of Azure / AWS experience.

Pluses, but not required: Any work experience in the following:
• ETL / ELT: Spark, Apache NiFi, Kafka, Luigi, Prefect.
• Languages: Java, Scala, R.
• Platforms: Databricks.
• Databases: Redis, Elasticsearch.
• Data Orchestrator: Control-M, JAMS.

  • Data Engineer

    2 weeks ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    2 weeks ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    2 weeks ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    1 day ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    2 hours ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Lead Data BSA

    3 weeks ago

    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Lead Data BSA

    1 day ago

    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Data Engineer

    5 days ago

    Jersey City, United States Jarvis Walker Full time

    Data EngineerWe are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lines of business, as well as enhance our existing product line.Key...

  • Data Engineer

    2 hours ago

    Jersey City, United States Jarvis Walker Full time

    Data EngineerWe are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lines of business, as well as enhance our existing product line.Key...

  • Data Engineer

    1 week ago

    Jersey City, United States YASH Technologies Full time

    Looking for 10+ yrs Senior ResourceMandatory Skills· Oracle· Mongo DB· Data Engineer· NO SQL database· Data ModelingThe Senior Database Engineer(MongoDB) will lead complex or critical database management initiatives that typically involve multiple disciplines and business groupsSupporting MongoDB databases / Supporting MongoDB Shards with Pearl and/or...

  • Data Engineer

    2 hours ago

    Jersey City, United States YASH Technologies Full time

    Looking for 10+ yrs Senior ResourceMandatory Skills· Oracle· Mongo DB· Data Engineer· NO SQL database· Data ModelingThe Senior Database Engineer(MongoDB) will lead complex or critical database management initiatives that typically involve multiple disciplines and business groupsSupporting MongoDB databases / Supporting MongoDB Shards with Pearl and/or...

  • Senior Data Engineer

    3 weeks ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Senior Data Engineer

    8 hours ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Data Architect/Engineer

    4 days ago

    Jersey City, United States Motion Recruitment Full time

    Grow your career as a Data Architect/Engineer with an innovative global bank in Jersey City, NJ. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You...

  • Data Architect, Engineer

    2 days ago

    Jersey City, United States Rose International Full time

    Date Posted: 05/31/2024 Hiring Organization: Rose International Position Number: 465057 Job Title: Data Architect, Engineer Job Location: Jersey City, NJ, USA, 07310 Work Model: Hybrid Shift: 3 Days in Office Employment Type: Temporary Estimated Duration (In months): 13 Min Hourly Rate ($): 90.00 Max Hourly Rate ($): 100.00 Must Have...

  • Data Engineer

    2 weeks ago

    Jersey City, United States SANS Full time

    Job Title - Data Engineer - SnowflakeLocation - Jersey City, NJ (Hybrid)Duration - 12+ Months Requirements:8 to 10 Yrs IT experience on Data driven initiatives with recent 2-3 Yrs experience in snowflake is mandatorySQL, Data Warehousing, Data Modeling, Cloud based technologies (Azure, AWS, Google Cloud Platform etc.)Performance Tuning experienceMetadata...

  • Data Engineer, Analytics

    1 week ago

    Jersey City, United States Bernard Nickels & Associates Full time

    Role: Data Engineer, AnalyticsStatus: PermLocation: Jersey City, NJSalary: up to $120KWith a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Job SummaryStrategic Analytics team - the team develops innovative...

  • Data Engineer, Analytics

    1 week ago

    Jersey City, United States Bernard Nickels & Associates Full time

    Role: Data Engineer, AnalyticsStatus: PermLocation: Jersey City, NJSalary: up to $120KWith a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Job SummaryStrategic Analytics team - the team develops innovative...

  • Director Of Data Engineering

    2 weeks ago

    Jersey City, United States Kavyos Consulting Inc Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....

  • Director Of Data Engineering

    4 weeks ago

    Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....