Lead Data Engineer

3 weeks ago


Egg Harbor City, United States SPENCER'S GIFTS Full time

Responsibilities

The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

  • Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables
  • Gather, document, promote, enforce, and maintain relevant data engineering best practices
  • Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team
  • Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements
  • Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements
  • Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems
  • Assist the development and architecture teams on data quality and various POC initiatives

Qualifications

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering
  • At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets
  • At least three years of experience working in Azure and Databricks technology
  • Working SQL knowledge and experience with relational databases, query authoring (SQL)
  • Working knowledge performing root cause analysis on internal and external data processing related issues
  • Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases
  • Knowledge of object-oriented/object function scripting languages: Python, Java, etc.

by Jobble


  • Lead Data Engineer

    4 weeks ago


    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Lead Data Engineer

    3 weeks ago


    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Lead Data BSA

    1 week ago


    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Lead Data BSA

    3 days ago


    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Lead Data Engineer

    1 week ago


    Kansas City, United States CyberTec Full time

    Lead Data Engineer Rate : $65/hr c2c Visa : USc,GC Location : Local to KC only and mainly remote. Client : confidential As the Lead Azure Data Engineer, you will be responsible for designing, building, and managing scalable and efficient data solutions on the Azure platform. You will play a key role in architecting data pipelines, ensuring data quality and...

  • Senior Data Scientist

    6 hours ago


    Oklahoma City, United States Data Axle Inc. Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging proprietary...

  • Lead Data Analyst

    1 week ago


    Jersey City, United States hackajob Full time

    The Analytical Data Operations (ADO) division is Verisk/ISO's data refinery, ensuring that ISO's analytical engines are properly fueled. As a member of ADO you will be part of a team of data analysts, BI developers, data engineers, data architects, and actuarial/analytical-engineers that are dedicated to improve our data analytics platform to support a host...

  • Lead Data Analyst

    2 weeks ago


    Jersey City, United States hackajob Full time

    The Analytical Data Operations (ADO) division is Verisk/ISO's data refinery, ensuring that ISO's analytical engines are properly fueled. As a member of ADO you will be part of a team of data analysts, BI developers, data engineers, data architects, and actuarial/analytical-engineers that are dedicated to improve our data analytics platform to support a host...

  • Staff Civil Engineer

    2 weeks ago


    Egg Harbor Twp, United States ARA Full time

    Contributes to ARA's team conducting pavement engineering research for the Federal Aviation Administration (FAA). Includes pavement design and analysis, pavement management, and the development of pavement-related software tools, both for in-house use and as client deliverables. Involves using pavement engineering and material concepts, statistical analysis,...

  • Lead Data Architect

    4 weeks ago


    League City, United States Robert Half Full time

    We are looking for a Lead Data Architect with a deep understanding of the MS Stack, including SQL, Azure, ADF/Synapse, PowerBI, and DB2, coupled with strong database experience. The ideal candidate will have a proven track record of designing and implementing robust data architecture solutions that meet the evolving needs of our clients. As a Lead Data...

  • Lead Data Architect

    4 weeks ago


    League City, United States Robert Half Full time

    We are looking for a Lead Data Architect with a deep understanding of the MS Stack, including SQL, Azure, ADF/Synapse, PowerBI, and DB2, coupled with strong database experience. The ideal candidate will have a proven track record of designing and implementing robust data architecture solutions that meet the evolving needs of our clients. As a Lead Data...

  • Lead Data Architect

    4 weeks ago


    League City, United States Robert Half Full time

    We are looking for a Lead Data Architect with a deep understanding of the MS Stack, including SQL, Azure, ADF/Synapse, PowerBI, and DB2, coupled with strong database experience. The ideal candidate will have a proven track record of designing and implementing robust data architecture solutions that meet the evolving needs of our clients. As a Lead Data...


  • Jersey City, United States Verisk Analytics Full time

    As the Data Engineering Director, you will lead a team of data engineers responsible for building efficient, maintainable production-grade data pipelines. This role can be based in our Jersey City, NJ location (hybrid work model) or remote. This is a Data Engineer, Director, Engineer, Product Engineer, Project Management, Technology, Data

  • Staff Engineer 2

    3 weeks ago


    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Staff Engineer, you will perform engineering design...

  • Data Engineer

    1 week ago


    Jersey City, United States Expedite Technology Solutions LLC Full time

    Provide technical design and develop Extract/Transform/Load (ETL), ELT applications that interface with Datametica's customer applications. Lead and implement data driven solutions and collaborate with larger development teams Lead and Develop Test Strategy, Test Plan, Test Cases to test the cloud based solutions Core Responsibilities Drive Analysis to...


  • Michigan City, United States Hitachi Data Systems Full time

    Description Summary of the position: The Continuous Improvement Engineer works in all aspects of Hitachi Global Air Power’s operations to analyze processes and practices for improvement opportunities. They develop, manage, and lead cross-functional continuous improvement projects in alignment with Hitachi Global Air Power’s quality goals. This individual...


  • Jersey City, NJ, United States Virtusa Full time

    DescriptionData Modernization Offerings Lead. Overall 20 yrs experience with 8+ experience utilizing multiple Cloud Platform Services AWS, Azure, GCP, Snowflake around Data Platform Migration & Modernization, Data Engineering Modernization, BI Platform Migration & Modernization, Data Architecture Modernization and Data Platform GovernanceExperience in...


  • Jersey City, New Jersey, United States Verisk Full time

    Job Description As the Data Engineering Director, you will lead a team of data engineers responsible for building efficient, maintainable production-grade data pipelines. This role can be based in our Jersey City, NJ location (hybrid work model) or remote. This is a hands-on role with a small team, where you will have the opportunity to provide technical...

  • Computer Scientist

    4 weeks ago


    Egg Harbor, United States Veracity Engineering Full time

    Veracity Engineering has an exciting opportunity for a driven, detail-oriented, and experienced Developmental Test Engineer for the FAA. The successful candidate will provide 2nd level engineering support for the Aeronautical Information Modernization Management (AIMM) systems. He/She Will provide expertise in software requirements analysis, design, design...

  • Cloud Data Engineer

    2 days ago


    Jersey City, United States ShiftCode Analytics Full time

    Title: Cloud Data Engineer Location: Charlotte, NC This role is 100% remote But Local Candidate is highly Preferred Sector: Banking Duration: 8 month (C2H) (USC or GC candidates Only***) Job Summary: Project Details: Job Description: Be the subject matter expert for data, pipeline design, architecture, and other data engineering technologies for the...