Lead Data Engineer

2 weeks ago

Egg Harbor Township, United States Spencer's Full time

Responsibilities


The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

  • Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables
  • Gather, document, promote, enforce, and maintain relevant data engineering best practices
  • Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team
  • Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements
  • Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements
  • Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems
  • Assist the development and architecture teams on data quality and various POC initiatives


Qualifications


  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering
  • At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets
  • At least three years of experience working in Azure and Databricks technology
  • Working SQL knowledge and experience with relational databases, query authoring (SQL)
  • Working knowledge performing root cause analysis on internal and external data processing related issues
  • Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases
  • Knowledge of object-oriented/object function scripting languages: Python, Java, etc.

  • Lead Data Engineer

    1 month ago

    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Lead Data Engineer

    2 months ago

    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Engineering Technician

    7 days ago

    Egg Harbor Township, United States General Dynamics Information Technology Full time

    Engineering Technician III: Primary Responsibilities- Data Acquisition and Instrumentation.Candidate will be expected to build and troubleshoot data acquisition systems designed by onsite engineers. Candidate will also perform installations of various pavement instrumentation at the NAPTF and selected airports across the country. In addition to data...

  • Mechanical Engineer Advisor Job Details | NTT DATA Services

    4 days ago

    Pearl Harbor, United States NTT DATA Full time

    Req ID: 283696NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Mechanical Engineer Advisor to join our team in Pearl Harbor, Hawaii (US-HI), United States (US).The Regional...

  • Intermediate Level Test Engineer

    2 weeks ago

    Egg Harbor Township, United States mPower Full time

    Intermediate Level Test Engineer Share | Job Summary Company: Location: Egg Harbor Township, NJ Type: Experience: Job Description Essential Job Functions: • Performs highly complex testing and analyzes network systems development including integration, systems testing, probability testing, field test plans and customer...

  • Technical Specialist

    3 weeks ago

    Egg Harbor Township, United States A3 Technology, Inc. Full time

    A3 Technology, Inc. is seeking a Technical Specialist to join our Terminal Second Level Engineering (TSLE) System Engineering & Integration team in Egg Harbor Township, NJ. This position serves as a member of the team that is deeply involved in the full system test and integration life cycle of multiple projects. **Essential Job Functions**: - Monitor NAS...

  • Lead Energetic Materials Engineer

    7 days ago

    Egg Harbor Twp, United States Battelle Memorial Institute Full time

    Battelle delivers when others cant. We conduct research and development, manage national laboratories, design and manufacture products and deliver critical services for our clientswhether they are a multi-national corporation, a small start-up or a government agency. We recognize and appreciate the value and contributions of individuals with diverse...

  • Lead Chemical Engineer

    6 days ago

    Egg Harbor Twp, United States Battelle Memorial Institute Full time

    Battelle delivers when others cant. We conduct research and development, manage national laboratories, design and manufacture products and deliver critical services for our clientswhether they are a multi-national corporation, a small start-up or a government agency. We recognize and appreciate the value and contributions of individuals with diverse...

  • Lead Chemical Engineer

    6 days ago

    Egg Harbor Twp, United States Battelle Memorial Institute Full time

    Battelle delivers when others cant. We conduct research and development, manage national laboratories, design and manufacture products and deliver critical services for our clientswhether they are a multi-national corporation, a small start-up or a government agency. We recognize and appreciate the value and contributions of individuals with diverse...

  • Engineering Technician

    7 days ago

    Egg Harbor City, United States General Dynamics Information Technology Full time

    Engineering Technician III: Primary Responsibilities- Data Acquisition and Instrumentation. Candidate will be expected to build and troubleshoot data acquisition systems designed by onsite engineers. Candidate will also perform installations of various pavement instrumentation at the NAPTF and selected airports across the country. In addition to data...

  • Junior Scientist

    2 months ago

    Egg Harbor Township, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Junior Scientist to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Junior Scientist, you will perform studies and...

  • Lead Data Engineer

    3 weeks ago

    Cranberry Township, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionIn this role you will democratize AI through the enterprise ML platform, accelerate the adoption of Generative Artificial Intelligence (Gen AI) and drive Responsible AI. You’ll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges.Primary Responsibilities:Develop and...

  • Staff Civil Engineer

    4 weeks ago

    Egg Harbor Twp, United States ARA Full time

    Contributes to ARA's team conducting pavement engineering research for the Federal Aviation Administration (FAA). Includes pavement design and analysis, pavement management, and the development of pavement-related software tools, both for in-house use and as client deliverables. Involves using pavement engineering and material concepts, statistical analysis,...

  • Engineering Technician

    3 days ago

    Egg Harbor Township, New Jersey, 08234, Atlantic County, NJ, United States General Dynamics Information Technology Full time

    Engineering Technician III: Primary Responsibilities- Data Acquisition and Instrumentation.Candidate will be expected to build and troubleshoot data acquisition systems designed by onsite engineers. Candidate will also perform installations of various pavement instrumentation at the NAPTF and selected airports across the country. In addition to data...

  • Staff Engineer 2

    6 days ago

    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Staff Engineer, you will perform engineering design...

  • Staff Engineer 2

    1 month ago

    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Staff Engineer, you will perform engineering design...

  • Staff Engineer 2

    3 days ago

    Egg Harbor Twp, United States Applied Research Associates Full time

    **Description** The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Staff Engineer, you will perform...

  • Staff Engineer 2

    5 days ago

    Egg Harbor Twp, United States Applied Research Associates Full time

    **Description** The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Staff Engineer, you will perform...

  • Data Engineer

    3 days ago

    Robinson Township, United States All Lines Technology Full time

    Job DescriptionJob DescriptionAll Lines Technology has an immediate opening for a Data Engineer in Robinson Township! The individual in this role will play a critical role in managing and optimizing data within our organization. They’ll be responsible for maintaining, organizing, and enhancing our data infrastructure to ensure efficient data flow,...

  • Staff EOD Technician 2

    3 weeks ago

    Egg Harbor Township, United States Applied Research Associates, Inc. Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff EOD Technician 2 to support engineering and scientific research, development, testing, studies, and related activities on-site in Egg Harbor Township, New Jersey. As a Staff EOD Technician 2 you will provide expertise in the composition and formulation of...