Lead Data Engineer

4 weeks ago

Egg Harbor, United States SPENCER'S GIFTS Full time

Responsibilities


The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

  • Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables
  • Gather, document, promote, enforce, and maintain relevant data engineering best practices
  • Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team
  • Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements
  • Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements
  • Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems
  • Assist the development and architecture teams on data quality and various POC initiatives


Qualifications


  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering
  • At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets
  • At least three years of experience working in Azure and Databricks technology
  • Working SQL knowledge and experience with relational databases, query authoring (SQL)
  • Working knowledge performing root cause analysis on internal and external data processing related issues
  • Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases
  • Knowledge of object-oriented/object function scripting languages: Python, Java, etc.

  • Staff Civil Engineer

    2 weeks ago

    Egg Harbor Twp, United States ARA Full time

    Contributes to ARA's team conducting pavement engineering research for the Federal Aviation Administration (FAA). Includes pavement design and analysis, pavement management, and the development of pavement-related software tools, both for in-house use and as client deliverables. Involves using pavement engineering and material concepts, statistical analysis,...

  • Staff Engineer 2

    3 weeks ago

    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Staff Engineer, you will perform engineering design...

  • Computer Scientist

    4 weeks ago

    Egg Harbor, United States Veracity Engineering Full time

    Veracity Engineering has an exciting opportunity for a driven, detail-oriented, and experienced Developmental Test Engineer for the FAA. The successful candidate will provide 2nd level engineering support for the Aeronautical Information Modernization Management (AIMM) systems. He/She Will provide expertise in software requirements analysis, design, design...

  • Senior Engineer 2

    18 hours ago

    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Senior Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Senior Engineer, you will perform in-depth...

  • Senior Engineer 2

    3 weeks ago

    Egg Harbor Twp, United States Applied Research Associates Full time

    **Description** The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Senior Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Senior Engineer, you will perform...

  • Technical Specialist

    6 days ago

    Egg Harbor Township, United States A3 Technology, Inc. Full time

    A3 Technology, Inc. is seeking a Technical Specialist to join our Terminal Second Level Engineering (TSLE) System Engineering & Integration team in Egg Harbor Township, NJ. This position serves as a member of the team that is deeply involved in the full system test and integration life cycle of multiple projects. **Essential Job Functions**: - Monitor NAS...

  • Computer Scientist Level 4

    4 weeks ago

    Egg Harbor, United States Veracity Engineering Full time

    WHAT THE POSITION ENTAILS:Veracity Engineering has an exciting opportunity for a Computer Scientist at the William J. Hughes Technical Center in Atlantic City, NJ. This position will support system development, testing, integration, and deployment activities for AIMM systems.What you will get to do:Install, configure, monitor, and maintain Linux systems...

  • Computer Scientist Level 4

    4 weeks ago

    Egg Harbor, United States Veracity Engineering Full time

    WHAT THE POSITION ENTAILS:Veracity Engineering has an exciting opportunity for a Computer Scientist at the William J. Hughes Technical Center in Atlantic City, NJ. This position will support system development, testing, integration, and deployment activities for AIMM systems.What you will get to do:Install, configure, monitor, and maintain Linux systems...

  • DHS TSL Environmental Health

    7 days ago

    Egg Harbor Twp, United States Global Systems Technologies Full time

    Job DescriptionJob Description Company Overview Global Systems Technologies (GST Inc.) since 1993, enhances national and homeland security by supporting Transportation Security Administration (TSA), Department of Homeland Security (DHS), and Department of Defense (DOD) initiatives and resolving complex technical issues. GST values integrity, initiative,...

  • Junior Scientist

    4 weeks ago

    Egg Harbor Township, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Junior Scientist to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Junior Scientist, you will perform studies and...

  • Construction Manager

    6 days ago

    Egg Harbor Township, United States Bacik Group LLC Full time

    Bacik Group is seeking a Construction Manager to join our Federal Aviation Administration Center Operations Technical and Engineering Support contract at the William J. Hughes Technical Center located near Atlantic City, New Jersey. The Construction Manager must be proficient in the Microsoft Office software suite (Excel, Word, Outlook) and have a minimum of...

  • Program Analyst

    4 days ago

    Egg Harbor, United States Indev Full time

    Position Title: Program Analyst Location: Atlantic City, NJ - FAA’s William J. Hughes Technical Center (WJHTC) Clearance Requirements: Must be a U.S. Citizen and be able to obtain a U.S. Federal government FAA badge and be required to pass a government Public Trust background investigation. Position Overview: Indev is seeking an experienced Program...

  • Sr Software Developer

    1 week ago

    Egg Harbor Twp, United States EVTKS Full time

    Benefits: 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Benefits/Perks Competitive Compensation Career Growth Opportunities Job Summary As a Sr. Software Developer, you will provide 2nd level engineering support for Aeronautical Common Service (ACS). ACS is the single trusted access point for Special Activity Airspace,...

  • Sr Software Developer

    2 days ago

    Egg Harbor Twp, United States EVTKS Full time

    Benefits: 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Benefits/Perks Competitive Compensation Career Growth Opportunities Job Summary As a Sr. Software Developer, you will provide 2nd level engineering support for Aeronautical Common Service (ACS). ACS is the single trusted access point for Special Activity Airspace,...

  • System Administrator Team Lead

    7 days ago

    Palm Harbor, United States Geographic Solutions, Inc. Full time

    Under limited supervision, leads and manages System Engineers and Network Engineers. This position is responsible for continuously analyzing user requirements, reviewing documented procedures, policies and workflows, and performing incident and probl Team Lead, System Administrator, Client Support, Network Engineer, Administrator, Microsoft, Technology,...

  • Computer Scientist

    4 weeks ago

    Egg Harbor Township, United States A3 Technology, Inc. Full time

    A3 Technology, Inc. is seeking a Computer Scientist to join our Terminal Second Level Engineering (TSLE) System Engineering & Field Support Team in Egg Harbor Township, NJ. This position serves as a member of the team that is deeply involved in the full deployment, integration and field support life cycle of multiple projects. **Essential Job...

  • Staff EOD Technician 2

    6 days ago

    Egg Harbor Township, United States Applied Research Associates, Inc. Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff EOD Technician 2 to support engineering and scientific research, development, testing, studies, and related activities on-site in Egg Harbor Township, New Jersey. As a Staff EOD Technician 2 you will provide expertise in the composition and formulation of...

  • Network Infrastructure Engineer

    1 week ago

    Egg Harbor Twp, United States AtlantiCare Full time

    Job DescriptionBachelor's degree with 3 years related experienced required or High School Diploma required minimum 5 years' experience required.POSITION SUMMARY The Network Infrastructure Engineer I role is to ensure the stability and integrity of in-house voice, data, video, and wireless network services. This is achieved by planning, designing, and...

  • Network Infrastructure Engineer

    2 days ago

    Egg Harbor Twp, United States AtlantiCare Full time

    Job DescriptionBachelor's degree with 3 years related experienced required or High School Diploma required minimum 5 years' experience required.POSITION SUMMARY The Network Infrastructure Engineer I role is to ensure the stability and integrity of in-house voice, data, video, and wireless network services. This is achieved by planning, designing, and...

  • Staff EOD Technician 2

    1 week ago

    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff EOD Technician 2 to support engineering and scientific research, development, testing, studies, and related activities on-site in Egg Harbor Township, New Jersey. As a Staff EOD Technician 2 you will provide expertise in the composition and formulation of...