Lead Data Engineer

3 weeks ago


Egg Harbor Twp, United States SPENCER'S GIFTS Full time

Responsibilities

The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables Gather, document, promote, enforce, and maintain relevant data engineering best practices Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems Assist the development and architecture teams on data quality and various POC initiatives

Qualifications

Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets At least three years of experience working in Azure and Databricks technology Working SQL knowledge and experience with relational databases, query authoring (SQL) Working knowledge performing root cause analysis on internal and external data processing related issues Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases Knowledge of object-oriented/object function scripting languages: Python, Java, etc.

#J-18808-Ljbffr


  • Lead Data Engineer

    3 weeks ago


    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Lead Data Engineer

    4 weeks ago


    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Staff Civil Engineer

    2 weeks ago


    Egg Harbor Twp, United States ARA Full time

    Contributes to ARA's team conducting pavement engineering research for the Federal Aviation Administration (FAA). Includes pavement design and analysis, pavement management, and the development of pavement-related software tools, both for in-house use and as client deliverables. Involves using pavement engineering and material concepts, statistical analysis,...

  • Staff Engineer 2

    3 weeks ago


    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Staff Engineer, you will perform engineering design...

  • Senior Engineer 2

    1 day ago


    Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Senior Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey.This position is contingent on contract award. As a Senior Engineer, you will perform in-depth...

  • Senior Engineer 2

    3 weeks ago


    Egg Harbor Twp, United States Applied Research Associates Full time

    **Description** The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Senior Engineer 2 to support engineering and scientific research, development, testing, studies, and related activities onsite in Egg Harbor Township, New Jersey. This position is contingent on contract award. As a Senior Engineer, you will perform...


  • Egg Harbor Twp, United States Global Systems Technologies Full time

    Job DescriptionJob Description Company Overview Global Systems Technologies (GST Inc.) since 1993, enhances national and homeland security by supporting Transportation Security Administration (TSA), Department of Homeland Security (DHS), and Department of Defense (DOD) initiatives and resolving complex technical issues. GST values integrity, initiative,...

  • Data Engineer

    2 weeks ago


    Limestone Twp, United States Gridiron IT Full time

    GridIron IT is seeking multiple Data Engineers on a remote basis. US Citizenship/Green Card and the ability to obtain a Federal Public Trust is required. The Data Engineer participates in the design and build of modern data products that comprise of raw data stores (data lakes) and cleansed data repositories, populated by batch or streaming data pipelines....

  • Data Engineer

    3 days ago


    Limestone Twp, United States Gridiron IT Full time

    GridIron IT is seeking multiple Data Engineers on a remote basis. US Citizenship/Green Card and the ability to obtain a Federal Public Trust is required. The Data Engineer participates in the design and build of modern data products that comprise of raw data stores (data lakes) and cleansed data repositories, populated by batch or streaming data pipelines....

  • Sr Software Developer

    2 weeks ago


    Egg Harbor Twp, United States EVTKS Full time

    Benefits: 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Benefits/Perks Competitive Compensation Career Growth Opportunities Job Summary As a Sr. Software Developer, you will provide 2nd level engineering support for Aeronautical Common Service (ACS). ACS is the single trusted access point for Special Activity Airspace,...


  • Egg Harbor Twp, United States EVTKS Full time

    Benefits: 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Benefits/Perks Competitive Compensation Career Growth Opportunities Job Summary As a Sr. Software Developer, you will provide 2nd level engineering support for Aeronautical Common Service (ACS). ACS is the single trusted access point for Special Activity Airspace,...


  • Egg Harbor Twp, United States AtlantiCare Full time

    Job DescriptionBachelor's degree with 3 years related experienced required or High School Diploma required minimum 5 years' experience required.POSITION SUMMARY The Network Infrastructure Engineer I role is to ensure the stability and integrity of in-house voice, data, video, and wireless network services. This is achieved by planning, designing, and...


  • Egg Harbor Twp, United States AtlantiCare Full time

    Job DescriptionBachelor's degree with 3 years related experienced required or High School Diploma required minimum 5 years' experience required.POSITION SUMMARY The Network Infrastructure Engineer I role is to ensure the stability and integrity of in-house voice, data, video, and wireless network services. This is achieved by planning, designing, and...


  • Egg Harbor Twp, United States ARA Full time

    The Engineering Science Division (ESD) of Applied Research Associates, Inc. (ARA) is seeking a Staff EOD Technician 2 to support engineering and scientific research, development, testing, studies, and related activities on-site in Egg Harbor Township, New Jersey. As a Staff EOD Technician 2 you will provide expertise in the composition and formulation of...


  • Egg Harbor Twp, United States AtlantiCare Full time

    Job DescriptionPOSITION SUMMARY The Senior Benefits Specialist is responsible for providing benefit support to all business units within AtlantiCare to meet their established goals and objectives. In this role the Senior Benefits Specialist will work with vendors to ensure compliance to established contracts, lead the work pertaining to the regulatory...


  • Egg Harbor Twp, United States OCH Technologies LLC Full time

    OCH Technologies is hiring a Database Administrator for a position supporting the FAA. The Database Administrator will provide database administration support including database architecture design and implementation, patch management, upgrades, troubleshooting and problem remediation. Databases include Oracle, PostgreSQL, and Microsoft SQL Server....


  • Egg Harbor Twp, United States OCH Technologies LLC Full time

    OCH Technologies is hiring a Database Administrator for a position supporting the FAA. The Database Administrator will provide database administration support including database architecture design and implementation, patch management, upgrades, troubleshooting and problem remediation. Databases include Oracle, PostgreSQL, and Microsoft SQL Server....

  • Dispatcher

    1 week ago


    Egg Harbor Twp, United States Comfort Now Full time

    We are seeking a detail-oriented and proactive Dispatcher to join our team. The Dispatcher plays a critical role in ensuring smooth operations within the service department by effectively coordinating technician schedules, communicating with customers, managing parts ordering, and handling various administrative tasks. The ideal candidate will possess strong...

  • Computer Scientist

    4 weeks ago


    Egg Harbor, United States Veracity Engineering Full time

    Veracity Engineering has an exciting opportunity for a driven, detail-oriented, and experienced Developmental Test Engineer for the FAA. The successful candidate will provide 2nd level engineering support for the Aeronautical Information Modernization Management (AIMM) systems. He/She Will provide expertise in software requirements analysis, design, design...


  • Lawrence Twp, United States Traffic Planning and Design Full time

    Ranked the overall #4 Best Civil Engineering Firm to Work for in the Nation (#1 in our size category) and residing on the list of the Engineering News Record (ENR)'s Top 500 Design Firms in the nation, TPD (Traffic Planning and Design, Inc.) is currently hiring a Civil Engineer for design projects in New Jersey and Pennsylvania. Our ideal candidate has 15+...