Lead Data Engineer

8 months ago


Egg Harbor, United States SPENCER'S GIFTS Full time

Responsibilities


The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

  • Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables
  • Gather, document, promote, enforce, and maintain relevant data engineering best practices
  • Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team
  • Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements
  • Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements
  • Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems
  • Assist the development and architecture teams on data quality and various POC initiatives


Qualifications


  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering
  • At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets
  • At least three years of experience working in Azure and Databricks technology
  • Working SQL knowledge and experience with relational databases, query authoring (SQL)
  • Working knowledge performing root cause analysis on internal and external data processing related issues
  • Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases
  • Knowledge of object-oriented/object function scripting languages: Python, Java, etc.


  • Cloud Data Architect

    23 hours ago


    Egg Harbor City, New Jersey, United States Spencer's Full time

    At Spencer's, we're seeking a seasoned Cloud Data Architect to lead our data engineering efforts. As the Lead Data Engineering Specialist, you'll be responsible for designing and managing algorithms and pipelines in collaboration with diverse teams.The ideal candidate will have at least eight years of experience in designing, building, and optimizing data...


  • Palm Harbor, Florida, United States GEOGRAPHIC SOLUTIONS INC Full time

    Job TitleSoftware Integrity QA Engineer IIAbout UsiQuery, a subsidiary of Geographic Solutions Incorporated (GSI), specializes in data analytics and offers customized applications tailored to meet the specific needs of B2B clients. Our services are designed to deliver state-of-the-art systems that enhance data-driven decision-making and operational...


  • Egg Harbor Township, United States Strongbridge LLC Full time

    Strongbridge, LLC is seeking a highly experienced Senior Network Engineer to join its growing contract supporting a federal government agency. The government customer requires the expertise of an experienced Senior Network Engineer to support its multiple networking initiatives across all areas of the division. Specifically, the government customer is...


  • Egg Harbor Twp, United States Noblis Full time

    We are seeking a highly skilled Principal Engineer to join our team at Noblis, a leading provider of specialized engineering and acquisition services to the Federal Aviation Administration (FAA).Company OverviewNoblis is a trusted partner to the government and industry, tackling the nation's toughest challenges with innovative solutions. Our team of experts...

  • Software Engineer

    2 months ago


    Egg Harbor Twp, United States Signature Science Full time

    Position Purpose: The primary purpose of this position is to develop and maintain software tools used for applied research projects in the Atlantic City Operation. Essential Duties and Responsibilities: * Develops software using LabVIEW, Visual Basic for Applications (VBA), Python, and C#, to fulfill the needs of government-based projects. * Develops data...


  • Pearl Harbor, United States Booz Allen Hamilton Full time

    Job Number: R0195717Data Architect, Senior The Opportunity: For an organization to transform in today's digital world, it needs to properly collect, store, and organize its data. Effective data management can enable more efficient operations, yielding more growth. As a senior data architect, you know how to apply your creative thinking and analytical mindset...

  • Program Manager

    2 weeks ago


    Egg Harbor, United States The Judge Group Full time

    Our Client is seeking a Senior Program Manager to support our FAA contract in Egg Harbor Township, NJ. What you will be doing:Second Level Engineering Support: (Hardware software, ongoing sustainment, 22, 30/40 year old radar systems. Windows 3.1 terminals. Cobalt program, Critically dependent on these experts to keep them up and running so that planes fly...


  • Egg Harbor Twp, United States Noblis Full time

    We are seeking a highly skilled Expert Spectrum and Surveillance Systems Engineer to join our team at Noblis, a leading provider of specialized engineering, acquisition, and program management services to the Federal Aviation Administration (FAA). This exciting opportunity is part of our ongoing efforts to advance the National Airspace System (NAS) and...


  • Egg Harbor Township, United States Noblis Full time

    About NoblisNoblis is a dynamic and innovative company that tackles the nation's toughest problems. We apply advanced solutions to our clients' most critical missions, bringing together the best of scientific thought, management, and engineering expertise.We work with a wide range of government clients in the defense, intelligence, and federal civil sectors,...


  • Pearl Harbor, United States U.S. Pacific Fleet, Commander in Chief Full time

    Job Summary: We are seeking a highly skilled Senior Mechanical Engineering Lead to join our team at U.S. Pacific Fleet, Commander in Chief.

  • Technical Specialist

    4 weeks ago


    Egg Harbor Twp, United States EVTKS Full time

    Benefits: 401(k) matching Dental insurance Health insurance Opportunity for advancement Vision insurance Benefits/Perks Competitive Compensation Career Growth Opportunities Job Summary As a Technical Specialist, you will be part of the Terminal Second Level Engineering (TSLE) System Engineering & Integration Team that handles the full System Test and...


  • Egg Harbor City, New Jersey, United States A3 Technology Full time

    About A3 TechnologyA3 Technology, Inc. is a leading provider of cutting-edge solutions in the field of process improvement.Job DescriptionWe are seeking a highly experienced Senior Process Optimization Expert to join our team in Egg Harbor Township, NJ. This position involves providing specialized expertise in process optimization supporting second-level...


  • Egg Harbor Twp, United States Thunderbolt Logistics Full time

    **Job Overview**We are seeking a highly skilled Quantitative Analysis Specialist to join our team at Thunderbolt Logistics. As a leading provider of innovative solutions for defense and commercial markets, we value transparency, innovation, collaboration, inclusion, and a learning mindset.As a Quantitative Analysis Specialist, you will play a crucial role in...


  • Bar Harbor, Maine, United States BETA Group, Inc. Full time

    About the RoleWe are seeking a Senior Water/Wastewater Project Engineer to join our team at BETA Group, Inc. The ideal candidate will lead technical design on concurrent projects, perform detailed engineering design, and provide responsive client service.Job ResponsibilitiesManage and oversee engineering design for water and wastewater treatment, conveyance,...


  • Fairport Harbor, Ohio, United States Corning Full time

    Company OverviewCorning is a leading innovator in materials science, driving progress in various industries and the world at large. Our commitment to purposeful invention enables us to solve complex challenges alongside our customers.SalaryThe estimated biweekly salary for this position is $1,635.00 - $3,185.00.Job DescriptionThis internship provides an...


  • Burns Harbor, United States Saxon Global Full time

    ONSITE - Burns Harbor, IndianaWork schedule: 8am-5pm, on call on occasions after hours or on weekend for emergency support As a Systems Integration Engineer, they would be responsible for and be involved in all technical aspects of the development, implementation, and support of messaging interfaces between various Information Technology (IT) platforms...


  • Egg Harbor City, New Jersey, United States Strongbridge LLC Full time

    Strongbridge LLC is a leading provider of IT services and engineering to the federal government. We are seeking an experienced Senior Network Engineer to join our team.The ideal candidate will have a strong background in network engineering, with expertise in designing and implementing network topologies, protocols, security, and connectivity. Experience...


  • EGG HARBOR, United States United Parcel Service Full time

    SHIFT YOUR FUTURE Seasonal Support Driver SHIFT YOUR TEAM Who exactly are UPS Seasonal Support Drivers? As a Seasonal Support Driver you’ll deliver packages throughout their communities, connecting with customers along the way while driving their own vehicle. This is a friendly, physically active crew who enjoy fast-paced work, being outdoors,...


  • EGG HARBOR, United States United Parcel Service Full time

    SHIFT YOUR FUTURE Seasonal Support Driver SHIFT YOUR TEAM Who exactly are UPS Seasonal Support Drivers? As a Seasonal Support Driver you’ll deliver packages throughout their communities, connecting with customers along the way while driving their own vehicle. This is a friendly, physically active crew who enjoy fast-paced work, being outdoors,...


  • Egg Harbor City, United States A3 Technology Full time

    A3 Technology, Inc. is seeking a senior level Process Improvement Specialist to join our team in Egg Harbor Township, NJ. This position provides specialized expertise in process improvement supporting the FAA second level engineering policies and processes. Essential Job Functions:Coordinate, plan and collect information on process management, process...