Azure Data Engineer, Lead

3 days ago


Egg Harbor, United States Spencer's Full time

Responsibilities


The Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.

  • Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverables
  • Gather, document, promote, enforce, and maintain relevant data engineering best practices
  • Design, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance team
  • Perform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvements
  • Partner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirements
  • Work with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systems
  • Assist the development and architecture teams on data quality and various POC initiatives


Qualifications


  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data Engineering
  • At least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data sets
  • At least three years of experience working in Azure and Databricks technology
  • Working SQL knowledge and experience with relational databases, query authoring (SQL)
  • Working knowledge performing root cause analysis on internal and external data processing related issues
  • Understanding processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Knowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databases
  • Knowledge of object-oriented/object function scripting languages: Python, Java, etc.


  • Lead Data Engineer

    9 months ago


    Egg Harbor, United States SPENCER'S GIFTS Full time

    ResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with...

  • Cloud Data Architect

    2 weeks ago


    Egg Harbor City, New Jersey, United States Spencer's Full time

    At Spencer's, we're seeking a seasoned Cloud Data Architect to lead our data engineering efforts. As the Lead Data Engineering Specialist, you'll be responsible for designing and managing algorithms and pipelines in collaboration with diverse teams.The ideal candidate will have at least eight years of experience in designing, building, and optimizing data...


  • Egg Harbor Twp, United States ASRC Federal Holding Company Full time

    The ASRC Federal Holding Company is looking for an experienced Electrical Engineering Technician to support their Terminal Flight Data Manager (TFDM) team at the William J Hughes Technical Center in Egg Harbor Township, NJ. The ideal candidate will possess skills in C/C++, Unix, LINUX, Solaris, CISCO, IOS, and proficiency with computer networks, TCP/IP,...


  • Palm Harbor, Florida, United States GEOGRAPHIC SOLUTIONS INC Full time

    Estimated salary range $110,000 - $140,000 per year.About the RoleGEOGRAPHIC SOLUTIONS INC is seeking a highly skilled Systems Engineer to join our Operations team. As part of this role, you will be responsible for providing data center and systems support for our Software as a Service (SaaS) Microsoft Windows, VMware, and hybrid Storage Area Network (SAN)...

  • Civil Engineer Lead

    2 weeks ago


    Bar Harbor, Maine, United States ExecuSource Full time

    About the RoleAs a seasoned Civil Engineer with a focus on stormwater management, you will play a key role in shaping the future of infrastructure projects in New England. Join ExecuSource, one of the region's most respected engineering firms, and collaborate with industry-leading experts on high-impact initiatives serving public-sector clients.Job...


  • Benton Harbor, Michigan, United States Gaishin Manufacturing Inc Full time

    Job Overview: As a Precision Engineering Lead at Gaishin Manufacturing Inc., you will play a key role in the development and implementation of precision engineering processes and systems. You will work closely with cross-functional teams to ensure that products meet established quality standards and specifications.Responsibilities:Developing and implementing...


  • Egg Harbor Township, United States Strongbridge LLC Full time

    Strongbridge, LLC is seeking a highly experienced Senior Network Engineer to join its growing contract supporting a federal government agency. The government customer requires the expertise of an experienced Senior Network Engineer to support its multiple networking initiatives across all areas of the division. Specifically, the government customer is...


  • Cold Spring Harbor, New York, United States Crossfire Consulting Full time

    Data Science Infrastructure Engineer PositionCrossfire Consulting is looking for a skilled Data Science Infrastructure Engineer to enhance our HPC capabilities in Cold Spring Harbor, NY.Job Description:As a key member of our technology organization, you will be responsible for optimizing and maintaining our NVIDIA GPU-based high-performance computing...


  • Palm Harbor, Florida, United States GEOGRAPHIC SOLUTIONS INC Full time

    We are looking for a Senior QA Engineer for Data Analytics who can take ownership of our testing process and ensure the highest quality products are delivered to our clients. In this role, you will plan, design, maintain and execute test cases with minimal direction.You will have the opportunity to work on a variety of projects, from planning to execution,...

  • Software Engineer

    2 months ago


    Egg Harbor Twp, United States Signature Science Full time

    Position Purpose: The primary purpose of this position is to develop and maintain software tools used for applied research projects in the Atlantic City Operation. Essential Duties and Responsibilities: * Develops software using LabVIEW, Visual Basic for Applications (VBA), Python, and C#, to fulfill the needs of government-based projects. * Develops data...


  • Pearl Harbor, United States Booz Allen Hamilton Full time

    Job Number: R0195717Data Architect, Senior The Opportunity: For an organization to transform in today's digital world, it needs to properly collect, store, and organize its data. Effective data management can enable more efficient operations, yielding more growth. As a senior data architect, you know how to apply your creative thinking and analytical mindset...

  • Program Manager

    4 weeks ago


    Egg Harbor, United States The Judge Group Full time

    Our Client is seeking a Senior Program Manager to support our FAA contract in Egg Harbor Township, NJ. What you will be doing:Second Level Engineering Support: (Hardware software, ongoing sustainment, 22, 30/40 year old radar systems. Windows 3.1 terminals. Cobalt program, Critically dependent on these experts to keep them up and running so that planes fly...


  • Oak Harbor, Washington, United States Northrop Grumman Full time

    **Job Overview**We are seeking a highly skilled Senior Engineering Manager to lead our MRB Liaison Engineering team.As a leader, you will manage the functional engineering activities of a team of Liaison Engineers and be responsible for design product integrity, process adherence, staffing, training, and tools.The ideal candidate will have a strong...


  • Egg Harbor Twp, United States ASRC Federal Holding Company Full time

    Software Developer/Adapter William J Hughes Technical Center, Egg Harbor Township, NJ, USA Req #649 Monday, December 23, 2024 ASRC Federal Technical Services is seeking a Software Developer/Adapter to join our Terminal Flight Data Manager (TFDM) team that supports the Federal Aviation Administration (FAA) in Egg Harbor Township, NJ. Terminal Flight Data...


  • Egg Harbor Twp, United States ASRC Federal Holding Company Full time

    As a Communication Systems Developer at ASRC Federal Holding Company, you will play a key role in planning, designing, developing, acquiring, installing, integrating, and implementing complex communication systems that accommodate specific user requirements. You will interpret and analyze complex information systems data to develop security-related technical...


  • Bar Harbor, Maine, United States Prysmian Group Full time

    Job OverviewPrysmian Group, a global leader in the energy and telecom cable systems industry, is seeking a skilled Manufacturing Process Engineer to join our team. As a key member of our engineering department, you will play a crucial role in improving process efficiency and ensuring quality standards are met.ResponsibilitiesLead and implement process...


  • Egg Harbor Twp, United States ASRC Federal Holding Company Full time

    Job OverviewASRC Federal Holding Company is seeking a skilled Technical Operations Specialist to join their team in Egg Harbor Township, NJ. The successful candidate will be responsible for providing expertise in a specific technical area defined by the government.Estimated Salary: $120,000 - $180,000 per yearKey Responsibilities:Provide expertise in a...


  • Egg Harbor Township, United States ASRC Federal Holding Company Full time

    ASRC Federal Technical Services is seeking a Process Improvement Specialist to join our Automated Weather Observing System (AWOS) Data Acquisition System (ADAS) team that supports the Federal Aviation Administration (FAA) in Egg Harbor Township, NJ. ADAS utilizes sensors that detect lightning data strikes at Air Route Traffic Control Centers (ARTCCs). This...


  • Bar Harbor, Maine, United States Spyglass , Inc. Defunct Full time

    About the Position:Spyglass, Inc. Defunct is seeking a highly skilled Azure AI Architect to lead the development of innovative AI solutions using Azure AI Services. As an Azure AI Architect, you will be responsible for designing and implementing AI-driven applications that meet the needs of our clients.Responsibilities:Lead the development of AI-powered...


  • Palm Harbor, Florida, United States GEOGRAPHIC SOLUTIONS INC Full time

    About the RoleWe are seeking an experienced Security Architect Lead to join our team at GEOGRAPHIC SOLUTIONS INC. The ideal candidate will possess strong leadership skills, excellent technical knowledge, and a passion for security architecture.Job SummaryThe Security Architect Lead will be responsible for designing, implementing, and maintaining our...