Lead Data Engineer

1 month ago

Atlanta, United States Spartan Technologies Full time

We are seeking a Technical Lead Data Engineer (located in Atlanta, GA or willing to relocate) that has the skills to bring substantial experience in Data Solutions in order to help unlock the power of our data for the Company's Stakeholders. In this role, you will handle the increasing complexity and demand for data from various sources, enabling business to make informed decisions. You will also provide technical leadership to team of ETL developers in designing and implementing a cutting-edge data platform and pipelines. This position includes Technical Data leadership that includes working closely with business analysts and stakeholders in other departments to identify, recommend, develop, implement, and support data solutions.


Key Responsibilities (Essential Duties and Functions)

  • Effectively communicate complex technical concepts to business stakeholders, helping them understand the development process and set realistic expectations.
  • Offer guidance and recommendations to the development team, stakeholders based on best practices and industry trends and maximize the return on the investment.
  • Clarify/translate requirements, data strategy into Epics/Stories & remove ambiguity and provide accurate estimates of the time and resources needed to complete tasks.
  • Anticipate potential challenges or edge cases, addressing them before they escalate into significant issues.
  • Collaborate between business stakeholders and development teams, ensuring everyone s input is considered, and the project stays on track.
  • Lead the design and implementation of the data & analytics architecture ensuring compliance, quality and a sustainable growth of the platform.
  • Mentor and train other data team members and business users as needed.
  • Build scalable data pipelines to integrate and model datasets from different sources that meet functional and non-functional requirements.
  • Provide the technology, the tools and data to support enterprise-wide reporting, analytics, data science and self-service need.
  • Delegating tasks and work with the technical team to achieve established timeline.
  • Ensure the data quality by implementing and monitoring a data quality framework together with the data source teams.
  • Formulate and complete end-to-end analysis that includes data gathering, analysis, ongoing scaled deliverables, and presentations.
  • Help to grow our data team with right talents.



Qualifications

  • Master or Bachelor s Degree in Engineering/Computer related discipline, or equivalent experience required
  • 10+ years of ETL / ELT Design, development and implementation experience using standard ETL/ ELT tool
  • 10+ years of SQL Development Experience
  • 7+ years of experience defining and managing ETL / ELT using tools and industry standard practices.
  • 3+ years of Cloud (Azure preferred) experience
  • 3+ years of Snowflake (must have) experience
  • Fivetran is preferred
  • dbt Cloud is nice to have
  • 3+ years of SQL Server Reporting Services (nice to have)
  • 2+ years of experience leading, coaching, and providing mentorship to ETL developers in an agile environment.
  • Hands-on and deep experience using Star/Snowflake for schema design, data modeling, data pipelines.


Skills and knowledge

  • Advanced knowledge of SQL databases and queries.
  • Advanced knowledge of CDC (Change Data Capture) & CT (Change Tracking) inner workings.
  • Experience in implementing and supporting several different ETL / ELT solutions.
  • Experience in working with many different data sets, large and small.
  • Experience working with data in multiple ERP and data movement technologies.
  • Experience with normalizing and de-normalizing data and creating different fit-for-purpose data model.
  • Knowledge of ETL best practices and standards.
  • Ability to quickly resolve issues.
  • Experience with Cloud (Azure - nice to have), Snowflake, SQL Server 2014 SQL Server 2019 , SQL Server Reporting Services , SQL Server Integration Services.
  • Ability to present ideas in concise, business-friendly and user-friendly language.
  • Excellent written, interpersonal and verbal communication skills.
  • Experience with managing and collaborating with multidisciplinary teams.
  • Experience with design and development of EDW (Enterprise Data warehouse) is preferred.
  • Experience with Data Lakehouse, Data Fabric architecture framework is preferred.

  • Lead Data Engineer

    4 days ago

    Atlanta, United States Seneca Resources Full time

    One of our top clients is hiring a Lead Data Engineer:The Lead Data Engineer is responsible for managing and organizing enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated and stored for optimal use by the organization. Lead...

  • Lead Data Engineer

    5 days ago

    Atlanta, United States Seneca Resources Full time

    One of our top clients is hiring a Lead Data Engineer:The Lead Data Engineer is responsible for managing and organizing enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated and stored for optimal use by the organization. Lead...

  • Lead Data Engineer

    4 weeks ago

    Atlanta, United States Incedo Inc. Full time

    Lead Data Engineer- data vaultJob Location: Atlanta, GA/Encino, CA (Hybrid)Role Description:As a Senior Technical Lead –Data Modeling at Incedo, you will be responsible for managing and optimizing the data infrastructure, including data modeling and data warehouse solutions using the Data Vault methodology, ensuring its performance, scalability, and...

  • Lead Data Engineer

    4 weeks ago

    Atlanta, United States Incedo Inc. Full time

    Lead Data Engineer- data vaultJob Location: Atlanta, GA/Encino, CA (Hybrid)Role Description:As a Senior Technical Lead –Data Modeling at Incedo, you will be responsible for managing and optimizing the data infrastructure, including data modeling and data warehouse solutions using the Data Vault methodology, ensuring its performance, scalability, and...

  • Data Engineer

    5 months ago

    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    5 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Lead Data Software Engineer

    3 days ago

    Atlanta, Georgia, United States Chick-fil-A, Inc. Full time

    About the RoleChick-fil-A, Inc. is seeking a highly skilled Lead Data Software Engineer to lead a strong team of data engineers responsible for the development, management, and support of our Customer 360 data systems.Key ResponsibilitiesSteward the organization's customer data into a single source of truth that's both searchable and accessible.Design,...

  • Azure Data Engineer/Data Governance Lead

    1 month ago

    Atlanta, United States STONE Resource Group Full time

    This is a fulltime position in Atlanta, GA or Kansas City. This role is NOT open to C2C, OPT, or VISA consideration. No vendor support allowed or needed!Your Responsibilities:Responsible for developing, operating and maintaining the Access Management systems globally across Data platformsResponsible to Recommend, implement and maintain appropriate tools/tech...

  • Azure Data Engineer/Data Governance Lead

    1 month ago

    Atlanta, United States STONE Resource Group Full time

    This is a fulltime position in Atlanta, GA or Kansas City. This role is NOT open to C2C, OPT, or VISA consideration. No vendor support allowed or needed!Your Responsibilities:Responsible for developing, operating and maintaining the Access Management systems globally across Data platformsResponsible to Recommend, implement and maintain appropriate tools/tech...

  • Lead Product Software Engineer | Lead Data Engineer | Azure Data Architecture | Solution Architecture

    4 months ago

    Atlanta, United States Wolters Kluwer DXG U.S., Inc. Full time

    Wolters Kluwer Tax & Accounting is looking for a Lead Data Engineer. The position can be remote. As a Lead Data Engineer , this position will support the building of data pipelines for the Azure cloud data platform. The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data...

  • Systems Engineer

    2 weeks ago

    Atlanta, United States NTT DATA Full time

    Company Overview: Req ID: 24-02313 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineer to join our team in Atlanta, Georgia (US-GA), United States (US). Job...

  • Lead Service Engineer

    3 weeks ago

    Atlanta, United States Informatik Data Solutions Inc. Full time

    Role: Lead Services EngineerLocation: Hybrid in Atlanta, GA - 3 days in a week officeDuration: Long termPosition Description:The Lead Services Engineer is responsible for technical leadership for building and managing APIs that support our Digital Apps, In-store integrations, payments, etc. Responsible for discovery, design, development and lifecycle...

  • Lead Service Engineer

    3 weeks ago

    Atlanta, United States Informatik Data Solutions Inc. Full time

    Role: Lead Services EngineerLocation: Hybrid in Atlanta, GA - 3 days in a week officeDuration: Long termPosition Description:The Lead Services Engineer is responsible for technical leadership for building and managing APIs that support our Digital Apps, In-store integrations, payments, etc. Responsible for discovery, design, development and lifecycle...

  • Lead Data Architect

    40 minutes ago

    Atlanta, Georgia, United States Seneca Resources Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Seneca Resources. As a key member of our organization, you will be responsible for managing and organizing enterprise data, overseeing the technical output of a team of data engineers, and driving standardization and automation.Key ResponsibilitiesTeam Leadership: Lead a...

  • Data Analytics Lead

    2 months ago

    Atlanta, Georgia, United States Karna LLC Full time

    Join our team as a Data Analytics Lead, where you'll oversee a team of experts, manage day-to-day operations, and spearhead innovation in data analytics. With your leadership, we'll drive data-driven decision-making, optimize data infrastructure, and unlock transformative insights. If you're passionate about shaping the future of data capabilities, apply...

  • Data Analytics Lead

    4 weeks ago

    Atlanta, Georgia, United States Karna LLC Full time

    Join our team as a Data Analytics Lead, where you'll oversee a team of experts, manage day-to-day operations, and spearhead innovation in data analytics. With your leadership, we'll drive data-driven decision-making, optimize data infrastructure, and unlock transformative insights. If you're passionate about shaping the future of data capabilities, apply...

  • Data Engineering Lead

    3 months ago

    Atlanta, United States Further Full time

    Job DescriptionJob DescriptionWE'RE HIRING! If you love data and are looking for unlimited growth opportunities, we want to talk with you about joining Further. Further is a data, cloud, and AI company whose focus is helping companies turn raw data into the right decisions. We have an award winning culture of extraordinary people. Our purpose is to...

  • Data Engineer

    1 month ago

    Atlanta, Georgia, United States iVoyant Full time

    About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team.The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design.They will ensure the availability and validity of the data to ensure that it fits with the...

  • Data Engineer

    2 weeks ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    2 weeks ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...