Lead Data Engineer

2 months ago


Atlanta, United States Seneca Resources Full time

One of our top clients is hiring a Lead Data Engineer:


The Lead Data Engineer is responsible for managing and organizing enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated and stored for optimal use by the organization. Lead Data Engineers will support other Data Engineers, Data Architects, and Data Analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They will drive standardization and reduce effort through automation.


Essential Duties

  • Lead a team of engineers through architecture, design, demand delivery, code reviews, release management, implementation, presentations, and meetings.
  • Mentor fellow data engineers and contribute to ongoing process improvements for the team.
  • Evaluate business needs and objectives and align architecture/designs with business requirements
  • Build the data pipelines required for the optimal extraction, transformation, integration and loading of raw data from a wide variety of data sources
  • Assemble large, complex data sets and model our data in a way that meets functional / non-functional business requirements
  • Create data tools for analytics team members that assist them in generating innovative industry insights that provide our business a competitive advantage
  • Implement data tagging mechanisms and metadata management so data is accurately classified and visible to the organization
  • Build processes to help identify and improve data quality, consistency and effectiveness
  • Ensure our data is managed in a way that it conforms to all information privacy and protection policies
  • Use agile software development processes to iteratively make improvements to our data management systems
  • Identify opportunities for automation
  • Be an advocate for best practices and continued learning


Requirements

  • Bachelor's/Tech School degree in Computer Science, MIS or Engineering or relevant technical field and/or commensurate years of real-world experience in software engineering.
  • 7+ years of relevant experience in data management
  • 5+ years in data engineering with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT
  • 3+ years of experience with Cloud based DW such as Redshift, Snowflake etc.
  • Technical expertise with data models, data mining, and segmentation techniques
  • Experience in data acquisition, transformation and storage design using design principles, patterns and best practices
  • Experience with performance analysis and optimization
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
  • Experience with data pipeline and workflow management tools
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Modern data platforms, Snowflake, dbt, Fivetran and Airflow.
  • Experience with stream-processing systems: Kafka, Storm, Spark-Streaming, etc. Data engineering certification is a plus.


About Seneca Resources:

Seneca Resources is a client driven provider of strategic Information Technology consulting services and Workforce Solutions to government and industry. Seneca Resources is a leading IT services provider with offices in Virginia, Alabama, Georgia, Florida and Texas that service clients throughout the United States.

We are an Equal Opportunity Employer and value the benefits of diversity in our workplace.


  • Lead Data Engineers

    3 weeks ago


    Atlanta, United States NasTech Global, Inc. Full time

    Role: Lead Data Engineer Location: Atlanta, GA (4 days onsite) Duration: Direct Hire Citizenship: US holder Top Skills: Hands on experience with Snowflake, Bachelors' in Technical field or over 12 years of Software Engineer experience, ETL, AWS The Lead Data Engineer is responsible for managing and organizing enterprise data and overseeing the technical...

  • Lead Data Engineer

    2 months ago


    Atlanta, United States Seneca Resources Full time

    One of our top clients is hiring a Lead Data Engineer:The Lead Data Engineer is responsible for managing and organizing enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated and stored for optimal use by the organization. Lead...

  • Lead Data Engineer

    3 weeks ago


    Atlanta, Georgia, United States NasTech Global, Inc. Full time

    Job Title: Lead Data EngineerJob Summary: We are seeking a highly skilled Lead Data Engineer to join our team at NasTech Global, Inc. The successful candidate will be responsible for managing and organizing enterprise data, overseeing the technical output of a team of data engineers, and architecting and designing data pipelines.Key Responsibilities:Lead a...


  • Atlanta, Georgia, United States Booz Allen Hamilton Full time

    Job Title: Data Engineering LeadAbout the Role:Booz Allen Hamilton is seeking a Data Engineering Lead to join our team. As a Data Engineering Lead, you will be responsible for leading data engineering activities on mission-driven projects. You will oversee the development and deployment of pipelines and platforms that organize and make disparate data...

  • Data Engineering Lead

    2 weeks ago


    Atlanta, Georgia, United States ATech Placement Full time

    We are seeking a highly skilled Data Engineering Lead to join our team at ATech Placement. As a key member of our engineering team, you will play a critical role in designing, developing, and optimizing our data pipelines and databases.You will lead the technical development of complex data solutions, ensuring they meet high standards of performance,...

  • Lead Data Engineer

    2 weeks ago


    Atlanta, Georgia, United States Capital One Full time

    Job Title: Lead Data EngineerCapital One is seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design and develop technical...

  • Data Engineering Lead

    2 weeks ago


    Atlanta, Georgia, United States Diverse Lynx Full time

    Job Title: Data Engineering LeadJob Summary:We are seeking a highly skilled Data Engineering Lead to join our team at Diverse Lynx LLC. As a key member of our Enterprise Data and Analytics team, you will be responsible for driving the design and development of analytical data pipelines. Your expertise will help us build a robust and scalable data...

  • Data Engineer

    1 week ago


    Atlanta, Georgia, United States iVoyant Full time

    About the RoleiVoyant is seeking a highly skilled Data Engineer to join our Digital Team. The successful candidate will work closely with functional SMEs to understand requirements and develop technical designs.Key Responsibilities Ensure data availability and validity to meet business rules Create and maintain data mappings, logical and physical data...

  • Lead Data Engineer

    1 week ago


    ATLANTA, United States Capital One Careers Full time

    Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...


  • Atlanta, Georgia, United States Elevance Health Full time

    Job Title: Cloud Data Engineer Senior LeadAt Elevance Health, we are seeking a highly skilled Cloud Data Engineer Senior Lead to join our team. This role will be responsible for leading the end-to-end application system development and maintenance on large complex enterprise-wide technology platforms.The ideal candidate will have a strong background in cloud...


  • Atlanta, Georgia, United States Chick-fil-A Full time

    Job SummaryWe are seeking a highly skilled Sr. Lead Data Engineer to join our team at Chick-fil-A. As a key member of our Supply Chain Data Analytics team, you will be responsible for leading complex project work and collaborating with cross-functional teams to design, implement, and maintain analytics infrastructure.Key Responsibilities:Exhibit wide...

  • Data Engineer Lead

    2 weeks ago


    Atlanta, Georgia, United States GovCIO Full time

    Job DescriptionGovCIO is seeking a highly skilled Technical Lead Data Engineer to join our team. As a key member of our ETL team, you will be responsible for ingesting and visualizing data from various sources, identifying deviations in normalization, and developing predictive and descriptive models to drive business decisions.Key Responsibilities:Extract,...


  • Atlanta, United States Elevance Health Full time

    Lead Cloud Data Engineer Senior Location: This position will work a hybrid model (remote and in office 1 -2 days per week). Ideal candidates will live within 50 miles of one of our Pulse Point locations in Indianapolis, IN, Grand Prairie, TX, Atlanta, GA, Richmond, VA or Chicago, IL. Alternate locations may be considered. A proud member of the Elevance...


  • Atlanta, United States Engineer Up Full time

    About Us: Engineer Up is on a mission to disrupt how good, hard-working people advance their careers in tech. We partner with Fortune 500 companies to deliver customized IT consulting services spanning from software development to digital transformation. Position: Senior Principal Software EngineerEmployer: Engineer UpLocation: RemoteRole: ConsultantPosition...


  • Atlanta, United States Smart IT Frame LLC Full time

    Hello Professionals,We are looking for a Lead Data Engineer for a contract opportunity at Frisco, TX and Atlanta, GA. Please find the below job description and apply for the job if you are interested.Role: Lead Data Engineer Location: Frisco, TX, Atlanta, GAHiring mode: Long term ContractMandatory skills: Azure Services, Azure Data Bricks, Python, Azure Data...


  • Atlanta, United States Smart IT Frame LLC Full time

    Hello Professionals,We are looking for a Lead Data Engineer for a contract opportunity at Frisco, TX and Atlanta, GA. Please find the below job description and apply for the job if you are interested.Role: Lead Data Engineer Location: Frisco, TX, Atlanta, GAHiring mode: Long term ContractMandatory skills: Azure Services, Azure Data Bricks, Python, Azure Data...


  • Atlanta, United States Smart IT Frame LLC Full time

    Hello Professionals,We are looking for a Lead Data Engineer for a contract opportunity at Frisco, TX and Atlanta, GA. Please find the below job description and apply for the job if you are interested.Role: Lead Data Engineer Location: Frisco, TX, Atlanta, GAHiring mode: Long term ContractMandatory skills: Azure Services, Azure Data Bricks, Python, Azure Data...


  • Atlanta, United States Wolters Kluwer DXG U.S., Inc. Full time

    Wolters Kluwer Tax & Accounting is looking for a Lead Data Engineer. The position can be remote. As a Lead Data Engineer , this position will support the building of data pipelines for the Azure cloud data platform. The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data...

  • Data Engineer

    2 weeks ago


    Atlanta, Georgia, United States iVoyant Full time

    About the JobiVoyant is seeking a highly skilled Data Engineer to join our Digital Team. The successful candidate will work closely with functional SMEs to understand business requirements and develop technical designs.The Data Engineer will be responsible for ensuring data availability and validity, creating and maintaining data mappings, and developing...


  • Atlanta, Georgia, United States Diverse Lynx Full time

    Data Engineering Role:Hadoop PySpark Technical Lead required to manage and develop data pipelines and ETL solutions using Apache Spark, Python, and Kafka targeting Cloudera Data Platform.Key Responsibilities:Design, develop, and schedule data pipelines that handle large volumes of data within SLA.Work with Data Analysts, Business Users, and Solution...