Data Engineering Lead

2 days ago

Charlotte, North Carolina, United States The Select Group Full time
Job Summary

As a Technical Lead - Data Engineer, you will be responsible for designing, developing, and implementing data solutions to empower our organization with actionable insights from complex datasets.

You will lead a team of data engineers, collaborate with cross-functional teams, and drive initiatives to strengthen our data infrastructure, CI/CD pipelines, and analytics capabilities.

Key Responsibilities:

  • Apply advanced knowledge of Data Engineering principles to design and implement data loading and aggregation frameworks.
  • Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing on cloud migration.
  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet product, engineering, and business needs.
  • Experience building enterprise systems using Databricks, Snowflake, and cloud platforms like Azure, AWS, and GCP.
  • Leverage strong Python, Spark, and SQL programming skills to construct robust pipelines for efficient data processing and analysis.
  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate data solution delivery.
  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
  • Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
  • Collaborate with data scientists, analysts, and stakeholders to understand business requirements and translate them into technical solutions.
  • Implement best practices for data governance, security, and compliance to ensure data asset integrity and confidentiality.

Requirements:

  • Bachelor's or master's degree in Computer Science, Engineering, or a related field.
  • Proven experience (9+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
  • Lead experience - previous experience leading at least one project end-to-end.
  • Strong proficiency in SQL, Python, and Spark programming languages.
  • Strong experience with cloud platforms like AWS, Azure, or GCP.
  • Hands-on experience with big data technologies like Hadoop, Spark, Kafka, and distributed computing frameworks.
  • Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, and Airflow.
  • Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
  • Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.
  • Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.
  • Relevant certifications (e.g., Azure, Databricks, Snowflake) are a plus.

The Select Group is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

  • Data Engineering Lead

    4 days ago

    Charlotte, North Carolina, United States HTC Global Services Full time

    Job Title: Technical Lead Engineer (Data)At HTC Global Services, we're seeking a highly skilled Technical Lead Engineer to join our team. As a key member of our data engineering team, you'll play a crucial role in designing, developing, and implementing data modernization projects.Key Responsibilities:Project Leadership: Lead cross-functional teams to ensure...

  • Data Engineering Lead

    4 days ago

    Charlotte, North Carolina, United States Ciber Full time

    As a Data Engineering Lead at HTC Global Services, you will be responsible for leading the design, development, and implementation of data modernization projects. You will coordinate with cross-functional teams to ensure project alignment with business goals and develop and maintain scalable data architectures. Your expertise in data engineering technologies...

  • Data Engineering Lead

    4 days ago

    Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Data Engineering LeadJob SummaryWe are seeking a highly skilled Data Engineering Lead to join our team at Insight Global. As a key member of our engineering team, you will be responsible for designing, developing, and implementing large-scale data engineering solutions using cloud technologies.Key Responsibilities* Lead complex technology...

  • Lead Data Engineer

    2 days ago

    Charlotte, North Carolina, United States American Red Cross Full time

    Job Title: Lead Data EngineerAre you passionate about data and analytics? Do you want to make a difference in the lives of others? We are seeking a Lead Data Engineer to join our Enterprise Data Analytics team at the American Red Cross.The successful candidate will be responsible for developing, testing, and maintaining our enterprise data warehouse system,...

  • Lead Data Engineer

    4 weeks ago

    Charlotte, North Carolina, United States WELLS FARGO BANK Full time

    About this RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Wells Fargo Bank. As a key member of our Enterprise Data Environment, you will play a critical role in supporting the IT Management Data Warehouse.Key ResponsibilitiesDesign and implement complex data solutions using Hadoop, Ab Initio, EXADATA, and Cloud-based...

  • Data Engineering Lead

    2 days ago

    Charlotte, North Carolina, United States Experis Full time

    Experis, a leading workforce solutions provider, is partnering with a prominent Financial Services organization to fill a contract position for a Big Data Engineer. The ideal candidate will assist the team in Charlotte, NC, with future onsite work required as per CDC and client guidelines. This 12-18 month engagement offers a unique opportunity to work with...

  • Data Engineering Lead

    3 days ago

    Charlotte, North Carolina, United States Experis Full time

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team at Experis. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Big Data tools and technologies such as Hive, Splunk, and ServiceNow.Key Responsibilities:- Design and develop data...

  • Lead Data Solutions Engineer

    2 days ago

    Charlotte, North Carolina, United States S&P Global Full time

    About the Role:We are seeking a highly skilled Lead Data Solutions Engineer to join our Advanced Analytics & Automation: Data Engineering team. As a key member of our team, you will play a critical role in developing solutions for the company, collaborating closely with Advanced Analytics & Automation to bring current high-profile initiatives to...

  • Azure Data Engineer Lead

    3 weeks ago

    Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Lead Azure Data EngineerJob Summary:We are seeking an experienced Lead Azure Data Engineer to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data solutions within Azure to empower our organization to derive actionable insights from intricate...

  • Data Architect and Engineering Lead

    3 weeks ago

    Charlotte, North Carolina, United States Finexio Full time

    Job OpportunityFinexio is seeking a highly skilled Data Architect and Engineering Lead to spearhead the design, development, and delivery of our data architecture and facilities, driving scalability and innovation. As a key member of our technology team, you will be responsible for crafting and implementing a strategy, designing the requisite data models and...

  • IT Lead Data Engineer

    4 weeks ago

    Charlotte, North Carolina, United States BrightSpeed Full time

    Job Title: IT Lead ETL EngineerWe are seeking an experienced IT Lead ETL Engineer to join our team at Brightspeed. As a key member of our Data Warehouse team, you will be responsible for designing and implementing ETL processes and controls to ingest, organize, and curate large volumes of data from various sources.Key Responsibilities:Design and implement...

  • IT Lead Data Engineer

    4 weeks ago

    Charlotte, North Carolina, United States BrightSpeed Full time

    Job Title: IT Lead ETL EngineerWe are seeking an experienced IT Lead ETL Engineer to join our team at Brightspeed. As a key member of our Data Warehouse team, you will be responsible for designing and implementing ETL processes and controls to ingest, organize, and curate large volumes of data from various sources.Key Responsibilities:Design and implement...

  • IT Lead Data Engineer

    1 month ago

    Charlotte, North Carolina, United States BrightSpeed Full time

    Job Title: IT Lead ETL EngineerWe are seeking an experienced IT Lead ETL Engineer to join our team at Brightspeed. As a key member of our Data Warehouse team, you will be responsible for designing and implementing ETL processes and controls to ingest, organize, and curate large volumes of data from various sources.Key Responsibilities:Design and implement...

  • Data Integration Specialist

    4 days ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data is seeking a highly skilled Data Integration Engineer to join our team. As a key member of our data integration team, you will design and implement solutions for integrating data from various sources into cloud-based systems.Key Responsibilities:Lead data integration efforts, designing, developing, and deploying complex data...

  • IT Lead Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States BrightSpeed Full time

    Job Title: IT Lead ETL EngineerWe are seeking an experienced IT Lead ETL Engineer to join our team at Brightspeed. As a key member of our Data Warehouse team, you will be responsible for designing and implementing ETL processes and controls to ingest, organize, and curate large volumes of data from various sources.Key Responsibilities:Design and implement...

  • Lead Data Quality Assurance Engineer

    6 days ago

    Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Lead Data Quality Assurance EngineerJob Summary:We are seeking a highly skilled Lead Data Quality Assurance Engineer to join our team at Insight Global. As a Lead Data Quality Assurance Engineer, you will be responsible for assisting in data improvement initiatives across the organization, working closely with data engineering, data analytics, and...

  • AWS Cloud Developer with Python and Data Integration

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Developer with expertise in Python, data integration, and ETL solutions to join our team at NTT DATA. As a key member of our Strategic Platform Engineering team, you will be responsible for designing and developing cloud-based data integration solutions that drive business value and innovation.Key...

  • Lead Information Security Architect

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    Job Title: Lead Information Security EngineerWe are seeking a highly skilled Lead Information Security Engineer to join our team in Charlotte, North Carolina. As a key member of our security team, you will be responsible for designing and implementing secure solutions for our cloud-based infrastructure.Key Responsibilities:Design and implement secure...

  • Data Architect and Engineering Lead

    4 days ago

    Charlotte, North Carolina, United States Finexio Full time

    Job DescriptionFinexio is revolutionizing the way businesses make and receive payments by integrating electronic payments and cash flow improvement solutions directly into customers' business process software.Our vision is a world where finance leaders only have to decide what to pay - Finexio's software seamlessly handles the how and when.As a Data...

  • AWS Cloud Developer with Python and Data Integration

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Developer with expertise in Python, GIT, Snowflake, and ETL to join our team in Charlotte, North Carolina. As a key member of our Strategic Platform Engineering team, you will be responsible for designing and developing data integration solutions on our cloud data warehouses and data lakes.Key...