Lead Data Engineer

1 month ago

Charlotte, United States Circle K Full time

Job Description:

As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities.

Responsibilities:

  • Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
  • Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
  • Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
  • Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc
  • Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
  • Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
  • Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
  • Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
  • Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
  • Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
  • Coaching and mentoring junior Data Engineers: Providing guidance, support, and technical expertise to junior members of the data engineering team.

Qualifications:

  • Bachelor's or master's degree in computer science, Engineering, or a related field.
  • Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
  • Strong proficiency in SQL, Python and Spark programming languages.
  • Strong experience with cloud platforms such as AWS, Azure, or GCP is a must.
  • Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.
  • Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.
  • Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
  • Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.
  • Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.
  • Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus.

#LI-KL1


Circle K is an Equal Opportunity Employer.
The Company complies with the Americans with Disabilities Act (the ADA) and all state and local disability laws. Applicants with disabilities may be entitled to a reasonable accommodation under the terms of the ADA and certain state or local laws as long as it does not impose an undue hardship on the Company. Please inform the Company's Human Resources Representative if you need assistance completing any forms or to otherwise participate in the application process.

Click below to review information about our company's use of the federal E-Verify program to check work eligibility:

In English

In Spanish

  • Lead Data Engineer

    4 days ago

    Charlotte, United States Forsyth Barnes Full time

    Title: Lead Data EngineerLocation: Charlotte, North CarolinaIndustry: RetailSalary: $180,000 + Bonus + BenefitsUnfortunately, at this time our client isn't accepting H1B, C2C or any other form of sponsorship.OverviewWe have partnered with a global retail organization searching for a Sr Data Engineering to join their growing team. As the focal point for...

  • Lead Data Engineer

    5 days ago

    Charlotte, United States Forsyth Barnes Full time

    Title: Lead Data EngineerLocation: Charlotte, North CarolinaIndustry: RetailSalary: $180,000 + Bonus + BenefitsUnfortunately, at this time our client isn't accepting H1B, C2C or any other form of sponsorship.OverviewWe have partnered with a global retail organization searching for a Sr Data Engineering to join their growing team. As the focal point for...

  • Java Lead Engineer

    3 weeks ago

    Charlotte, United States NTT DATA Full time

    Company Overview: Req ID: 284615 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Java Lead Engineer to join our team in Charlotte, North Carolina (US-NC), United States...

  • Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Python/PySpark) - Onsite to join our team in Charlotte, North Carolina (US-NC), United States (US). We are...

  • Lead Data Engineer

    1 week ago

    Charlotte, United States Akkodis Full time

    Akkodis is seeking a Lead Data Engineer for a contract to hire opportunity with a leading client located in Charlotte, NCLocation: Charlotte, NCPay Range: $70/hrDescriptionAs the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to...

  • Lead Data Engineer

    2 days ago

    Charlotte, United States akkodis Full time

    Akkodis is seeking a Lead Data Engineer for a contract to hire opportunity with a leading client located in Charlotte, NCLocation: Charlotte, NCPay Range: $70/hrDescriptionAs the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to...

  • Data Engineering Lead

    6 days ago

    Charlotte, United States The Brixton Group, Inc. Full time

    Duties & Responsibilities Responsible for leading the design, configuration, engineering, integration, and implementation of data platforms components and services and advise the engineering teams that work across Agile teams to design, develop, test, implement and support technical solutions across full-stack development tools and technologies. Deliver...

  • Data Engineering Lead

    2 days ago

    Charlotte, United States The Brixton Group, Inc. Full time

    Duties & ResponsibilitiesResponsible for leading the design, configuration, engineering, integration, and implementation of data platforms components and services and advise the engineering teams that work across Agile teams to design, develop, test, implement and support technical solutions across full-stack development tools and technologies.Deliver...

  • Data Engineering Lead

    1 week ago

    Charlotte, United States The Brixton Group, Inc. Full time

    Duties & ResponsibilitiesResponsible for leading the design, configuration, engineering, integration, and implementation of data platforms components and services and advise the engineering teams that work across Agile teams to design, develop, test, implement and support technical solutions across full-stack development tools and technologies.Deliver...

  • Data Engineering Lead

    1 week ago

    Charlotte, United States The Brixton Group, Inc. Full time

    Duties & ResponsibilitiesResponsible for leading the design, configuration, engineering, integration, and implementation of data platforms components and services and advise the engineering teams that work across Agile teams to design, develop, test, implement and support technical solutions across full-stack development tools and technologies.Deliver...

  • Lead Data Engineer

    4 days ago

    Charlotte, United States Virtual Full time

    Vaco is on the search for a global client for a Lead Data Engineer where you spearhead the design, development, and implementation of data solutions aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and...

  • Lead Data Engineer

    2 days ago

    Charlotte, United States Virtual Full time

    Vaco is on the search for a global client for a Lead Data Engineer where you spearhead the design, development, and implementation of data solutions aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and...

  • Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Python to join our team in Charlotte, South Carolina (US-SC), United States (US). Job...

  • Lead Data Engineer

    3 weeks ago

    Charlotte, United States Chatham Financial Full time

    Overview: We don't simply hire employees. We invest in them. When you work at Chatham, we empower you - offering professional development opportunities to help you grow in your career, no matter if you've been here for five months or 15 years. Chatham has worked hard to create a distinct work environment that values people, teamwork, integrity, and client...

  • Lead Data Engineer

    3 weeks ago

    Charlotte, United States Chatham Financial Full time

    Overview: We don't simply hire employees. We invest in them. When you work at Chatham, we empower you - offering professional development opportunities to help you grow in your career, no matter if you've been here for five months or 15 years. Chatham has worked hard to create a distinct work environment that values people, teamwork, integrity, and client...

  • Lead Data Engineer

    2 weeks ago

    Charlotte, United States Chatham Financial Full time

    Overview: We don't simply hire employees. We invest in them. When you work at Chatham, we empower you - offering professional development opportunities to help you grow in your career, no matter if you've been here for five months or 15 years. Chatham has worked hard to create a distinct work environment that values people, teamwork, integrity, and client...

  • Lead Data Engineer

    4 weeks ago

    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...

  • Lead Data Engineer

    3 weeks ago

    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...

  • Lead Data Engineer

    3 weeks ago

    Charlotte, United States Irvine Technology Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry) Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite) Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status) Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp) Required experience: Python, SQL, Databricks, Azure, Retail industry...

  • Lead Data Engineer

    7 days ago

    Charlotte, North Carolina, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...