Data Engineer

4 weeks ago

Charlotte, United States Clark Davis Associates Full time

*Must be US Citizen or GC holder

*No C2C

You Will:

  • Architect and develop data pipelines to optimize performance, quality, and scalability
  • Build, maintain & operate scalable, performant, and containerized infrastructure required for optimal extraction, transformation, and loading of data from various data sources
  • Design, develop, and own robust, scalable data processing and data integration pipelines using Python, dbt, Kafka, Airflow, PySpark, SparkSQL, and REST API endpoints to ingest data from various external data sources to Data Lake
  • Develop testing frameworks and monitoring to improve data quality, observability, pipeline reliability, and performance
  • Orchestrate sophisticated data flow patterns across a variety of disparate tooling
  • Support analytics engineers, data analysts, and business partners in building tools and data marts that enable self-service analytics
  • Partner with the rest of the Data Platform team to set best practices and ensure the execution of them
  • Partner with the analytics engineers to ensure the performance and reliability of our data sources
  • Partner with machine learning engineers to deploy predictive models
  • Partner with the legal and security teams to build frameworks and implement data compliance and security policies
  • Partner with DevOps to build IaC and CI/CD pipelines
  • Support code versioning and code deployments for data Pipelines

You Have:

  • 8+ years of professional experience designing, creating and maintaining scalable data pipelines using Python, API calls, SQL, and scripting languages
  • Demonstrated experience writing clean, efficient & well-documented Python code and are willing to become effective in other languages as needed
  • Demonstrated experience writing complex, highly optimized SQL queries across large data sets
  • Experience with Azure Cloud technologies
  • Experience with Databricks platform
  • Experience with data warehouses like BigQuery, Databricks, Snowflake, and Postgres
  • Experience building event streaming pipelines using Kafka/Confluent Kafka
  • Experience with modern data stack like Airflow/Astronomer, Databricks, dbt, Fivetran, Confluent, Tableau/Looker
  • Experience with containers and container orchestration tools such as Docker or Kubernetes
  • Experience with CI/CD (Jenkins, GitHub Actions, Circle CI)
  • Thorough understanding of SDLC and Agile frameworks

  • Data Engineer

    4 days ago

    Charlotte, United States LHH Full time

    **Must be local to Charlotte area for a weekly hybrid commute**LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing robust, scalable data solutions in Azure Cloud environments.Responsibilities:Design,...

  • Data Engineer

    4 days ago

    Charlotte, United States LHH Full time

    **Must be local to Charlotte area for a weekly hybrid commute**LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing robust, scalable data solutions in Azure Cloud environments.Responsibilities:Design,...

  • Data Engineer

    5 days ago

    Charlotte, United States LHH Full time

    **Must be local to Charlotte area for a weekly hybrid commute**LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing robust, scalable data solutions in Azure Cloud environments.Responsibilities:Design,...

  • Data Engineering Manager

    4 weeks ago

    Charlotte, United States Trilogy International Full time

    Data Engineering Manager required for high-growth InsurTechMust be based in greater Charlotte, NC area (or willing to relocate) $180-200k base + Bonus + Benefits US Citizens/Green Card Holders invited to applyThe CompanyOur client is a dynamic and innovative organization at the forefront of revolutionizing the insurance industry. Their mission is to leverage...

  • Data Engineering Manager

    4 weeks ago

    Charlotte, United States Trilogy International Full time

    Data Engineering Manager required for high-growth InsurTechMust be based in greater Charlotte, NC area (or willing to relocate) $180-200k base + Bonus + Benefits US Citizens/Green Card Holders invited to applyThe CompanyOur client is a dynamic and innovative organization at the forefront of revolutionizing the insurance industry. Their mission is to leverage...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States Judge Consulting Group Full time

    Job Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States Judge Consulting Group Full time

    Job Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...

  • Data Engineering Manager

    4 days ago

    Charlotte, North Carolina, United States Mediavine Full time

    Mediavine is seeking an Engineering Manager to join our Data & Analytics Team to lead our data engineering efforts, focused on delivering impactful and innovative solutions in the Ad Tech Industry. This role is ideal for leaders enthusiastic about driving meaningful change and shaping the future of our technology, who embrace change and demand...

  • Data Engineer

    2 weeks ago

    Charlotte, United States PamTen Full time

    Experience in Data Warehouse related projects in product or service-based organization • Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) • A deep expertise in your field of Software Engineering • Expert at troubleshooting complex system and application stacks • Operational Experience in Big Data...

  • Data Engineer

    4 weeks ago

    Charlotte, United States Infinicsinc.com Full time

    Bachelors' degree in Computer Science Engineering Information Technology or related area 7+ years' experience on ETL Development Tools Spark / Java (preferred) Python Ab Initio Informatica Advanced experience & demonstrated proficiency in Spark. Experience with Apache Beam Cloud Data Flow Dataproc Cloud Composer and Big Query 3+ years'...

  • Data Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Infinicsinc Full time

    Bachelors' degree in Computer Science Engineering Information Technology or related area 7+ years' experience on ETL Development Tools Spark / Java (preferred) Python Ab Initio Informatica Advanced experience & demonstrated proficiency in Spark. Experience with Apache Beam Cloud Data Flow Dataproc Cloud Composer and Big Query 3+ years' experience in Big Data...

  • Sr. Data Engineer

    2 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Sr. Data Engineer Charlotte, NC onsite We are looking for a highly capable Data Engineer who has experience in building end-to-end systems Roles & Responsibilities : Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK. Define and setup development, test,...

  • Data Engineer

    2 weeks ago

    Charlotte, United States Belk, Inc. & Belk eCommerce LLC Full time

    EDW Data Engineer is responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. Creates pipelines that convert raw data into usable formats for data scientists and other data consumers to utilize. Builds and leverages information loaded into the Belk Enterprise Data Warehouse (EDW)...

  • Big Data Engineer

    2 days ago

    Charlotte, North Carolina, United States Emblue Full time

    Responsibilities Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems. Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers analyzes synthesizes and develops visualizations...

  • Senior Data Engineer

    7 days ago

    Charlotte, United States Experis Full time

    Our client, [Industry Descriptor] is seeking a [Job Title] to join their team. As a [Job Title], you will be part of the [Department Name] supporting [Team Name(s)]. The ideal candidate will have [Soft Skill 1], [Soft Skill 2] and [Soft Skill 3] which will align successfully in the organization. Job Title: Data Engineer Location: Charlotte, NC Job...

  • GCP Data Engineer

    1 day ago

    Charlotte, United States Capgemini Full time

    Job Title :: GCP Data EngineerJob Location:: Charlotte , NCJob Description::Responsibilities::Develop complex data pipelines to support data initiativesDevelop reusable framework based data ingestion and transformation capabilities to rapidly design and deploy data pipelinesDesign build test and deploy new libraries frameworks or full systems for our core...

  • GCP Data Engineer

    2 weeks ago

    Charlotte, United States Capgemini Full time

    Job Title :: GCP Data EngineerJob Location:: Charlotte , NCJob Description::Responsibilities::Develop complex data pipelines to support data initiativesDevelop reusable framework based data ingestion and transformation capabilities to rapidly design and deploy data pipelinesDesign build test and deploy new libraries frameworks or full systems for our core...

  • Data Engineering Architect

    2 weeks ago

    Charlotte, United States Incedo Inc. Full time

    Job Title: Data Engineering Architect / DirectorJob Location: Charlotte, NCJob Type: Full TimePosition Overview:We are seeking a skilled and experienced Data Engineering Leader to join our team. The ideal candidate will have expertise in data streaming technologies, particularly Kafka, Kinesis and glue, and a strong background in the wealth management or...

  • Data Engineering Architect

    2 weeks ago

    Charlotte, United States Incedo Inc. Full time

    Job Title: Data Engineering Architect / DirectorJob Location: Charlotte, NCJob Type: Full TimePosition Overview:We are seeking a skilled and experienced Data Engineering Leader to join our team. The ideal candidate will have expertise in data streaming technologies, particularly Kafka, Kinesis and glue, and a strong background in the wealth management or...

  • Data Engineering Architect

    2 weeks ago

    Charlotte, United States Incedo Inc. Full time

    Job Title: Data Engineering Architect / DirectorJob Location: Charlotte, NCJob Type: Full TimePosition Overview:We are seeking a skilled and experienced Data Engineering Leader to join our team. The ideal candidate will have expertise in data streaming technologies, particularly Kafka, Kinesis and glue, and a strong background in the wealth management or...