Senior Data Engineer

17 hours ago

Fort Mill, South Carolina, United States Spark Tek Management Consulting LLC Full time

Job Title:
Senior Data Engineer (Snowflake & ML)

Location:
Fort Mill, SC

Experience Required:
13+ years

Role Overview

We are seeking a highly skilled
Senior Data Engineer
with extensive experience in Snowflake and Machine Learning (ML) to design, implement, and optimize data pipelines and intelligent automation solutions. The ideal candidate will have strong expertise in Snowflake, Python, and ML pipeline deployment, as well as hands-on exposure to emerging LLM frameworks and AI-driven automation.

Key Responsibilities

  • Lead the design and development of scalable
    data pipelines
    and
    ETL/ELT workflows
    on Snowflake.
  • Implement and optimize
    Snowflake architectures
    with Snowpark and advanced SQL techniques.
  • Build, deploy, and manage
    end-to-end ML pipelines
    using frameworks such as
    scikit-learn, TensorFlow, MLflow, or SageMaker
    .
  • Integrate and operationalize
    Large Language Models (LLMs)
    using frameworks like
    LangChain, Hugging Face, and OpenAI
    .
  • Drive
    LLM-based automation
    leveraging
    AWS Bedrock + Claude Sonet
    for intelligent workflows.
  • Ensure data quality, governance, and observability across platforms.
  • Collaborate with cross-functional teams (data scientists, ML engineers, business analysts) to deliver enterprise-grade solutions.
  • Implement
    CI/CD pipelines, containerization (Docker, Kubernetes)
    , and Git-based workflows for deployment and version control.

Required Skills & Experience

  • 13+ years
    of experience in
    data engineering, analytics, or data science roles
    .
  • 10+ years
    in
    data engineering & pipeline development
    .
  • Experience with
    2–3 large-scale Snowflake implementations
    (including ML pipeline & model deployment).
  • Strong expertise in
    Snowflake, Snowpark, Python, and SQL
    .
  • Hands-on experience with ML tools (
    scikit-learn, TensorFlow, MLflow, SageMaker
    ).
  • Familiarity with
    LLM frameworks
    (LangChain, OpenAI, Hugging Face) and
    prompt engineering
    .
  • Knowledge of
    data governance, metadata management, and observability tools
    .
  • Proficiency in
    CI/CD, Git, Docker, Kubernetes
    .

Note: Only GC,USC or H4EAD are considered who are willing to work on W2 or 1099.

  • Senior Data Engineer

    4 days ago

    Fort Mill, South Carolina, United States ClifyX Full time

    Job Title: AWS Data EngineerLocation: Fort Mill, SC Hybrid)Employment Type: W2 ContractJob Details:Must Have Skills:• AWS Glue Data Brew• SQL• Data ProfilingDetailed Job Description:• Analyze and map wealth management entities (e.g., Advisor, Account, Product) to business capabilities and journeys.• Perform exploratory data analysis (EDA) on...

  • Senior Software Engineer

    2 weeks ago

    Fort Mill, South Carolina, United States PCI Group Full time $120,000 - $180,000 per year

    __________________________________________________________________________________________________Job Position: Senior Software EngineerReports to: Vice President of Software TechnologyDepartment:Information TechnologyClassification: Exempt (Not Overtime Eligible)Company OverviewPCI Group is the leading provider of mission-critical communications for...

  • Data Engineer

    2 weeks ago

    Fort Mill, South Carolina, United States ClifyX Full time $120,000 - $170,000 per year

    Job Title: Sr Data EngineerLocation: Fort Mill SC Hybrid)Duration: 12+ month ContractJOB DESCRIPTION:Looking for USC and GC only who can work on W2Must Have SkillsDBTDAGSnowflakeJenkins, GitHub Actions, CI/CD, Terraform, Docker, KubernetesDetails:Performance Expectations: Seasoned Data Engineer with 10 years of experience in dbt Data Build Tool to design,...

  • AWS Data Engineer

    14 hours ago

    Fort Mill, South Carolina, United States LSEG Full time

    Ready to build scalable data systems with real-world impact?Join us at FTSE RussellWe're establishing a team of engineers passionate about data, software craftsmanship, and substantial impact. You'll help to power the indices trusted by financial institutions worldwide. You'll work in an AWS environment, build robust pipelines, and work with product and...

  • Senior Software Engineer

    6 days ago

    Fort Mill, South Carolina, United States LPL Financial Full time

    Are you interested in working on meaningful projects? Do you want to work with cutting-edge technology? Are you interested in being part of a team that is working to transform and do things differently? If so, then this could be the role for youJob Overview:We are looking for an inspired innovative Senior Developer for our cloud transformation journey, with...

  • Senior Engineer, Software Developer

    1 week ago

    Fort Mill, South Carolina, United States LPL Financial Full time $123,000 - $133,000 per year

    Name of Employer: LPL Financial LLCPosition Title: Senior Engineer, Software Developer (Req Requisition: 000085Hours: 40 hours per weekSalary Range: $123,000 to $133,000 per yearLocation: 1055 LPL Way, Fort Mill, SC 29715Telecommuting: 40% telecommuting permitted.JOB DUTIES: Designing and developing software to build and maintain sustainable, scalable...

  • Senior Observability Engineer

    4 days ago

    Fort Mill, South Carolina, United States LPL Financial Full time

    Senior Observability EngineerLPL FinancialWhat if you could build a career where ambition meets innovation?At LPL Financial, we empower professionals to shape their success while helping clients pursue their financial goals with confidence. What if you could have access to cutting-edge resources, a collaborative environment, and the freedom to make an...

  • Senior DataPower Engineer

    2 weeks ago

    Fort Mill, South Carolina, United States TalentBridge Full time $120,000 - $180,000 per year

     Position: Senior DataPower Engineer (Contract-to-Hire) Fort Mill, SC (Hybrid: 3 Days Onsite, 2 Days Remote)Must be USC/GC We're seeking a highly experiencedDataPower Engineerto join our team inFort Mill, SC. This is aContract-to-Hire rolefor professionals who are passionate about secure integrations, high-performance API management, and enterprise-scale...

  • Data Analyst

    4 days ago

    Fort Mill, South Carolina, United States DOC Maintenance Full time

    About the Role:We're looking for a Data Analyst to support our predictive maintenance initiatives for IoT-enabled equipment. In this role, you'll analyze historical and real-time equipment data, build predictive models, and turn insights into actionable recommendations that help improve uptime, reduce maintenance costs, and drive smarter operational...

  • SVP, Data Governance

    1 week ago

    Fort Mill, South Carolina, United States LPL Financial Full time

    What if you could build a career where ambition meets innovation? At LPL Financial, we empower professionals to shape their success while helping clients pursue their financial goals with confidence. What if you could have access to cutting-edge resources, a collaborative environment, and the freedom to make an impact? If you're ready to take the next step,...