Lead Data Engineer

7 days ago

Atlanta Metropolitan Area, United States Insure Technology Full time $120,000 - $200,000 per year

Role:
Lead Data Engineer

Type:
6 Month Contract To Hire

Location:
Atlanta Metro Area (In-office Monday through Friday)

About the Opportunity

Insure Technologies is partnering with one of it's key strategic partners, a leading enterprise financial payments organization, to identify a
hands-on Lead/Senior Data Engineer
in Atlanta to play a key role in designing and optimizing large-scale data solutions in a modern Azure + Databricks environment. This individual will lead development of robust data pipelines, drive automation, and ensure delivery excellence across a globally distributed data team.

You'll serve as both a technical expert and mentor—working closely with offshore engineers, guiding best practices, and ensuring the business can make sense of data through effective storytelling and visualization.

Key Responsibilities

  • Design, build, and optimize scalable
    data pipelines
    and
    ETL frameworks
    using
    Python / PySpark
    within
    Databricks
    .
  • Automate performance monitoring, reporting, and pipeline management across large data ecosystems.
  • Leverage
    Azure Data Lake
    and related MS data technologies to support enterprise analytics and data science initiatives.
  • Analyze and interpret datasets to identify trends, provide insights, and communicate findings effectively to business stakeholders.
  • Collaborate with cross-functional teams to align data strategy with business objectives.
  • Manage, coach, and mentor a small offshore data engineering team, promoting collaboration and quality execution.
  • Drive continuous improvement through automation, code reviews, and adoption of modern tools (GitHub, CI/CD, etc.).

What We're Looking For

  • 8+ years of experience in data engineering, including recent
    hands-on development in Python and PySpark
    .
  • Strong experience with
    Databricks
    , including notebook development, pipeline setup, and automation.
  • Solid understanding of
    Azure cloud data services
    and
    Data Lake
    architectures.
  • Proven ability to interpret and visualize data—comfortable using spreadsheets, dashboards, or BI tools to communicate insights.
  • Self-directed and delivery-oriented with the ability to thrive in fast-moving, dynamic environments.
  • Excellent communication skills with a collaborative and coaching mindset.
  • Exposure to
    machine learning / AI
    concepts or experience integrating GitHub with AI tools is a strong plus.
  • Experience mentoring or managing offshore teams preferred.

Additional Details

  • This position requires on-site presence Monday through Friday.
  • Applicants must be authorized to work in the U.S. without current or future sponsorship.
  • This role will be an initial 6 month contract engagement with a strong likelihood of conversion to FTE status

  • Lead Software Engineer

    2 days ago

    Atlanta Metropolitan Area, United States Franklin Fitch Full time $120,000 - $200,000 per year

    Lead Software EngineerLocation:Hybrid or Remote (US-based)Employment Type:Full-time | SaaS | .NET | AzureWe are a growth-oriented SaaS company that pioneered accounting software in the hospitality industry. Our modern .NET-based platform empowers businesses with innovative, data-driven financial tools. As we continue to scale, we're seeking aLead Software...

  • Lead Cloud Engineer

    4 days ago

    Atlanta Metropolitan Area, United States Remobi Full time $120,000 - $200,000 per year

    AWS Cloud LeadSummaryWe are seeking an experienced AWS Cloud Lead to drive end-to-end solution architecture, technical delivery, and engineering leadership across large-scale AWS environments. This role combines hands-on technical design with leadership responsibilities, ensuring secure, scalable, and cost-efficient cloud solutions leveraging AWS Connect,...

  • Data Engineer

    2 days ago

    Detroit Metropolitan Area, United States IC Resources Full time $80,000 - $120,000 per year

    Data Management Engineer – Sensing & Analytics SystemsAnn Arbor, Michigan (Onsite preferred, hybrid considered)We're partnering with a global technology company developing next-generation sensing and analytics platforms for large-scale, continuous monitoring of physical environments. Their systems capture and process vast volumes of time-series and...

  • Software Engineer in Test

    4 days ago

    Denver Metropolitan Area, United States Access Data Consulting Corporation Full time $140,000 - $170,000 per year

    Senior SDET - PythonContractSouth Denver areaWe are seeking a highly experienced Software Development Engineer in Test (SDET) to act as the technical lead for our mobile automation platform. This is a hands-on role where you will design, engineer, and maintain the entire test automation ecosystem, ensuring our mobile product release cycles are fast, stable,...

  • Data Engineer

    2 weeks ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    22 hours ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Lead Data Engineer

    18 hours ago

    Atlanta, GA, United States MasterCard Full time

    Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Lead DevOps Engineer

    2 days ago

    Atlanta Metropolitan Area, United States FTS, Inc. Full time $100,000 - $180,000 per year

    Our client, a rapidly growing manufacturing company modernizing its technology operations, is seeking aLead Azure DevOps Engineerto drive cloud automation, CI/CD optimization, and platform scalability across the enterprise. This is a key technical leadership role with high visibility and impact as the organization continues its digital transformation...

  • Data Engineer

    3 days ago

    Bucharest Metropolitan Area, United States Placeable Full time $60,000 - $120,000 per year

    We're looking for aData Engineereager to work alongside a major e-commerce player in Bucharest, Romania.Why join us?You will make an impact on challenging projects alongside a growing, established, international online retailer.You will be part of a bigger, international team where the official work language is english.You will enjoy a hybrid position in...