Senior Data Engineer

4 days ago

Atlanta, GA, United States inSync Staffing Full time
Senior Data Engineer (Databricks) - Hybrid, Metro Atlanta

Location: Metro Atlanta, GA (Hybrid - 3 days onsite per week)
Type: Long-term contract / Full-time opportunity

Overview

We are seeking a Senior Data Engineer with strong hands-on experience in Databricks and modern data engineering practices. This role is ideal for an engineer who enjoys building, optimizing, and maintaining scalable data pipelines that enable analytics, business intelligence, and data-driven decision-making across the organization.

The ideal candidate will be highly proficient in data modeling, data pipeline orchestration, ETL/ELT design, and cloud data engineering (preferably AWS), with deep knowledge of the Medallion Data Architecture (Bronze, Silver, Gold layers) to ensure data reliability, scalability, and reusability.

Key Responsibilities
  • Design & Build Data Pipelines: Architect, implement, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies.
  • Medallion Data Architecture: Design and implement data workflows following the Medallion (Bronze-Silver-Gold) architecture - ensuring structured, quality-controlled data flow from raw ingestion to curated and analytics-ready datasets.
  • Data Transformation & Optimization: Develop efficient data processing and transformation workflows to support analytics and reporting use cases.
  • Data Integration: Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets.
  • Performance Tuning: Optimize Spark jobs, queries, and workflows for efficiency, scalability, and cost-effectiveness.
  • Collaboration: Work closely with cross-functional teams (data science, analytics, and business units) to design and implement data solutions aligned with business goals.
  • Data Quality & Validation: Implement robust validation, monitoring, and observability processes to ensure data accuracy, completeness, and reliability.
  • Automation & Governance: Contribute to data governance, security, and automation initiatives within the data ecosystem.
  • Cloud Environment: Leverage AWS services (e.g., S3, Glue, Lambda, Redshift) to build and deploy cloud-native data solutions.
Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Systems, or related field.
  • 5+ years of experience as a Data Engineer or Senior Data Engineer in enterprise-scale environments.
  • Proven hands-on experience with Databricks, Apache Spark, and PySpark for large-scale data engineering and analytics.
  • Strong understanding of Medallion Data Architecture and experience implementing Bronze, Silver, and Gold data layers within a Databricks or lakehouse environment.
  • Proficiency in Python and SQL for data manipulation, automation, and orchestration.
  • Experience designing and maintaining ETL/ELT processes and data pipelines for large datasets.
  • Working knowledge of AWS (preferred) or other cloud platforms (Azure, GCP).
  • Familiarity with data modeling, schema design, and performance tuning in data lake or data warehouse environments.
  • Solid understanding of data governance, security, and compliance principles.
  • Excellent communication, analytical, and problem-solving skills.
  • Strong teamwork skills with the ability to collaborate across distributed teams.
Nice to Have
  • Experience with tools like Fivetran, Prophecy, or Precisely Connect.
  • Exposure to Delta Lake, Airflow, or dbt.
  • Prior experience developing in Lakehouse environments or data mesh architectures.
  • Familiarity with CI/CD practices for data pipelines.
  • Experience working in Agile or DevOps-oriented environments.
Benefits (employee contribution):
  • Health insurance
  • Health savings account
  • Dental insurance
  • Vision insurance
  • Flexible spending accounts
  • Life insurance
  • Retirement plan

All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

  • Senior Data Engineer

    2 weeks ago

    Atlanta, GA, United States Prestige Staffing Information Technology Job Full time

    JobID: 51796 Senior Data Engineer / Architect (Remote) Pay $150,000 - 170,000 Location 100% Remote Summary We are seeking a highly skilled and innovative Senior Data Engineer / Architect to lead the design, development, and management of our enterprise data infrastructure. This role offers an exciting opportunity to work at the forefront of data technology,...

  • Senior Data Engineer

    6 days ago

    Atlanta, GA, United States Prestige Staffing Information Technology Job Full time

    JobID: 51796 Senior Data Engineer / Architect (Remote) Pay $150,000 - 170,000 Location 100% Remote Summary We are seeking a highly skilled and innovative Senior Data Engineer / Architect to lead the design, development, and management of our enterprise data infrastructure. This role offers an exciting opportunity to work at the forefront of data technology,...

  • Data & BI Senior Data Engineer

    1 week ago

    Atlanta, GA, United States Axiom Software Solutions Limited Full time

    Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with...

  • Data Engineer

    2 weeks ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    11 minutes ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Systems Administration Senior Specialist

    2 weeks ago

    Atlanta, GA, United States NTT DATA Full time

    Req ID: 338845 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Administration Senior Specialist to join our team in Atlanta, Georgia (US-GA), United States (US). Senior...

  • Senior Data Platform Engineer

    2 weeks ago

    Atlanta, GA, United States Under Armour Full time

    Join Under Armour, a pioneering brand dedicated to innovation and performance, as our new Senior Data Platform Engineer. In this exciting role, you will help shape the data products and services that enhance our direct to consumer experience, along with other key elements of our performance brand. Collaborate with cross-functional teams in data analytics,...

  • Senior Software Engineer, Data Engineering

    4 days ago

    Atlanta, GA, United States Omada Health Full time

    Senior Software Engineer, Data Engineering Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time. Job overview: We are dedicated to leveraging data to drive strategic decision-making and operational efficiency. Our team is passionate about harnessing the power of data to solve complex problems and deliver impactful...