Senior Data Engineer

23 hours ago

Atlanta, GA, United States inSync Staffing Full time
Senior Data Engineer (Databricks) - Hybrid, Metro Atlanta

Location: Metro Atlanta, GA (Hybrid - 3 days onsite per week)
Type: Long-term contract / Full-time opportunity

Overview

We are seeking a Senior Data Engineer with strong hands-on experience in Databricks and modern data engineering practices. This role is ideal for an engineer who enjoys building, optimizing, and maintaining scalable data pipelines that enable analytics, business intelligence, and data-driven decision-making across the organization.

The ideal candidate will be highly proficient in data modeling, data pipeline orchestration, ETL/ELT design, and cloud data engineering (preferably AWS), with deep knowledge of the Medallion Data Architecture (Bronze, Silver, Gold layers) to ensure data reliability, scalability, and reusability.

Key Responsibilities
  • Design & Build Data Pipelines: Architect, implement, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies.
  • Medallion Data Architecture: Design and implement data workflows following the Medallion (Bronze-Silver-Gold) architecture - ensuring structured, quality-controlled data flow from raw ingestion to curated and analytics-ready datasets.
  • Data Transformation & Optimization: Develop efficient data processing and transformation workflows to support analytics and reporting use cases.
  • Data Integration: Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets.
  • Performance Tuning: Optimize Spark jobs, queries, and workflows for efficiency, scalability, and cost-effectiveness.
  • Collaboration: Work closely with cross-functional teams (data science, analytics, and business units) to design and implement data solutions aligned with business goals.
  • Data Quality & Validation: Implement robust validation, monitoring, and observability processes to ensure data accuracy, completeness, and reliability.
  • Automation & Governance: Contribute to data governance, security, and automation initiatives within the data ecosystem.
  • Cloud Environment: Leverage AWS services (e.g., S3, Glue, Lambda, Redshift) to build and deploy cloud-native data solutions.
Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Systems, or related field.
  • 5+ years of experience as a Data Engineer or Senior Data Engineer in enterprise-scale environments.
  • Proven hands-on experience with Databricks, Apache Spark, and PySpark for large-scale data engineering and analytics.
  • Strong understanding of Medallion Data Architecture and experience implementing Bronze, Silver, and Gold data layers within a Databricks or lakehouse environment.
  • Proficiency in Python and SQL for data manipulation, automation, and orchestration.
  • Experience designing and maintaining ETL/ELT processes and data pipelines for large datasets.
  • Working knowledge of AWS (preferred) or other cloud platforms (Azure, GCP).
  • Familiarity with data modeling, schema design, and performance tuning in data lake or data warehouse environments.
  • Solid understanding of data governance, security, and compliance principles.
  • Excellent communication, analytical, and problem-solving skills.
  • Strong teamwork skills with the ability to collaborate across distributed teams.
Nice to Have
  • Experience with tools like Fivetran, Prophecy, or Precisely Connect.
  • Exposure to Delta Lake, Airflow, or dbt.
  • Prior experience developing in Lakehouse environments or data mesh architectures.
  • Familiarity with CI/CD practices for data pipelines.
  • Experience working in Agile or DevOps-oriented environments.
Benefits (employee contribution):
  • Health insurance
  • Health savings account
  • Dental insurance
  • Vision insurance
  • Flexible spending accounts
  • Life insurance
  • Retirement plan

All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

  • Data Engineer

    1 day ago

    Atlanta, GA, United States Republic National Distributing Company Full time

    Republic National Distributing Company (RNDC) is a family-owned business with roots extending before Prohibition that has evolved into one of the nation's largest wine and spirits wholesalers. Our success is grounded in our core values of Family, Service, Accountability, Honesty, and Professionalism. We offer a vibrant, inclusive culture and workplace...

  • Senior Data Engineer

    21 hours ago

    Atlanta, GA, United States Deploy Alloy Full time

    About the job Senior Data Engineer Position Purpose Summary: DEPLOY's client is building a next-generation business management platform from the ground up and were looking for a hands-on Senior Data Engineer to deliver and scale our data strategy. As we grow rapidly through mergers and acquisitions, we face a rich and complex data environment. This role...

  • Senior Data Engineer

    5 days ago

    Atlanta, GA, United States Deploy Alloy Full time

    About the job Senior Data Engineer Position Purpose Summary: DEPLOY's client is building a next-generation business management platform from the ground up and were looking for a hands-on Senior Data Engineer to deliver and scale our data strategy. As we grow rapidly through mergers and acquisitions, we face a rich and complex data environment. This role...

  • Senior Data Engineer

    2 days ago

    Atlanta, GA, United States Deploy Alloy Full time

    About the job Senior Data Engineer Position Purpose Summary: DEPLOY's client is building a next-generation business management platform from the ground up and were looking for a hands-on Senior Data Engineer to deliver and scale our data strategy. As we grow rapidly through mergers and acquisitions, we face a rich and complex data environment. This role...

  • Senior Data Engineer

    2 weeks ago

    Atlanta, GA, United States Prestige Staffing Information Technology Job Full time

    JobID: 51796 Senior Data Engineer / Architect (Remote) Pay $150,000 - 170,000 Location 100% Remote Summary We are seeking a highly skilled and innovative Senior Data Engineer / Architect to lead the design, development, and management of our enterprise data infrastructure. This role offers an exciting opportunity to work at the forefront of data technology,...

  • Senior Data Engineer

    1 day ago

    Atlanta, GA, United States Steampunk.com Full time

    Overview We are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Senior Data Engineer", we are looking for a technologist with excellent communication and customer service skills and a passion for data and problem...

  • Senior Data Engineer

    3 days ago

    Atlanta, GA, United States Steampunk.com Full time

    Overview We are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Senior Data Engineer", we are looking for a technologist with excellent communication and customer service skills and a passion for data and problem...

  • Data & BI Senior Data Engineer

    1 day ago

    Atlanta, GA, United States Axiom Software Solutions Limited Full time

    Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with...

  • Data & BI Senior Data Engineer

    2 weeks ago

    Atlanta, GA, United States Axiom Software Solutions Limited Full time

    Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with...

  • Data & BI Senior Data Engineer

    5 days ago

    Atlanta, GA, United States Axiom Software Solutions Limited Full time

    Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with...