Data Engineer

4 days ago

Atlanta, Georgia, United States HiQo Solutions Full time

We are looking for a skilled and proactive Data Engineer with deep expertise in Databricks to join our data platform team. You will be responsible for designing, building, and optimizing scalable data pipelines and lakehouse architectures that power analytics, reporting, and machine learning across the organization

Responsibilities

  • Develop and maintain robust ETL/ELT pipelines using Databricks and Apache Spark
  • Design and implement Delta Lake architectures for structured and semi-structured data
  • Collaborate with data analysts, scientists, and product teams to deliver clean, reliable datasets
  • Optimize performance of Spark jobs and manage cluster resources efficiently
  • Automate workflows using Databricks Jobs, Workflows
  • Ensure data quality, lineage, and governance using Unity Catalog and monitoring tools
  • Document data models, pipeline logic, and architectural decisions
  • Participate in code reviews and contribute to engineering best practices

Required skills and experience

  • 4+ years of experience as a Data Engineer or in a similar role
  • Strong hands-on experience with Databricks, including Delta Lake, Spark SQL
  • Proficiency in Python and SQL for data manipulation and pipeline development
  • Solid understanding of Apache Spark internals and performance tuning
  • Experience with cloud platforms (Azure, AWS,GCP)
  • Knowledge of data modeling, partitioning, and lakehouse principles
  • Ability to work with large-scale datasets and optimize storage and compute costs
  • Strong communication skills and ability to collaborate across teams

Nice to have

  • Experience with Azure Data Factory or Airflow
  • Proficiency with modern data warehouses and tools including Snowflake, Synapse, Red Gate
  • Exposure to data governance frameworks and tools (e.g., Unity Catalog, Purview)
  • Understanding of machine learning workflows and integration with data pipelines
  • Experience with BI tools (Power BI, Tableau) and supporting analytics teams
  • Contributions to open-source projects or technical blogs

  • Data Engineer

    1 week ago

    Atlanta, Georgia, United States SoHo Dragon Full time $80,000 - $120,000 per year

    Position: Data EngineerLocation: Atlanta, GA(Hybrid 3x in office)Employment Type:Contract-to-hireContract Duration: 6months-1yearThe data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineer will work with a multidisciplinary Agile team to build...

  • Data Engineer

    3 days ago

    Atlanta, Georgia, United States iVoyant Full time

    iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design. They will ensure the availability and validity of the data to ensure that it fits with the requested business rules....

  • Data Engineer

    1 week ago

    Atlanta, Georgia, United States STEMtech Full time $80,000 - $120,000 per year

    Company Description STEMtech has a client in the Atlanta area looking for a Data Engineer who will aid in the optimization of operations by manipulating and aggregating the disparate operational and back office data sources into a format that is easily digestible by both data scientists and statistically adept colleagues.  His/her core responsibility will...

  • Sales Executive, Microsoft Power Platform Consulting Services

    2 days ago

    Atlanta, Georgia, United States Engineer Up Full time

    Sales Executive, Microsoft Power Platform Consulting ServicesLocation: 100% Remote (preference for Atlanta, GA, but open to any US-based candidate)Company: Engineer UpAbout Us:We provide technology consulting for companies that demand results. No fluff. Just hard work. Our expertise is Microsoft Power Platform.Position Summary:Engineer Up is seeking a...

  • Data Engineer

    7 days ago

    Atlanta, Georgia, United States Carman Solutions Group Full time $120,000 - $180,000 per year

    Job Title: Data EngineerLocation: Alpharetta, GADuration: Long Term ContractVisa: H1B Transfers OnlyExperience: 10+ Years (Must)Job DescriptionWe are looking for an experienced Data Engineer with strong expertise in building and optimizing data processing applications using Java and Python, ensuring high performance and scalability of data pipelines.Key...

  • IT Data Engineer

    1 week ago

    Atlanta, Georgia, United States Kanak Elite Services Full time $140,000 - $170,000 per year

    Title - IT Data EngineerLocation - GA Local requiredDuration - 12+We have some urgent requirements with atleast 3 years experience asData Engineerto join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data...

  • Data Engineer

    1 day ago

    Atlanta, Georgia, United States Agile Resources, Inc. Full time

    Location/Remote:100% Remote (U.S. only; preference for EST/CST time zones; must work EST hours)Employment Type:Indefinite W-2/1099 contract (some people have worked here for 7+ years)Compensation:Up to $75/hour W-2 or $83/hour 1099Work Authorization:U.S. Citizen or Green Card Holder only (due to work involving sensitive material)Benefits:Medical, dental,...

  • Data Engineer

    1 week ago

    Atlanta, Georgia, United States Apollo Technology Solutions LLC Full time $90,000 - $120,000 per year

    Job Title: Data EngineerLocation: Atlanta, GA(Hybrid)Duration: 8+ months Note:Must be physically located in GeorgiaOn-site: Tuesday to Thursday (per manager's discretion)Mandatory in-person meetings: All Hands, Enterprise ApplicationsShort Description:Under broad supervision, combines strong technical skills with knowledge of database administration. Works...

  • Data Engineer

    1 week ago

    Atlanta, Georgia, United States Largeton Group Full time $120,000 - $140,000 per year

    Location- Atlanta,Georgia-Hybrid- Local candidates Only-with State ExperienceLinkedin- Must be strongDuration- 9 months2 Mangerial Refrence RequiredWe have some urgent requirements with atleast 3 years experience asData Engineerto join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development,...

  • Senior Data Engineer

    1 week ago

    Atlanta, Georgia, United States Aptonet Full time $120,000 - $180,000 per year

    Senior Data Engineer (Databricks) – Hybrid, Metro AtlantaLocation:Metro Atlanta, GA (Hybrid – 3 days onsite per week)Type:Long-term contract / Full-time opportunityOverviewWe are seeking aSenior Data Engineerwith strong hands-on experience inDatabricksand modern data engineering practices. This role is ideal for an engineer who enjoys building,...