Current jobs related to Big Data Developer - Atlanta, Georgia - Brilliant®

  • Senior Big Data Engineer

    6 days ago

    Atlanta, Georgia, United States Kforce Inc Full time $120,000 - $200,000 per year

    ResponsibilitiesKforce has a client that is seeking a remote Senior Big Data Engineer to join their team. Summary: The team supports a portal and product landing page, which supports all marketing functions of the website. Currently, they are operating under one monolithic application and want to decouple into loosely coupled microservices. The individual...

  • Full Stack .NET/Angular Developer

    5 days ago

    Atlanta, Georgia, United States Crown Data Systems Full time $80,000 - $120,000 per year

    Who is Crown Data Systems?Crown is a leader in the air freight shipping industry. We provide state of the art software to first/last mile shipping agents. We've been developing software for shipping companies for 20 years. Our company values work/life balance, modern engineering/development practices & technology, Agile development, deployment,and sales, and...

  • Data Engineer

    3 days ago

    Atlanta, Georgia, United States Carman Solutions Group Full time $120,000 - $180,000 per year

    Job Title: Data EngineerLocation: Alpharetta, GADuration: Long Term ContractVisa: H1B Transfers OnlyExperience: 10+ Years (Must)Job DescriptionWe are looking for an experienced Data Engineer with strong expertise in building and optimizing data processing applications using Java and Python, ensuring high performance and scalability of data pipelines.Key...

  • Data Engineer

    5 days ago

    Atlanta, Georgia, United States STEMtech Full time $80,000 - $120,000 per year

    Company Description STEMtech has a client in the Atlanta area looking for a Data Engineer who will aid in the optimization of operations by manipulating and aggregating the disparate operational and back office data sources into a format that is easily digestible by both data scientists and statistically adept colleagues.  His/her core responsibility will...

  • Utility Development Program Manager

    4 days ago

    Atlanta, Georgia, United States QTS Data Centers Full time $120,000 - $180,000 per year

    SUMMARYThe Utility Development Program Manager will be responsible for the overall planning and execution of QTS utility capacity needs portfolio wide. This leader will ultimately be responsible for ensuring utility capacity is prepositioned and delivered at each campus to support data centers by leading execution of all substation and utility build...

  • Business Intelligence Developer

    6 days ago

    Atlanta, Georgia, United States KellyMitchell Group Full time $60,000 - $120,000 per year

    Job SummaryOur client is seeking a Business Intelligence Developer to join their team This position is located in Alpharetta, GA; Irving, TX and Basking Ridge, NJ.DutiesDefine business enhancement and reporting requirements, including baseline functionality and system improvements to support business operationsPlan, design, and develop innovative BI...

  • Full Stack Developer

    1 day ago

    Atlanta, Georgia, United States Largeton Group Full time $120,000 - $200,000 per year

    Title: Full Stack DeveloperLocation: Minneapolis, MN or Atlanta, GA (Candidates MUST BE LOCAL – the hiring manager does on-site interviews)Need 10+ years expTop SkillsJavaAWSSQLMicroservicesREST APIsJob DescriptionThe Senior Full Stack Developer position has multiple years of software development experience with recent hands-on experience working with AWS...

  • Senior Data Engineer

    21 hours ago

    Atlanta, Georgia, United States Steampunk Full time $140,000 - $180,000

    OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Senior Data Engineer", we are looking for a technologist with excellent communication and customer service skills and a passion for data and problem...

  • Data Engineer

    5 days ago

    Atlanta, Georgia, United States SoHo Dragon Full time $80,000 - $120,000 per year

    Position: Data EngineerLocation: Atlanta, GA(Hybrid 3x in office)Employment Type:Contract-to-hireContract Duration: 6months-1yearThe data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineer will work with a multidisciplinary Agile team to build...

  • Senior Data Engineer

    2 days ago

    Atlanta, Georgia, United States Prestige Staffing Full time $120,000 - $180,000 per year

    Senior Data Engineer / Architect (Remote)Pay$150, ,000Location100% RemoteSummaryWe are seeking a highly skilled and innovative Senior Data Engineer / Architect to lead the design, development, and management of our enterprise data infrastructure. This role offers an exciting opportunity to work at the forefront of data technology, driving business insights...

Big Data Developer

2 weeks ago

Atlanta, Georgia, United States Brilliant® Full time $100,000 - $180,000 per year

Job Title
: Big Data Developer

Location
: Remote USA

Salary Range
: $130,000 - $150,000

Benefits
: Healtcare, PTO

Overview
We're looking for a Big Data Engineer to play a key role in modernizing enterprise-scale data platforms. This person will focus on migrating and optimizing legacy Hadoop-based workloads into open-source and cloud-aligned environments. The ideal candidate combines strong technical skills across distributed systems with a passion for performance, scalability, and clean data architecture.

Responsibilities

  • Rebuild and optimize Spark, Hive, and MapReduce workloads for execution in modern distributed compute environments.
  • Design, develop, and maintain data pipelines for both batch and streaming use cases using Spark, NiFi, and Kafka.
  • Convert legacy ETL processes and workflows into open-source or cloud-native frameworks.
  • Collaborate with data engineers, architects, and platform teams to define data ingestion and transformation standards.
  • Tune and optimize performance across large-scale data workloads (partitioning, caching, resource management).
  • Implement and automate data validation frameworks to ensure consistency throughout the migration process.
  • Conduct code reviews, performance testing, and production readiness validation.
  • Create and maintain technical documentation, including migration strategies, dependencies, and operational guides.
  • Work closely with business and application stakeholders to ensure seamless handoff and domain alignment.

Key Technologies

  • Data Processing: Apache Spark, PySpark, Hive, NiFi, Kafka, Trino, Iceberg
  • Languages: Python, Scala, Java
  • Data Storage & Formats: Parquet, ORC, Avro, S3, HDFS
  • Orchestration: Airflow, DBT, Oozie
  • Performance Tuning: YARN, Kubernetes, partitioning, caching
  • Testing & Validation: Great Expectations, Deequ, SQL-based validation
  • Monitoring: Datadog, Grafana, Prometheus

Qualifications

  • 4–8 years of experience in big data engineering, ETL modernization, or distributed system development.
  • Proven experience migrating workloads from Hadoop-based ecosystems (Cloudera, MAPR, Hortonworks) to open-source or cloud-native platforms.
  • Deep understanding of data lake and distributed data architecture principles.
  • Hands-on experience with hybrid or cloud environments (AWS, Azure, or GCP).
  • Familiarity with large enterprise or regulated environments preferred.

Brilliant Staffing, LLC is an Equal Opportunity Employer and encourages applications from all individuals regardless of race, color, religion, gender, gender identity, sexual orientation, national origin, disability, or veteran status.

Tech2025