Senior Spark Data Engineer

4 weeks ago


Atlanta, United States Coca-Cola Company Full time
Position Overview

You will work in Global Data & Analytics organization that is responsible for designing, building, and maintaining cloud-based (Azure) analytics products for that directly impacts Coca-Cola's business growth globally with an emphasis on continuous learning. Our development teams embrace agile principles to quickly generate value for our stakeholders. We have the freedom to try new ideas, experiment and are expected to be constantly learning and growing. There is also a strong emphasis on mentoring others in the group, enabling them to grow and learn.

Relocation and Work Sponsorship will not be available.

What You'll Do for Us

  • Lead end to end design and development of the data solutions.
  • Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.
  • Develop data pipelines to ingest and transform data using Scala and SQL on Spark.
  • Setup orchestration of the pipelines using Azure Synapse pipeline.
  • Source and version control code/configuration artifacts using GitHub.
  • Create GitHub actions to deploy code/configuration artifacts.
  • Create tables/views (using SQL) in Synapse for reporting/visualization.
  • Investigate and remediate data pipeline errors or performance issues.
Qualification & Requirements
  • Bachelor's degree or higher in Computer Science or a related field.
  • 5+ years of experience in developing code on JVM (Java or Scala preferred).
  • 5+ years of Spark experience in data engineering.
  • Proficient in at least one of the programming languages like Scala, Python, and Java.
  • Knowledge of source code repository like GIT/Azure Repos & build tools like Maven.
  • Familiarly with agile development practices.
Desired Qualifications
  • Deep understanding of distributed computing (Spark), cloud architecture and SQL.
  • Experience working with public clouds like Azure, AWS, Google etc.
  • Personal qualities such as creativity, tenacity, curiosity, and passion for deep technical excellence.


  • Atlanta, United States LTIMindtree Full time

    Role: Data Engineer(Java Spark)Location: Atlanta, GAJob Description: Expertise in Java programming Version 8 and later and Spark Experience in ETL transformation process and data pipelines. Knowledge on at least one of the cloud technologies Google Cloud Platform preferred. Knowledge of Maven build tool SQL Knowledge and ability to write complex queries ...

  • Sr. Spark Developer

    2 weeks ago


    Atlanta, United States Resource Informatics Group Inc Full time

    Job DescriptionJob DescriptionRole: Sr. Spark Developer Location:  Atlanta, GADuration:- 12 Months Visa:- AnyInterview:- Phone/SkypeJob Description:-⦁ Looking for Sr. Spark Developer with experience on AWS platform.⦁ Total of 10 Years over all IT Experience with at least 5 Years in Java, SPARK .⦁ At least one 5 of experience with SQL and Java or...

  • Data Engineer

    4 weeks ago


    Atlanta, United States Scalene Works People Solution LLP Full time

    Requisition/Position Title Senior Azure Data Engineer Employment (Regular/Consultant) Regular Position Type (New/Replacement) New Experience Level (Min-Max) >6 Years Mandatory Skillset (Maximum 5) Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake Detailed Job Description Job Responsibilities: · Design, develop, and implement robust...

  • Senior Data Architect

    3 weeks ago


    Atlanta, United States ITTConnect Full time

    Job DescriptionJob DescriptionITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV,...

  • Senior Data Architect

    3 weeks ago


    Atlanta, United States ITTConnect Full time

    ITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a global leader in consulting, digital transformation, technology and engineering services present in over 50 countries. This person will be initially working in one of their established accounts in the telecommunications area (internet, cable TV &...


  • Atlanta, United States ITTConnect Full time

    ITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a global leader in consulting, digital transformation, technology and engineering services present in over 50 countries. This person will be initially working in one of their established accounts in the telecommunications area (internet, cable TV &...


  • Atlanta, United States ITTConnect Full time

    ITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV, cellular provider). Job location:...

  • Senior Data Architect

    3 weeks ago


    Atlanta, United States ITTConnect Full time

    ITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV, cellular provider).Job location:...


  • Atlanta, United States ITTConnect Full time

    ITTConnect is seeking a Senior Data Architect to work for a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV, cellular provider).Job location:...


  • Atlanta, United States Blue Chip Financial Corp Full time

    BlueChip Financial (BCF) is looking for an experienced Senior Devops/Data Engineer who loves building software to help drive our company's growth. This position reports directly to the BCF Solutions Architect. The role will be split into two different areas: Devops / infrastructure (70-80% of the time) Data engineering (20-30% of the time) In this role, you...

  • Data Engineer

    1 month ago


    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    4 weeks ago


    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...


  • Atlanta, United States Metas Solutions Full time

    Job DescriptionJob DescriptionAbout Us:Metas Solutions is a professional services firm headquartered in Atlanta, GA. We are an 8(a)-certified, Woman Owned Small Business (WOSB/EDWOSB) headquartered in Atlanta GA with offices at StudioPlex in Atlanta's Old Fourth Ward neighborhood. Metas is a professional services firm that offers technical assistance and...


  • Atlanta, United States Capgemini Full time

    Title - Senior Software Engineer - Bigdata Job Location  Tampa FL (Hybrid) Duration Fulltime Key Responsibilities Ability to write robust code in Scala  Understanding of data structures data modelling and software architecture You will be responsible for designing, developing, and maintaining scalable data pipelines and...


  • Atlanta, United States Opis Senior Services Group Full time

    Individual will likely have to come into Vinings location or work out of data center occasionally. Responsibilities: The Senior Network Engineer is responsible for assisting with and overseeing switch changes, acting as experts and leaders for the mid-level engineers. The Senior Network Engineer is responsible for adding switches to stacks, activating ports,...


  • Atlanta, Georgia, United States Avanade Full time

    Data Engineer- Senior Analyst Harness data to empower business decisions and foster growth with Avanade's advanced analytics expertise. Come join usEmbark on a journey where you translate complex business needs into data-driven solutions. You'll play a pivotal role in shaping insights that drive strategic decisions, ensuring a seamless flow of information...


  • Atlanta, United States GAP Solutions, Inc. Full time

    Position Objective: The Data Modernization Accelerator at CDC (DMAC) Team is seeking a Cloudera Data Engineer. The role involves designing, building, and maintaining data pipelines. The Engineer will integrate data from various sources and deploy solutions on cloud services. Additionally, they be responsible for optimizing data infrastructure for...


  • Atlanta, United States GAP Solutions, Inc. Full time

    Position Objective: The Data Modernization Accelerator at CDC (DMAC) Team is seeking a Cloudera Data Engineer. The role involves designing, building, and maintaining data pipelines. The Engineer will integrate data from various sources and deploy solutions on cloud services. Additionally, they be responsible for optimizing data infrastructure for...


  • Atlanta, United States Daniel Ernest Full time

    Job Title: Senior Data and AI LeaderLocation: Atlanta, GAPrimary Skills: GenAI, AI/ML, Azure, Python, LangchainDesirable: Studied at Georgia Institute of Technology Massachusetts Institute of Technology or Stanford UniversityThis will initially start as a contract position and you will have the option to transition to fulltime permanent with the possibility...


  • Atlanta, United States Daniel Ernest Full time

    Job Title: Senior Data and AI LeaderLocation: Atlanta, GAPrimary Skills: GenAI, AI/ML, Azure, Python, LangchainDesirable: Studied at Georgia Institute of Technology Massachusetts Institute of Technology or Stanford UniversityThis will initially start as a contract position and you will have the option to transition to fulltime permanent with the possibility...