Current jobs related to Big Data Engineer - Atlanta, Georgia - Norfolk Southern Corp.

  • Big Data Engineer

    3 weeks ago

    Atlanta, Georgia, United States VDart Inc Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at VDart Inc. The ideal candidate will have hands-on experience with Spark, Hadoop, and Kafka, as well as strong programming skills in Java, Scala, or Python.Key Responsibilities:Design and develop batch and streaming solutions using Big Data technologiesWork with...

  • Big Data Engineer

    3 weeks ago

    Atlanta, Georgia, United States Amaze Systems Inc. Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Amaze Systems Inc. in Atlanta, GA.Key Responsibilities:Design and develop scalable big data solutions using Spark, Hadoop, and Kafka.Develop batch and streaming data pipelines using various big data technologies.Collaborate with cross-functional teams to...

  • Big Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States Amaze Systems Inc. Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Amaze Systems Inc.Key Responsibilities:Design and develop scalable big data solutions using Hadoop, Spark, and Kafka.Develop batch and streaming data processing pipelines using various big data technologies.Collaborate with cross-functional teams to integrate big data...

  • Big Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States VDart Inc Full time

    Job OverviewWe are seeking a highly skilled Big Data Engineer to join our team at VDart Inc.Key ResponsibilitiesDesign and develop batch and streaming solutions using Big Data technologies such as Spark, Hadoop, and Kafka.Develop strong programming skills in Java, Scala, or Python.Work with real-time or near real-time ingestion systems.Familiarity with...

  • Big Data Engineer

    22 hours ago

    Atlanta, Georgia, United States Headway tek Full time

    Job Title: Big Data EngineerJob Location: Atlanta GA (Onsite Day one)Experience : 8years Rate: $60/hr candidate rateJob DescriptionDevelop batch and streaming solutions using various Big Data technologies.Have strong programming knowledge in Java, Scala, or Python.Be familiar with Agile/Scrum methodologies.Developing batch and streaming solutions using...

  • Big Data Engineer Lead

    4 weeks ago

    Atlanta, Georgia, United States Elevance Health Full time

    Job Title: Big Data Engineer LeadJob Summary:We are seeking a highly skilled Big Data Engineer Lead to join our team at Elevance Health. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Lead the design and development of data...

  • Senior Big Data Engineer

    3 days ago

    Atlanta, Georgia, United States VDart Inc Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at VDart Inc. as a key member of our Data Engineering team.The successful candidate will be responsible for designing and implementing scalable data infrastructure solutions using Snowflake, Azure, and other big data technologies.Key Responsibilities:Design and implement data...

  • Big Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States Mondo Full time

    Job OverviewMondo is seeking a highly skilled Big Data Engineer to join our team. As a hybrid position, this role will involve working on a long-term contract basis, with a start date of ASAP.Key ResponsibilitiesDesign and develop scalable data architecturesDevelop and maintain high-quality codeProvide production support and mentor junior team...

  • Big Data Engineer

    2 weeks ago

    Atlanta, Georgia, United States Mondo Full time

    Job OverviewMondo is seeking a highly skilled Big Data Engineer to join our team. As a hybrid position, this role will involve working on a long-term contract basis, with a start date of ASAP.Key ResponsibilitiesDesign and develop scalable data architecturesDevelop and maintain high-quality codeProvide production support and mentor junior team...

  • Big Data Engineer Lead

    1 month ago

    Atlanta, Georgia, United States Elevance Health Full time

    Job DescriptionElevance Health is seeking a highly skilled Big Data Engineer Lead to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Lead the development of data engineering solutions, including data pipelines, data...

  • Senior Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Marketing Services (MS) Technology team at Mastercard. As a key member of our team, you will be responsible for designing, developing, and implementing data solutions using cutting-edge technologies such as Big Data, AI/Machine Learning, and Data Analytics.The ideal candidate will...

  • Big Data Architect

    4 days ago

    Atlanta, Georgia, United States Mondo Staffing Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Mondo Staffing. As a key member of our team, you will be responsible for designing and implementing scalable data processing pipelines using AWS components.Responsibilities:Design and develop data processing pipelines using Spark Streaming and AWS...

  • Senior Data Engineer

    3 weeks ago

    Atlanta, Georgia, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Mastercard. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop data pipelines using various Big Data technologiesDevelop...

  • Big Data Engineer L1 Support Specialist

    4 weeks ago

    Atlanta, Georgia, United States Solugenix Full time

    Job Title: Big Data Engineer L1 SupportWe are seeking a highly skilled Big Data Engineer L1 Support professional to join our team at Solugenix. As a key member of our support team, you will be responsible for providing top-notch support for AWS Big Data services, including Amazon EMR, Amazon Redshift, Amazon S3, and AWS Glue.Responsibilities:Provide L1...

  • Senior Big Data Developer

    3 days ago

    Atlanta, Georgia, United States GATE Insight, Inc. Full time

    Job Title:Data Systems EngineerJob Overview:GATE Insight, Inc. is seeking a highly skilled Data Systems Engineer to design and develop scalable data processing systems using Spark, Hadoop, and Kafka. The ideal candidate will have hands-on experience with Big Data technologies and a strong understanding of data processing pipelines.Key Responsibilities:...

  • Senior Software Engineer/Java/Big Data/Hybrid

    3 days ago

    Atlanta, Georgia, United States Motion Recruitment Partners, LLC Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Motion Recruitment Partners, LLC. As a key member of our team, you will be responsible for designing and developing cutting-edge software solutions using Java and big data technologies.Key ResponsibilitiesDesign and develop scalable software solutions using Java and...

  • Senior Big Data Architect

    3 days ago

    Atlanta, Georgia, United States Mondo Staffing Full time

    Job SummaryWe are seeking a highly skilled Data Engineering Specialist to join our team at Mondo Staffing. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data processing pipelines on AWS. Your expertise in Spark Streaming, Scala, and Python will enable you to develop efficient and reliable data...

  • Senior Software Engineer/Java/Big Data/Hybrid

    3 weeks ago

    Atlanta, Georgia, United States Motion Recruitment Full time

    About the RoleA leading global retail/e-commerce company is seeking a highly skilled Senior Software Engineer to join their team. As a key member of the shares services division, you will be responsible for building two brand new greenfield products. The ideal candidate will have strong skills in Java, Springboot/Spring, GCP or AWS, and big data tooling...

  • Senior Software Engineer/E-Commerce Platform/Java/ Big Data

    3 days ago

    Atlanta, Georgia, United States Motion Recruitment Partners, LLC Full time

    Job Opportunity: We are seeking a skilled Sr. Java Engineer to join our team in the retail/e-commerce space. The ideal candidate will have strong Java/Springboot fundamentals, experience with cloud deployments, and big data tooling (Hadoop, Cassandra, Spark). Key Responsibilities:Design and develop new features for our recommendation applicationCollaborate...

  • Senior Software Engineer/E-Commerce Platform/Java/Big Data Specialist

    24 hours ago

    Atlanta, Georgia, United States Motion Recruitment Partners Full time

    Job Title: Senior Software Engineer/E-Commerce Platform/Java/Big Data SpecialistThe company is seeking a skilled Senior Software Engineer to join their team in developing a recommendation application for the e-commerce platform. The ideal candidate will have strong Java/Springboot fundamentals, experience with cloud deployments, and big data tooling (Hadoop,...

Big Data Engineer

3 months ago

Atlanta, Georgia, United States Norfolk Southern Corp. Full time

Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail. As part of Norfolk Southern, you'll join a collaborative team where there are opportunities for growth across the organization. We are building a culture where everyone can thrive by owning and driving exceptional results, being humble and leading with trust, serving our customers with excellence, and collaborating and coaching to win.

Job Description

Norfolk Southern Corporation is currently seeking a Big Data Engineer with an affinity for working with others to create successful solutions. Join a smart, highly skilled team with a passion for technology, where you will work on our state-of-the-art Big Data Platforms. This Data Engineer with a balance of theoretical business intelligence and data analytics knowledge and hands-on experience and exposure to real-world BI problem-solving. In this role, you will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions, and perform data ingestion development and support duties.

In this role, you will work with people from many areas of the company to understand their data and BI needs and perform detailed requirements gathering along with analysis in partnership with our team of Data Modelers. Engage our BI development team to agree on effort estimates and then oversee the progress of the project through its completion.

Responsibilities
  • Defines data requirements, gather, and wrangle large scale of structured and unstructured data, and validate data by running various data tools in the Data Environment.
  • Supports the standardization, customization and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data.
  • Creates data policy and develop interfaces and retention models which requires synthesizing or anonymizing data.
  • Implements statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists and analytics and insights creation in data sourcing and preparation to visualize data and synthesize insights of commercial value.
  • Develops and maintains data engineering best practices and contributes to Insights on data analytics and visualization concepts, methods and techniques.
  • Works closely with the data science and business intelligence teams to develop data models and pipelines for research, reporting, and machine learning.
  • Builds data pipelines that clean, transform, and aggregate data from disparate sources.
  • Employs a variety of languages and tools (e.g. scripting languages) to marry systems together.
  • Applies knowledge of Data Architecture components, leads project teams from requirements to implementation.
Skills Required
  • 3-5 years of being in a Data Engineering role manipulating, processing, and extracting value from large datasets.
  • 3+ years of Big Data tools like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS.
  • 3+ years building, testing, and optimizing 'Big Data' data ingestion pipelines, architectures, and data sets with Tibco, IBM or others.
  • Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog.
  • High-velocity high-volume stream processing with Apache Kafka and Spark Streaming.
  • Strong SQL skills with ability to write intermediate complexity queries.
  • ETL experience with PySpark, Spark SQL or similar.
  • Agile Scrum, Kanban or SAFe experience.

Skills Desired

  • Python (and/or Scala) and PySpark/Scala-Spark.
  • Database solutions like Snowflake, Kudu/Impala, Delta Lake or BigQuery.
  • NoSQL databases, including HBASE and/or Cassandra.
  • Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue.
  • Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series.

Education Desired

Bachelor's Degree, preferably in Information Systems, Computer Science, Computer Information Systems or related field.

Work Conditions

Environment: Office Remote, ideal candidate must be based within 60 miles Atlanta.

Shift Work: No

On-Call: Yes

Weekend Work: No


Company Overview

Since 1827, Norfolk Southern Corporation (NYSE: NSC) and its predecessor companies have safely moved the goods and materials that drive the U.S. economy. Today, it operates a customer-centric and operations-driven freight transportation network. Committed to furthering sustainability, Norfolk Southern helps its customers avoid 15 million tons of yearly carbon emissions by shipping via rail. Its dedicated team members deliver more than 7 million carloads annually, from agriculture to consumer goods, and is the largest rail shipper of auto products and metals in North America. Norfolk Southern also has the most extensive intermodal network in the eastern U.S., serving a majority of the country's population and manufacturing base, with connections to every major container port on the Atlantic coast as well as the Gulf of Mexico and Great Lakes. Learn more by visiting

At Norfolk Southern, we believe in celebrating our individuality. By leveraging the unique backgrounds and viewpoints of our employees, we can create a culture of innovation, respect, and inclusion. We know that employees thrive in a workplace where differing viewpoints, ideas, and experiences are freely shared and valued. As such, we encourage all employees to contribute their distinctive skills and capabilities to our organization.

Equal employment opportunities are available to all applicants regardless of race, color, religion, age, sex, national origin, disability status, genetic information, veteran status, sexual orientation, and gender identity. Together, we power progress.