Current jobs related to Big Data Engineer - Atlanta - Norfolk Southern Corp.

  • Big Data Engineer

    3 months ago

    Atlanta, United States Mondo Full time

    Job DescriptionJob Description Apply now: Big Data Engineer, a hybrid position local to Atlanta, GA. The start date is ASAP for this long-term contract position. Job Title: Big Data Engineer Location: Hybrid to Atlanta, GA Duration: 6+ Months to extend Rate: $90-100 Per Hour W2 Start Date: ASAP Responsibilities: Architecture and Design Code Development...

  • Big Data Engineer

    1 month ago

    Atlanta, Georgia, United States Norfolk Southern Corp. Full time

    Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail. As part of Norfolk Southern, you'll join a collaborative team where there are opportunities for growth across...

  • Big Data Software Engineer

    8 hours ago

    Atlanta, Georgia, United States Georgia Tech Research Institute Full time

    About the RoleWe are seeking a highly skilled Big Data Software Engineer to join our team at the Georgia Tech Research Institute. As a key member of our Health Emerging & Advanced Technologies (HEAT) Division, you will play a critical role in designing, developing, and implementing secure and scalable big data solutions for healthcare data analytics.Key...

  • Big Data Engineer

    2 months ago

    Atlanta, United States Open Systems Inc. Full time

    Big Data EngineerAtlanta, GAHybrid-periodically onsite as needed Company Client Corporation is Fortune-300 transportation company specializing in freight railroading. We operate approximately 21,000 route miles in 22 states and the District of Columbia, serve every major container port in the eastern United States, and provide efficient connections to other...

  • Big Data Specialist

    3 days ago

    Atlanta, Georgia, United States Brooksource Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Brooksource. As a Data Engineer, you will play a critical role in managing and optimizing data pipelines, ensuring the reliability and scalability of our data architecture.Key ResponsibilitiesData Pipeline Development: Design, build, and maintain scalable data pipelines to...

  • Big Data Software Engineer

    1 day ago

    Atlanta, United States Georgia Tech Research Institute Full time

    Big Data Software Engineer - GTRI-ICL Open Rank Submit Resume ID: 499863 Type: Researchers Location: Atlanta, GA Categories: Data Analytics/Science, Health Informatics Overview: The Georgia Tech Research Institute (GTRI) is the nonprofit, applied research division of the Georgia Institute of Technology (Georgia Tech).Founded in 1934 as the Engineering...

  • AWS Software Engineer III, Big Data and ETL

    2 weeks ago

    Atlanta, United States JPMorgan Chase Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As an AWS Software Engineer III, Big Data and ETL at JPMorgan Chase within Corporate Technology, specifically as a part of Consumer and Community Banking Risk Technology team, your role will be to contribute to an agile team responsible for...

  • Data Engineer

    5 months ago

    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    5 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Senior Data Engineer

    8 hours ago

    Atlanta, Georgia, United States Georgia Tech Research Institute Full time

    About the RoleWe are seeking a highly skilled Big Data Software Engineer to join our team at the Georgia Tech Research Institute. As a key member of our Health Emerging & Advanced Technologies (HEAT) Division, you will play a critical role in designing, developing, and implementing secure and scalable big data solutions for healthcare data analytics.Key...

  • Sr. Data Engineer

    2 days ago

    Atlanta, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Sr. Data engineerLocation: Atlanta, GA - OnsiteDuration: / Term: 6+ months ContractJob Description:Proficiency in data modeling and database management.Strong programming skills (e.g., Python, Java, or SQL).Experience in SnowflakeKnowledge of big data technologies like Hadoop and Spark.Experience with ETL (Extract,...

  • Data Engineer

    4 days ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    5 days ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States iVoyant Full time

    About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team.The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design.They will ensure the availability and validity of the data to ensure that it fits with the...

  • AWS Data Engineer

    3 months ago

    Atlanta, United States Mueller Co. LLC Full time

    Job Summary : AWS-BI Developer with strong experience across the entire Cloud Data stack. The ideal candidate will have extensive experience in data pipelines (ELT/ETL), data warehousing and dimensional modeling, and curation of data sets for Data Scientists and Business Intelligence users. Experience in building Data Lake. This candidate will also have...

  • Data Engineer

    3 months ago

    Atlanta, United States Marathon TS Full time

    Job DescriptionJob DescriptionData Engineer is responsible for supporting our enterprise data warehouse for our Supply Chain Operations. As a Data Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production...

  • Senior Data Engineer

    2 months ago

    Atlanta, United States KellyMitchell Group Full time

    Job Summary:Our client is seeking a Senior Data Engineer who will identify ways to improve data reliability, efficiency, and quality by various data solution techniques. This job is located in Atlanta, Georgia. Duties:Identify data sources and build pipelines using various ETL tools such as SSIS and Alteryx Assist in defining the data architecture framework,...

  • Senior Data Engineer

    2 months ago

    Atlanta, United States KellyMitchell Group Full time

    Job Summary:Our client is seeking a Senior Data Engineer who will identify ways to improve data reliability, efficiency, and quality by various data solution techniques. This job is located in Atlanta, Georgia. Duties:Identify data sources and build pipelines using various ETL tools such as SSIS and Alteryx Assist in defining the data architecture framework,...

  • Software Engineer

    4 hours ago

    Atlanta, Texas, United States Adswizz Full time

    About UsSiriusXM Media is a leading digital audio advertising ecosystem in North America, providing innovative ad tech solutions and a gateway for marketers to reach over 150 million listeners each month.Job SummaryWe are seeking a Senior Software Engineer to join our Ads Data and Engineering team, responsible for demystifying advertisement performance data...

  • Key Data Engineer

    2 months ago

    Atlanta, Georgia, United States EPAM Systems Full time

    We are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.What You'll DoBuild and maintain secure and compliant...

Big Data Engineer

1 month ago

Atlanta, United States Norfolk Southern Corp. Full time

Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail.  As part of Norfolk Southern, you’ll join a collaborative team where there are opportunities for growth across the organization. We are building a culture where everyone can thrive by owning and driving exceptional results, being humble and leading with trust, serving our customers with excellence, and collaborating and coaching to win.

Job Description

Norfolk Southern Corporation is currently seeking a Big Data Engineer with an affinity for working with others to create successful solutions.  Join a smart, highly skilled team with a passion for technology, where you will work on our state-of-the-art Big Data Platforms. This Data Engineer with a balance of theoretical business intelligence and data analytics knowledge and hands-on experience and exposure to real-world BI problem-solving.  In this role, you will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions, and perform data ingestion development and support duties.  

In this role, you will work with people from many areas of the company to understand their data and BI needs and perform detailed requirements gathering along with analysis in partnership with our team of Data Modelers.  Engage our BI development team to agree on effort estimates and then oversee the progress of the project through its completion.  
 

Responsibilities
  • Defines data requirements, gather, and wrangle large scale of structured and unstructured data, and validate data by running various data tools in the Data Environment.
  • Supports the standardization, customization and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data.
  • Creates data policy and develop interfaces and retention models which requires synthesizing or anonymizing data.
  • Implements statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists and analytics and insights creation in data sourcing and preparation to visualize data and synthesize insights of commercial value.
  • Develops and maintains data engineering best practices and contributes to Insights on data analytics and visualization concepts, methods and techniques.
  • Works closely with the data science and business intelligence teams to develop data models and pipelines for research, reporting, and machine learning.
  • Builds data pipelines that clean, transform, and aggregate data from disparate sources.
  • Employs a variety of languages and tools (e.g. scripting languages) to marry systems together.
  • Applies knowledge of Data Architecture components, leads project teams from requirements to implementation. 

 
 

Skills Required
  • 3-5 years of being in a Data Engineering role manipulating, processing, and extracting value from large datasets.
  • 3+ years of Big Data tools like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS.
  • 3+ years building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures, and data sets with Tibco, IBM or others. 
  • Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog.
  • High-velocity high-volume stream processing with Apache Kafka and Spark Streaming.
  • Strong SQL skills with ability to write intermediate complexity queries.
  • ETL experience with PySpark, Spark SQL or similar.
  • Agile Scrum, Kanban or SAFe experience.

 

Skills Desired 

  • Python (and/or Scala) and PySpark/Scala-Spark.
  • Database solutions like Snowflake, Kudu/Impala, Delta Lake or BigQuery.
  • NoSQL databases, including HBASE and/or Cassandra.
  • Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue.
  • Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series.

 

Education Desired 
Bachelor’s Degree, preferably in Information Systems, Computer Science, Computer Information Systems or related field.

 

Work Conditions
Environment: Office Remote, ideal candidate must be based within 60 miles Atlanta.
Shift Work: No
On-Call: Yes
Weekend Work: No
 
 

Company Overview

Since 1827, Norfolk Southern Corporation (NYSE: NSC) and its predecessor companies have safely moved the goods and materials that drive the U.S. economy. Today, it operates a customer-centric and operations-driven freight transportation network. Committed to furthering sustainability, Norfolk Southern helps its customers avoid 15 million tons of yearly carbon emissions by shipping via rail. Its dedicated team members deliver more than 7 million carloads annually, from agriculture to consumer goods, and is the largest rail shipper of auto products and metals in North America. Norfolk Southern also has the most extensive intermodal network in the eastern U.S., serving a majority of the country’s population and manufacturing base, with connections to every major container port on the Atlantic coast as well as the Gulf of Mexico and Great Lakes. Learn more by visiting www.NorfolkSouthern.com.

 

At Norfolk Southern, we believe in celebrating our individuality. By leveraging the unique backgrounds and viewpoints of our employees, we can create a culture of innovation, respect, and inclusion. We know that employees thrive in a workplace where differing viewpoints, ideas, and experiences are freely shared and valued. As such, we encourage all employees to contribute their distinctive skills and capabilities to our organization.

 

Equal employment opportunities are available to all applicants regardless of race, color, religion, age, sex, national origin, disability status, genetic information, veteran status, sexual orientation, and gender identity. Together, we power progress.