Data Engineer

4 weeks ago

Atlanta, Georgia, United States iVoyant Full time
About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team.

The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design.

They will ensure the availability and validity of the data to ensure that it fits with the requested business rules.

The Data Engineers will create and maintain the Source-to-Target data mappings, Logical and Physical Data Model and, business and technical test cases to ensure data quality.

In addition, they will also assist a team of developers in developing the data pipeline (using Informatica BDM or Python) to ensure ongoing data collection, consolidation, and management.

The Data Engineers will aid in the optimization of operations by manipulating and aggregating the disparate data sources into a format that is easily digestible by both data scientists and statistically adept colleagues.

Their core responsibility will be to combine large volumes of disparate complex data, conduct quality checks on the data, manipulate the data and ensure continuous access to a clean format of the operational data for data scientists and other stakeholders.

Responsibilities Take ownership of the Functional Data Domain assigned to the Data Engineer.
Gather knowledge of the business, functions, and their data analysis needs along with business's relationship with the Data.
Work with Functional team to understand requirements, data sources and business rules.

Identify, Analyze and Profile the data across various source systems to understand and ensure that data fits the business requirements.

Raise any data anomalies and work with the functional users to close any anomalies or data gaps.
Identify relationships across multiple source systems; and create reference data with the help of data stewards.

Design the Dimensional Data Model, Data Engineering Pipelines, Data Quality and Validation rules based on the business requirements and rules that would include any error handing, exception management and data quality routines to expose the anomalies in the data.

Finalize the technical Source-to-Target mapping to develop the data pipelines from source systems to the dimensional model.
Work with the team of Developer(s) for the technical implementation of the Data Pipelines.
Ensure that the Unit and Integration tests complete successfully.
Drive the QA/UAT with the Functional users and ensure a deployment to higher environments.
Designs and jointly develops the data architecture with data architect and ensures security and maintenance Identifies gaps and implements solutions for data security, quality and automation of processes Supports maintenance, bug fixing and performance analysis along data pipeline Diagnoses existing architecture and data maturity and identifies gaps Gather requirements, assess gaps and build roadmaps and architectures to help the analytics driven organization achieve its goals Qualifications 7
years of experience in data engineering.
7
years of working on data analysis using SQL, PowerBI and other equivalent tools 4
years of experience in data modeling, data analysis and working with business.
3
years of experience in leading a team of developers and drive technical solutions.

Required Skills Knowledge of SQL, databases and tables structure to query the data from various places, integrate and present the results to the business Knowledge of ETL, data pipelines using Informatica (DEI/BDM) or equivalent technologies.

Strong critical thinking and problem solving skills Success at working on cross-functional teams to meet a common goal Self-starter with a high sense of urgency Other Skills Knowledge of Big Data platforms (e.
g.
Hadoop, Map/Reduce, Spark, HBase, HDInsight, Data Bricks, Hive) and with programming languages like UNIX shell scripting, Python etc.
Knowledge of reporting and BI packages e.
g.
, PowerBI, Tableau, SAP BO etc.

Education Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus Recommended Skills Apache H Base Apache Hadoop Apache Hive Apache Spark Architecture Automation Apply to this job.

Think you're the perfect candidate? Apply on company site

Estimated Salary:
$20 to $28 per hour based on qualifications.

  • Data Engineer

    5 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Senior Data Engineer

    1 month ago

    Atlanta, Georgia, United States Motion Recruitment Full time

    Every year, nearly 200 million travelers trust our client to get them where they're going. Take your career to new heights by working for this longstanding leader in air travel that services more worldwide destinations than any other airline.We are looking for a Senior Data Engineer to join our team for a 12 month contract in Atlanta, GA. Contract Duration:...

  • Senior Data Engineer

    9 hours ago

    Atlanta, Georgia, United States Georgia Tech Research Institute Full time

    About the RoleWe are seeking a highly skilled Big Data Software Engineer to join our team at the Georgia Tech Research Institute. As a key member of our Health Emerging & Advanced Technologies (HEAT) Division, you will play a critical role in designing, developing, and implementing secure and scalable big data solutions for healthcare data analytics.Key...

  • Key Data Engineer

    2 months ago

    Atlanta, Georgia, United States EPAM Systems Full time

    We are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.What You'll DoBuild and maintain secure and compliant...

  • Big Data Engineer

    1 month ago

    Atlanta, Georgia, United States Norfolk Southern Corp. Full time

    Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail. As part of Norfolk Southern, you'll join a collaborative team where there are opportunities for growth across...

  • Data Engineer II

    3 weeks ago

    Atlanta, Georgia, United States Bank of America Corporation Full time

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day.One of the keys to driving Responsible Growth is being a great place to work for our...

  • Data Engineers

    3 months ago

    Atlanta, Georgia, United States Search Discovery Full time

    If you love data and are looking for unlimited growth opportunities, we would love to talk with you about joining Further in the near future.Being a professional services organization, we are always one week away from our next potential deal closing. We love connecting with talented individuals so when that next opportunity is here, we already have you in...

  • Big Data Software Engineer

    9 hours ago

    Atlanta, Georgia, United States Georgia Tech Research Institute Full time

    About the RoleWe are seeking a highly skilled Big Data Software Engineer to join our team at the Georgia Tech Research Institute. As a key member of our Health Emerging & Advanced Technologies (HEAT) Division, you will play a critical role in designing, developing, and implementing secure and scalable big data solutions for healthcare data analytics.Key...

  • Data Center Technician, DCC Communities

    3 weeks ago

    Atlanta, Georgia, United States Amazon Data Services, Inc. Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure.In other words, we're the people who keep the cloud running.We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on.We...

  • Senior Manager – Data Engineering

    2 months ago

    Atlanta, Georgia, United States Currency Cloud Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year.Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Staff Data Engineer

    1 month ago

    Atlanta, Georgia, United States Currency Cloud Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Senior Data Engineer, Data Ingestion

    1 month ago

    Atlanta, Georgia, United States SIRIUS Full time

    Who We Are:SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners -- in the car, at home, and anywhere on the go with connected devices....

  • Data and Analytics Cloud Engineering Manager

    1 month ago

    Atlanta, Georgia, United States Truist Full time

    The position is described below.If you want to apply, click the Apply Now button at the top or bottom of this page.After you click Apply Now and complete your application, you'll be invited to create a profile, which will let you see your application status and any communications.If you already have a profile with us, you can log in to check status.Need...

  • Mechanical Engineer

    4 hours ago

    Atlanta, Georgia, United States Meade Engineering, Inc. Full time

    About the RoleMeade Engineering, Inc. is seeking an experienced Mechanical Engineer to join our design team as a key member. This role will involve working on high-profile construction projects, including data centers, industrial buildings, and offices.Key ResponsibilitiesDrive projects forward throughout design and construction phases, ensuring timely...

  • Staff Data Engineer, Platform Infrastructure

    2 months ago

    Atlanta, Georgia, United States SiriusXM Radio Full time

    Who We Are:SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners in the car, at home, and anywhere on the go with connected...

  • Staff Data Engineer, Platform Infrastructure

    2 months ago

    Atlanta, Georgia, United States Sirius XM Radio, Inc. Full time

    ResponsibilitiesWho We Are:SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners - in the car, at home, and anywhere on the go with...

  • Cloud Data Engineering Lead

    7 minutes ago

    Atlanta, Georgia, United States Tata Consultancy Services Full time

    Job DescriptionWe are seeking a highly skilled Azure Sr Data Engineer to join our team at Tata Consultancy Services.Key Responsibilities:Cloud Application Development: Design and develop scalable and secure applications that can be hosted on the Azure cloud platform.Framework and Core Functionality: Design and develop frameworks and core functionality to...

  • Compliance Staff Data Engineer

    2 months ago

    Atlanta, Georgia, United States Visa Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year.Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Data Center Engineer

    2 hours ago

    Atlanta, Georgia, United States Ericsson Full time

    About this opportunity:We are seeking a highly motivated and skilled Data Center Engineer to join our team at Ericsson. The ideal candidate will have experience in racking, cabling, and stacking equipment, decommissioning, break-fix, remote hands services, and hardware replacement. The Engineer will ensure the seamless operation of our data center...

  • Data Engineer

    5 months ago

    Atlanta, Georgia, United States Atechstar Full time

    Job descriptionYour RoleA Day in the LifeDesign and build interfaces that facilitate workflows between the Data shop platform and third-party client systems as scoped while complying with respective standards and industry best practices. Define and document best practices along with thorough message specifications. Monitor configure and tune the...