Data Engineer

1 month ago

Atlanta, United States iVoyant Full time

About the job Data Engineer

iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design. They will ensure the availability and validity of the data to ensure that it fits with the requested business rules. The Data Engineers will create and maintain the Source-to-Target data mappings, Logical and Physical Data Model and, business and technical test cases to ensure data quality. In addition, they will also assist a team of developers in developing the data pipeline (using Informatica BDM or Python) to ensure ongoing data collection, consolidation, and management.

The Data Engineers will aid in the optimization of operations by manipulating and aggregating the disparate data sources into a format that is easily digestible by both data scientists and statistically adept colleagues. Their core responsibility will be to combine large volumes of disparate complex data, conduct quality checks on the data, manipulate the data and ensure continuous access to a clean format of the operational data for data scientists and other stakeholders.

Responsibilities

  • Take ownership of the Functional Data Domain assigned to the Data Engineer. Gather knowledge of the business, functions, and their data analysis needs along with business's relationship with the Data.
  • Work with Functional team to understand requirements, data sources and business rules.
  • Identify, Analyze and Profile the data across various source systems to understand and ensure that data fits the business requirements. Raise any data anomalies and work with the functional users to close any anomalies or data gaps.
  • Identify relationships across multiple source systems; and create reference data with the help of data stewards.
  • Design the Dimensional Data Model, Data Engineering Pipelines, Data Quality and Validation rules based on the business requirements and rules that would include any error handing, exception management and data quality routines to expose the anomalies in the data.
  • Finalize the technical Source-to-Target mapping to develop the data pipelines from source systems to the dimensional model.
  • Work with the team of Developer(s) for the technical implementation of the Data Pipelines. Ensure that the Unit and Integration tests complete successfully. Drive the QA/UAT with the Functional users and ensure a deployment to higher environments.
  • Designs and jointly develops the data architecture with data architect and ensures security and maintenance
  • Identifies gaps and implements solutions for data security, quality and automation of processes
  • Supports maintenance, bug fixing and performance analysis along data pipeline
  • Diagnoses existing architecture and data maturity and identifies gaps
  • Gather requirements, assess gaps and build roadmaps and architectures to help the analytics driven organization achieve its goals
Qualifications
    • 7+ years of experience in data engineering.
    • 7+ years of working on data analysis using SQL, PowerBI and other equivalent tools
    • 4+ years of experience in data modeling, data analysis and working with business.
    • 3+ years of experience in leading a team of developers and drive technical solutions.
Required Skills
    • Knowledge of SQL, databases and tables structure to query the data from various places, integrate and present the results to the business
    • Knowledge of ETL, data pipelines using Informatica (DEI/BDM) or equivalent technologies.
    • Strong critical thinking and problem solving skills
    • Success at working on cross-functional teams to meet a common goal
    • Self-starter with a high sense of urgency
Other Skills
  • Knowledge of Big Data platforms (e.g. Hadoop, Map/Reduce, Spark, HBase, HDInsight, Data Bricks, Hive) and with programming languages like UNIX shell scripting, Python etc.
  • Knowledge of reporting and BI packages e.g., PowerBI, Tableau, SAP BO etc.

Education

Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus

  • Data Engineer

    2 months ago

    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    2 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Center Engineering Operations Technician

    1 week ago

    Atlanta, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be Earth's most Customer-centric Company and Earth's Best Employer. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build and expand The Cloud, this is your chance to make history.Amazon Data Services Inc. is currently hiring for a Engineering Operations Tech (EOT) to support our...

  • Data Center Engineering Operations Technician

    2 weeks ago

    Atlanta, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be Earth's most Customer-centric Company and Earth's Best Employer. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build and expand The Cloud, this is your chance to make history.Amazon Data Services Inc. is currently hiring for a Engineering Operations Tech (EOT) to support our...

  • Data Engineer

    6 days ago

    Atlanta, United States WebMD Full time

    Description Position at WebMD WebMD Ignite is a full service growth engine for health systems and health-centric organizations. Our comprehensive experience, datasets and breadth of capabilities maximize our partners' marketing investments resulting in an enhanced reputation, deeper loyalty and profitable growth. Position Summary The Web Data Engineer is...

  • Data Engineer

    2 weeks ago

    Atlanta, Georgia, United States Howmet Aerospace Full time

    Howmet Aerospace seeks an experienced, driven, self-starter to fill the role of Data Engineer. Successful candidates will have strong capabilities and demonstrated success in the following area: Modeling, designing and building data pipelines and workflows, in both on-premise and cloud environments, to support the AI and analytics needs of data...

  • Data Engineer

    7 days ago

    Atlanta, Georgia, United States Howmet Aerospace Full time

    Howmet Aerospace seeks an experienced, driven, self-starter to fill the role of Data Engineer. Successful candidates will have strong capabilities and demonstrated success in the following area: Modeling, designing and building data pipelines and workflows, in both on-premise and cloud environments, to support the AI and analytics needs of data...

  • Data Engineer

    6 days ago

    Atlanta, United States Kaizen Analytix Full time

    As a Data Engineer, you will be expected to work independently, collect requirements, perform data mapping to warehouse, hands on prototyping, ad hoc process of data files and transform them into structured data that can be ingested on a production basis. The ideal candidate will have a strong background in data engineering, including experience with SQL...

  • Data Engineer

    7 days ago

    Atlanta, Georgia, United States Kaizen Analytix Full time

    As a Data Engineer, you will be expected to work independently, collect requirements, perform data mapping to warehouse, hands on prototyping, ad hoc process of data files and transform them into structured data that can be ingested on a production basis. The ideal candidate will have a strong background in data engineering, including experience with SQL...

  • Data Engineer

    2 weeks ago

    Atlanta, United States Kaizen Analytix Full time

    As a Data Engineer, you will be expected to work independently, collect requirements, perform data mapping to warehouse, hands on prototyping, ad hoc process of data files and transform them into structured data that can be ingested on a production basis. The ideal candidate will have a strong background in data engineering, including experience with SQL...

  • Data Engineer

    2 weeks ago

    Atlanta, United States Acunor Full time

    Title: Data EngineerLocation: Atlanta, GA (Onsite on Hybrid mode from day 1)Duration: 12+ Months Contract Qualifications:• Bachelor of Science degree in Computer Science or equivalent• At least 7 years of post-degree professional experience• At least 5+ years of Airline industry experience• 4+ years development experience building and maintaining ETL...

  • Data Engineer

    7 days ago

    Atlanta, United States Acunor Full time

    Title: Data EngineerLocation: Atlanta, GA (Onsite on Hybrid mode from day 1)Duration: 12+ Months Contract Qualifications:• Bachelor of Science degree in Computer Science or equivalent• At least 7 years of post-degree professional experience• At least 5+ years of Airline industry experience• 4+ years development experience building and maintaining ETL...

  • Data Engineer

    1 week ago

    Atlanta, United States Cynet Systems Full time

    Job Description: Responsibilities: pply broad knowledge of technology options, technology platforms, design techniques and approaches across the Data Engineering ecosystem to build systems that meet quality needs. Build systems and datasets using software engineering best practices, data management fundamentals, data storage principles, recent advances...

  • Data Engineer

    3 days ago

    Atlanta, United States GSquared Group Full time

    Title: Data Engineer / GCP Terms: Contract to hire Location: Atlanta area HYBRID ROLEMUST LIVE IN ATLANTA, GEORGIANo 3rd party agencies at this timeAre you looking for a career opportunity that allows you to grow your career? If so, this opportunity will genuinely excite you! Our client is transforming how their organization services their customers while...

  • Salesforce DevOps Engineer

    2 weeks ago

    Atlanta, United States NTT DATA Full time

    We are currently seeking a Senior Salesforce DevOps Engineer to join our team in Atlanta, Georgia! Job Description This position will be responsible for the source code control, CI/CD, testing, monitoring and automation of Salesforce deployments using Jenkins. The successful candidate will have functional and technical expertise in the configuration,...

  • Data Engineer

    2 months ago

    Atlanta, United States Scalene Works People Solution LLP Full time

    Requisition/Position Title Senior Azure Data Engineer Employment (Regular/Consultant) Regular Position Type (New/Replacement) New Experience Level (Min-Max) >6 Years Mandatory Skillset (Maximum 5) Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake Detailed Job Description Job Responsibilities: · Design, develop, and implement robust...

  • Data Engineer

    1 week ago

    Atlanta, United States Scalene Works People Solution LLP Full time

    Requisition/Position Title Senior Azure Data Engineer Employment (Regular/Consultant) Regular Position Type (New/Replacement) New Experience Level (Min-Max) >6 Years Mandatory Skillset (Maximum 5) Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake Detailed Job Description Job Responsibilities: · Design, develop, and implement robust...

  • Salesforce DevOps Engineer

    2 weeks ago

    Atlanta, United States NTT DATA Full time

    We are currently seeking a Senior Salesforce DevOps Engineer to join our team in Atlanta, Georgia! Job Description: This position will be responsible for the source code control, CI/CD, testing, monitoring and automation of Salesforce deployments using Jenkins. The successful candidate will have functional and technical expertise in the configuration,...

  • Data Engineer

    1 week ago

    Atlanta, United States Marathon TS Full time

    Job DescriptionJob DescriptionData Engineer is responsible for supporting our enterprise data warehouse for our Supply Chain Operations. As a Data Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production...

  • Data Engineer

    7 days ago

    Atlanta, United States Marathon TS Full time

    Job DescriptionJob DescriptionData Engineer is responsible for supporting our enterprise data warehouse for our Supply Chain Operations. As a Data Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production...