Data Engineer

4 months ago

Atlanta, United States iVoyant Full time

About the job Data Engineer

iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design. They will ensure the availability and validity of the data to ensure that it fits with the requested business rules. The Data Engineers will create and maintain the Source-to-Target data mappings, Logical and Physical Data Model and, business and technical test cases to ensure data quality. In addition, they will also assist a team of developers in developing the data pipeline (using Informatica BDM or Python) to ensure ongoing data collection, consolidation, and management.

The Data Engineers will aid in the optimization of operations by manipulating and aggregating the disparate data sources into a format that is easily digestible by both data scientists and statistically adept colleagues. Their core responsibility will be to combine large volumes of disparate complex data, conduct quality checks on the data, manipulate the data and ensure continuous access to a clean format of the operational data for data scientists and other stakeholders.

Responsibilities

  • Take ownership of the Functional Data Domain assigned to the Data Engineer. Gather knowledge of the business, functions, and their data analysis needs along with business's relationship with the Data.
  • Work with Functional team to understand requirements, data sources and business rules.
  • Identify, Analyze and Profile the data across various source systems to understand and ensure that data fits the business requirements. Raise any data anomalies and work with the functional users to close any anomalies or data gaps.
  • Identify relationships across multiple source systems; and create reference data with the help of data stewards.
  • Design the Dimensional Data Model, Data Engineering Pipelines, Data Quality and Validation rules based on the business requirements and rules that would include any error handing, exception management and data quality routines to expose the anomalies in the data.
  • Finalize the technical Source-to-Target mapping to develop the data pipelines from source systems to the dimensional model.
  • Work with the team of Developer(s) for the technical implementation of the Data Pipelines. Ensure that the Unit and Integration tests complete successfully. Drive the QA/UAT with the Functional users and ensure a deployment to higher environments.
  • Designs and jointly develops the data architecture with data architect and ensures security and maintenance
  • Identifies gaps and implements solutions for data security, quality and automation of processes
  • Supports maintenance, bug fixing and performance analysis along data pipeline
  • Diagnoses existing architecture and data maturity and identifies gaps
  • Gather requirements, assess gaps and build roadmaps and architectures to help the analytics driven organization achieve its goals
Qualifications
    • 7+ years of experience in data engineering.
    • 7+ years of working on data analysis using SQL, PowerBI and other equivalent tools
    • 4+ years of experience in data modeling, data analysis and working with business.
    • 3+ years of experience in leading a team of developers and drive technical solutions.
Required Skills
    • Knowledge of SQL, databases and tables structure to query the data from various places, integrate and present the results to the business
    • Knowledge of ETL, data pipelines using Informatica (DEI/BDM) or equivalent technologies.
    • Strong critical thinking and problem solving skills
    • Success at working on cross-functional teams to meet a common goal
    • Self-starter with a high sense of urgency
Other Skills
  • Knowledge of Big Data platforms (e.g. Hadoop, Map/Reduce, Spark, HBase, HDInsight, Data Bricks, Hive) and with programming languages like UNIX shell scripting, Python etc.
  • Knowledge of reporting and BI packages e.g., PowerBI, Tableau, SAP BO etc.

Education

Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus

  • Data Center Engineering Operations Technician

    6 months ago

    Atlanta, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be Earth's most Customer-centric Company and Earth's Best Employer. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build and expand The Cloud, this is your chance to make history.Amazon Data Services Inc. is currently hiring for a Engineering Operations Tech (EOT) to support our...

  • Data Engineer

    1 month ago

    atlanta, United States Factspan Full time

    Job Title: Data EngineerJob Type: Full TimeJob Location: Atlanta, GAJob Description:You will be a core member of the Data Platform and Analytics Engineering team that is building the infrastructural foundations for data aggregation, management, and insights. Our data and engineering teams build products that power our operations (warehouse, transportation,...

  • Data Engineer

    2 months ago

    atlanta, United States Factspan Full time

    Job Title: Data EngineerJob Type: Full TimeJob Location: Atlanta, GAJob Description:You will be a core member of the Data Platform and Analytics Engineering team that is building the infrastructural foundations for data aggregation, management, and insights. Our data and engineering teams build products that power our operations (warehouse, transportation,...

  • Data Engineer

    2 months ago

    Atlanta, United States Factspan Full time

    Job Title: Data EngineerJob Type: Full TimeJob Location: Atlanta, GAJob Description:You will be a core member of the Data Platform and Analytics Engineering team that is building the infrastructural foundations for data aggregation, management, and insights. Our data and engineering teams build products that power our operations (warehouse, transportation,...

  • Data Engineer

    1 week ago

    Atlanta, United States Insight Global Full time

    We are actively seeking a skilled Data Engineer to join our innovative team in Atlanta. This is a contract-to-hire position with a decision expected by the end of the year. The ideal candidate will have extensive experience working with offshore teams and a strong background in data engineering and data science projects.Responsibilities:Collaborate with a...

  • Data Engineer

    16 hours ago

    Atlanta, United States RIT Solutions, Inc. Full time

    Data Engineer | TELECOMMUTE TELECOMMUTE, MN Job Description 100% telecommute Hours: Regular day working hours with some flexibility, but must be available for most of Central Time working hours with a heavier focus on availability in the mornings. Project: Working with customers to design data extracts based on their reporting needs ...

  • Data Analyst

    16 hours ago

    Atlanta, United States TechnoGen Full time

    Data Analyst (Data Engineer) location Atlanta GA Qualifications: Position title : Data Analyst Qualifications • Bachelor of Science degree in Computer Science or equivalent • At least 5+ years of post-degree professional experience • Required experience in SQL and other querying languages to convert into modern data tools or jobs • Strongly preferred...

  • Senior Data Engineer

    1 month ago

    atlanta, United States Saxon Global Full time

    Job Description: Senior Data EngineerLocation: Atlanta, GAType: Full-timeSalary : $130K/annumVisa : USC/GC/H4 EADNO OPT and H1B please9-10+ Years of candidate can apply for this role Role Overview:We are seeking a skilled Data Engineer with hands-on experience in Snowflake to join our dynamic team. In this role, you will play a crucial part in designing,...

  • Senior Data Engineer

    1 month ago

    atlanta, United States Saxon Global Full time

    Job Description: Senior Data EngineerLocation: Atlanta, GAType: Full-timeSalary : $130K/annumVisa : USC/GC/H4 EADNO OPT and H1B please9-10+ Years of candidate can apply for this role Role Overview:We are seeking a skilled Data Engineer with hands-on experience in Snowflake to join our dynamic team. In this role, you will play a crucial part in designing,...

  • Senior Data Engineer

    1 month ago

    Atlanta, United States Saxon Global Full time

    Job Description: Senior Data EngineerLocation: Atlanta, GAType: Full-timeSalary : $130K/annumVisa : USC/GC/H4 EADNO OPT and H1B please9-10+ Years of candidate can apply for this role Role Overview:We are seeking a skilled Data Engineer with hands-on experience in Snowflake to join our dynamic team. In this role, you will play a crucial part in designing,...

  • Data Engineer

    20 hours ago

    Atlanta, United States GATE Insight, Inc. Full time

    Job Title: Data Engineer Job Location: Atlanta, GA (Onsite Day one) Experience : 8 years Job Description Have hands-on knowledge of Spark (Scala preferred), Hadoop, Kafka etc Develop batch and streaming solutions using various Big Data technology

  • Data Engineer

    1 week ago

    Atlanta, United States S.P. Richards Company Full time

    Job DescriptionJob DescriptionSummary: Seeking a skilled Data Engineer to join our dynamic Business Intelligence team. Responsible for designing, developing, and maintaining our data infrastructure, ensuring reliable and efficient data flow and accessibility for analysis, decision-making, and internal data processes. Must possess a deep understanding of...

  • Data Engineer

    15 hours ago

    Atlanta, United States S.P. Richards Full time

    Summary: Seeking a skilled Data Engineer to join our dynamic Business Intelligence team. Responsible for designing, developing, and maintaining our data infrastructure, ensuring reliable and efficient data flow and accessibility for analysis, decision-making, and internal data processes. Must possess a deep understanding of designing, implementing, and...

  • Data Engineer

    17 hours ago

    Atlanta, United States Vimerse InfoTech Inc Full time

    Tiitle: Data Engineer Location- Atlanta, GA Hybrid Role Must have skills : Azure Data Factory, Databricks Good to have skills: Azure Synapse Job Description: *Hands-on experience with Azure Data Factory * Hands-on experience with Azure Databricks * Excellent SQL and T-SQL skills * Experience of working in Agile teams * Excellent communication and...

  • snowflake data engineer

    23 hours ago

    Atlanta, United States TechnoGen Full time

    Expert Level - Snow Flake , Azure Data Bricks , Data Modelling , looking for a Sr. Azure Data Engineer who is self driven, can lead a team of Data engineers working on an Onshore-Offshore model collaborating with customer IT SMEs, Business partners Job responsibilities - Azure DataBricks Snowflake Python Azure Data Factory Data Modeling Data Analysis Azure...

  • Data Engineer

    18 hours ago

    Atlanta, United States TEKsystems Full time

    *Description* Our customer is looking to hire 2-3 W2 Data Engineers. Resources can sit 100% remote in US however must be able to work EST hours. The consultants will be part of the Data Analytics organization, and will focus on either Sales Analytics or Services Analytics related projects. My manager is still confirming projects with their business...

  • GCP Data Engineer

    18 hours ago

    Atlanta, United States SysMind Tech Full time

    Job Title GCP Data Engineer Key words to search in resume GCP Data Engineer Technical/Functional Skills -MUST HAVE SKILLS * Strong Python Development Experience is mandatory * 8 + years of Data Engineering experience working with both distributed architectures, ETL, EDW and Big Data technologies * Demonstrable knowledge & Experience using Google Cloud Big...

  • Data Engineer with ML Engineering Experience

    3 days ago

    Atlanta, United States Highbrow LLC Full time

    Job DescriptionEducation and Experience· Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. A Master's degree or relevant certifications (e.g., Google Professional Data Engineer) is a plus.· 5+ years of experience in data engineering, with at least 2-3 years of experience in machine learning engineering or deploying ML...

  • Lead Data Engineer

    3 weeks ago

    Atlanta, United States ATech Placement Full time

    Job DescriptionJob DescriptionWe are looking for an experienced Lead Data Engineer to mentor and lead the buildout and support of our Data Lake solutions. This person will be a hands-on partner who can work across various business units and technical teams to build the next generation data solutions for Company. The required skills are:· 7+ yrs data...

  • Data engineer

    23 hours ago

    Atlanta, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Data engineer - data science/ML engineer Location: Atlanta, GA [ (Day one Onsite) Job Description: Bs degree in CS / Software / Electrical with 5 years experience Experience in building and scaling gen AI applications, frameworks like Langchain / PGVector / Pinecone / AzureML Must have Model Deployment experience along with GenAI frameworks,...