Big Data Engineer

4 weeks ago


Malvern, United States Vision It US Full time
Job DescriptionJob Description

Responsibilities

  • Responsible for working closely with the data analysts for data discovery, data engineers to provide technical guidance for data ingestion to bring data from various sources into the AEP.
  • Responsible for data quality in the platform, monitor data ingestion ,solid understanding of the schemas, identity service, Data lifecycle, query service, data science workspace(for future) , intelligent services(for future), use case playbooks (for future).
  • Responsible for transformations in the tool by writing queries(data prep/data distiller), build & maintain/enhance XDM schemas for batch ingestion & streaming datasets, configure source & destination connectors.
  • Activate & build profile for identity stitching and represent data within AEP ensuring compatibility with downstream analytics & reporting needs and work with Data Engineers for Data Egress from AEP to S3.
  • Responsible to work with the data governance team to ensure privacy & compliance standards are met in AEP by adding the governance tags for the data fields and should always inform governance teams in CDAO.
  • Responsible to work cross-functional teams that would like to build and use the audiences in CDP by training them and providing the segmentation strategy for segmentation builder (Batch, edge & streaming types), helping understand the data, helping understand any limitations in data.
  • Responsible for working closely with the MarTech CDP team to be up to date on the contract policies, new releases, activation of source and destination connectors, Segmentation guardrails within AEP.
  • Understanding of AEP guardrails for batch ingestion, streaming ingestion, RT-CDP profile, data model limits, data size limits, segmentation guardrails.
  • looking someone with experience in Relationship Management , Stakeholder management & high motivated.

Qualifications

  • Adobe Experience Platform
  • Adobe Web SDK
  • Adobe Launch (Data Collection Tags)
  • SQL

Additional plus to have: Adobe Journey Optimizer & Customer Journey Analytics


Required Skills : Data Warehouse
Additional Skills : Big Data
  • Data Engineer

    3 weeks ago


    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionResponsibilitiesWe would like an engineer that can build data and machine learning ingestion patterns and assist with basic data analytics and visualization. We are building a new data hub where we are loading and transforming new data into S3, building machine learning models in Sagemaker and helping our clients query, connect...


  • Malvern, Pennsylvania, United States THE VANGUARD GROUP, INC. MALVERN, PA Full time

    Job Summary:We are seeking a highly skilled Data Engineer, Specialist to join our team at THE VANGUARD GROUP, INC. in MALVERN, PA. As a key member of our data engineering team, you will be responsible for designing and implementing data systems, developing tools for real-time and offline analytic processing, and ensuring data quality and integrity.Key...

  • Data Engineer

    1 month ago


    Malvern, Arkansas, United States CubeSmart Full time

    OverviewThis is a hybrid role base in Malvern, PACubeSmart is currently seeking a Data Engineer to join the Information Technology team at our corporate office in Malvern, PA. The Data Engineer will be responsible for the implementation, development, and optimization of database, data objects, and database scripting with the core database platforms utilized...


  • Malvern, United States THE VANGUARD GROUP, INC. MALVERN, PA Full time

    Write ETL (Extract/Transform/Load) processes, design database systems, utilize data transformation, normalization or consolidation, and develop tools for real-time and offline analytic processing; apply best practices of data quality and lineage; troubleshoot software and processes for data consistency and integrity; integrate large scale data from a variety...


  • Malvern, Pennsylvania, United States Syntricate Technologies Full time

    About the RoleWe are seeking an experienced Agile Project Manager/Scrum Master to lead our Data Science and Engineering Solutions team at Syntricate Technologies. As a key member of our team, you will be responsible for facilitating the development of data science and engineering solutions that incorporate machine learning, AI, experimentation, and...

  • Data Scientist

    1 month ago


    Malvern, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • AWS BIgdata Engineer

    3 months ago


    Malvern, United States Mergen IT Full time

    Design develop and deploy modern data warehouse solutions in AWS cloud platform.• Gather and document business requirements and translate it into technical design documents.• Create technical documentation e.g. data flow diagrams end user guide and technical operations guides.• Create technical documentation e.g. data flow diagrams end user guide...

  • AEP Data Engineer

    4 weeks ago


    Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    An ideal candidate would be someone who has led the implementation of the Adobe Experience Platform (AEP) for seamless data ingestion, schema management, and identity stitching, ensuring data quality, governance compliance, and effective stakeholder collaboration across cross-functional teams.Position Overview:We are seeking a highly motivated Adobe...

  • AEP Data Engineer

    4 weeks ago


    Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    An ideal candidate would be someone who has led the implementation of the Adobe Experience Platform (AEP) for seamless data ingestion, schema management, and identity stitching, ensuring data quality, governance compliance, and effective stakeholder collaboration across cross-functional teams.Position Overview:We are seeking a highly motivated Adobe...


  • Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    Overview:Seeking an AWS Certified Developer to join our client focusing on building scalable, cost-effective data pipelines, data lakes, and analytics systems.Key Responsibilities:Data Ingestion: Implement processes for collecting data from various sources.Data Transformation: Develop ETL processes to cleanse and structure raw data.Data Storage: Manage and...


  • Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    Overview:Seeking an AWS Certified Developer to join our client focusing on building scalable, cost-effective data pipelines, data lakes, and analytics systems.Key Responsibilities:Data Ingestion: Implement processes for collecting data from various sources.Data Transformation: Develop ETL processes to cleanse and structure raw data.Data Storage: Manage and...

  • Head of Data Science

    3 months ago


    Malvern, United States Vanguard Full time

    The Center for Analytics and Insights (CAI) at Vanguard is an enterprise center of excellence for Artificial Intelligence, Machine Learning and Advanced Analytics transforming how data, analytics and AI/ML are used to support strategic decisions and serve Vanguard’s clients. The CAI’s mission is to apply innovative analytical approaches to help tackle...


  • Malvern, United States Vanguard Full time

    Core Responsibilities1. Implements new data strategies for FinTech program under guidance from senior team members.2. Understands and aids in development of process and data architecture, data preparation, and normalization.3. Supports and maintains FinTech data architecture, software, and model libraries and process routines.4. Back-tests and confirms peer...


  • Malvern, United States Vanguard Full time

    Core Responsibilities1. Implements new data strategies for FinTech program under guidance from senior team members.2. Understands and aids in development of process and data architecture, data preparation, and normalization.3. Supports and maintains FinTech data architecture, software, and model libraries and process routines.4. Back-tests and confirms peer...


  • Malvern, United States Goli Tech Full time

    Job DescriptionJob DescriptionResponsibilitiesWe are looking for a Data Center Operations engineer with knowledge and experience in power distribution, cabling infrastructure, DC space allocation, remote hands vendor management, with CMDB (Service Now) and DCIM administration experience (Nlyte, Sunbird, Eaton, Hyperview, etc.) Must be fluent in MS Office...


  • Malvern, United States New Life Staffing LLC Full time

    Job DescriptionJob DescriptionDescription:Salary: 90-110KTravel Required: Typically, 2-3 times a month doing a client visit no more than 3 hoursAutoCad experience is a mustDesign experienceField role client facingPE required 10+ years of experienceSenior Mechanical Engineer with 10 years+ of consulting engineering experience in designing HVAC, plumbing and...


  • Malvern, Arkansas, United States CubeSmart Full time

    OverviewThis is a hybrid role based in Malvern, PAThe Senior Manager of Data Science will play a pivotal role in driving data-driven decision-making and strategic insights for CubeSmart. This leader will oversee a team of data scientists, utilizing advanced analytics, machine learning, and predictive modeling to optimize business operations, enhance customer...


  • Malvern, United States Merge IT Full time

    Our enterprise-level client in Malvern, PA, has a need for an IT Support Engineer. Please see below for full details— Job Notes:--6+ month contract / extendable and likely to go perm with good performance.--Please note the project will start onsite in Spring House, PA. After a few weeks, the remainder of the project will be based out of Malvern, PA.--Drug...


  • Malvern, United States Almirall Full time

    POSITION SUMMARY / MISSION:The Commercial Data and Veeva CRM Analyst will support business decision-making by providing insightful analysis, market trends, and operational efficiency. This role also involves administering, configuring, and supporting the Veeva CRM system, ensuring it is optimized to support business processes and objectives. Importantly,...


  • Malvern, United States Almirall Full time

    POSITION SUMMARY / MISSION:The Commercial Data and Veeva CRM Analyst will support business decision-making by providing insightful analysis, market trends, and operational efficiency. This role also involves administering, configuring, and supporting the Veeva CRM system, ensuring it is optimized to support business processes and objectives. Importantly,...