See more Collapse

data engineer

1 month ago

Malvern, United States Skilzmatrix Full time
Job DescriptionJob DescriptionResponsibilities:
Integrate AWS Services such as Lambda, DynamoDB, EC2, RDS, S3, Athena, Data pipeline, API gateway, Glue, EMR etc. in reporting application to improve the accessibility/efficiency
Write scripts and troubleshoot for performance using relevant programming languages like SQL, Spark and Python
Develop and Implement ETL jobs using AWS Glue to extract, transform, and load data from various sources
Design and implement scalable data solutions using AWS, PySpark, Python and other related services
Work closely with Data and Analytics team to build Data Lake using various AWS services like EMR, S3, DynamoDB, Lambda etc., Apache Airflow, PySpark, and HIVE
Use AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources
Work on migration of PySpark framework into AWS Glue for enhanced processing
Design and Develop web applications using Java EE, Python, Web Services and AWS Qualified candidates will be responsible for API design, implementation, testing and prod support.
They will work on a data modernization project which will utilize multiple AWS Services Tech needs: Java AWS Services - Glue, EMR API development SpringBoot services
They are aws tech experience. dynamo and/or azure db.
Knowledge of Resiliency patterns and chaos testing. Kafka knowledge
Nice to have:Architecture experience in cloud or legacy systems. Building large scale systems. Java 11 understanding. spring boot experience and jersey framework knowledge, micro service architecture, graph ql implementation, Performance tuning of Java rest APIs.
Design, Model, Develop, Test and Implement using Big Data technologies like Python, Pyspark, Hadoop, UNIX and SQL

We have other current jobs related to this field that you can find below

  • Data Engineer

    2 weeks ago

    Malvern, United States Cogent Infotech Corp Full time

    Desired Skills and Experience: *- 6+ years of experience in the Data Engineering Space - Experience writing ETL processes, designing database systems and developing tools for real-time and offline analytic processing. - Experience with AWS Technologies like: Glue ETL, S3 RDS etc. - Strong experience with PySpark, preferably for building Data Pipelines -...

  • Data Engineer

    3 days ago

    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionResponsibilitiesWe would like an engineer that can build data and machine learning ingestion patterns and assist with basic data analytics and visualization. We are building a new data hub where we are loading and transforming new data into S3, building machine learning models in Sagemaker and helping our clients query, connect...

  • Data Engineer, Specialist

    2 weeks ago

    Malvern, United States The Vanguard Group Full time

    Data Engineer, Specialist (The Vanguard Group, Inc. / Malvern, PA) -- Analyze and process Extract, Transform and Load (ETL) Data Requests; support of NonProd and Production Environments, both domestic and internationally based; engage in projects related to design and enhancement of existing Infrastructure; provide technical consultation and support to...

  • Data Engineer

    2 weeks ago

    Malvern, United States CyberTec Full time

    Client: Vanguard New Role: Data Engineer Pay Rate: $68.00/hr. on C2C) Location: Malvern, PA(Hybrid 3 days a week, must be onsite on day 1) Owns and manages the overall data strategy and architecture for Charitable (enterprise-wide) Understand the data and data needs across both SaaS applications and their on-prem legacy apps Go deep on evolving data &...

  • Data Engineer

    3 weeks ago

    Malvern, United States CubeSmart Full time

    Overview This is a hybrid role base in Malvern, PA CubeSmart is currently seeking a Data Engineer to join the Information Technology team at our corporate office in Malvern, PA. The Data Engineer will be responsible for the implementation, development, and optimization of database, data objects, and database scripting with the core database platforms...

  • Data Engineer

    2 weeks ago

    Malvern, Arkansas, United States CubeSmart Full time

    OverviewThis is a hybrid role base in Malvern, PACubeSmart is currently seeking a Data Engineer to join the Information Technology team at our corporate office in Malvern, PA. The Data Engineer will be responsible for the implementation, development, and optimization of database, data objects, and database scripting with the core database platforms utilized...

  • Big Data Engineer

    1 week ago

    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionResponsibilitiesResponsible for working closely with the data analysts for data discovery, data engineers to provide technical guidance for data ingestion to bring data from various sources into the AEP. Responsible for data quality in the platform, monitor data ingestion ,solid understanding of the schemas, identity service,...

  • Data Engineer

    1 month ago

    Malvern, United States Goli Tech Full time

    Job DescriptionJob DescriptionData Management AnalystProvides data domain aligned support for a given business area. Ensures the quality and accuracy of data. Serves as a thought partner and point of contact to resolve operational and service issues. Will perform data validation and documenting use casesData Management Analysts will be hybridized as a...

  • Data Engineer

    4 weeks ago

    Malvern, United States Veridic Solutions Full time

    Title: Big Data AWS EngineerLocation: Malvern PAContractResponsibilitiesLearns and experiments with new technologies, tools and processes.Learns and understands client area business functions and requirements.Determines the appropriate technical tool to address the client's business needs.Designs, implements, and deploys cloud platforms to support and meet...

  • Data Engineer

    1 month ago

    Malvern, United States Veridic Solutions Full time

    Title: Big Data AWS EngineerLocation: Malvern PAContractResponsibilitiesLearns and experiments with new technologies, tools and processes.Learns and understands client area business functions and requirements.Determines the appropriate technical tool to address the client's business needs.Designs, implements, and deploys cloud platforms to support and meet...

  • Data Engineer- Malvern, PA

    2 weeks ago

    Malvern, United States Georgia IT Inc Full time

    Job Title: Data Engineer Location: CA, PA Duration: Contract Rate: DOE(USC. GC, GCEAD and L2EADS are only preferred)Candidate Should be a local to Malvern or Charlotte, Relocation wont work on thisDuties and responsibilities: Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...

  • Data Scientist

    3 weeks ago

    Malvern, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • Data Scientist

    3 weeks ago

    Malvern, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • AEP Data Engineer

    6 days ago

    Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    An ideal candidate would be someone who has led the implementation of the Adobe Experience Platform (AEP) for seamless data ingestion, schema management, and identity stitching, ensuring data quality, governance compliance, and effective stakeholder collaboration across cross-functional teams.Position Overview:We are seeking a highly motivated Adobe...

  • AEP Data Engineer

    7 days ago

    Malvern, United States Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council ) Full time

    An ideal candidate would be someone who has led the implementation of the Adobe Experience Platform (AEP) for seamless data ingestion, schema management, and identity stitching, ensuring data quality, governance compliance, and effective stakeholder collaboration across cross-functional teams.Position Overview:We are seeking a highly motivated Adobe...

  • Big Data Consultant

    4 weeks ago

    Malvern, United States Veridic Solutions Full time

    Big Data EngineerLocation: Dallas, TX Required / Must HaveSpark/AWS Analytics/Lambda/Dynamo/Aurora Development experience with Python, APIM, Ansible, a little bit of C#, Hadoop (with parquet files) Experience with Microsoft Azure services (must have Azure Functions, Azure Storage Accounts, Azure Data Lake)

  • Big Data Consultant

    1 month ago

    Malvern, United States Veridic Solutions Full time

    Big Data EngineerLocation: Dallas, TX Required / Must HaveSpark/AWS Analytics/Lambda/Dynamo/Aurora Development experience with Python, APIM, Ansible, a little bit of C#, Hadoop (with parquet files) Experience with Microsoft Azure services (must have Azure Functions, Azure Storage Accounts, Azure Data Lake)

  • API Developer/Data Engineer

    1 month ago

    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionDesign and Develop web applications using Java EE, Python, Web Services and AWS Qualified candidates will be responsible for API design, implementation, testing and prod support. They will work on a data modernization project which will utilize multiple AWS Services Tech needs: Java AWS Services - GlueEMR API development...

  • Data Analyst

    3 weeks ago

    Malvern, United States Nava Software Solutions LLC Full time

    Job DescriptionJob DescriptionNAVA Software solutions is looking for a Data Analyst Details:Data Analyst EngineerLocation: Malvern, PA - Hybrid Duration: 6 -12 monthsTwo Round Interview Process Round 1: Technical Interview Round 2: Case Study (Candidates will be given a takeaway case study with the expectation of returning it completed within a few days)...

  • Data Analyst Engineer

    3 weeks ago

    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionJob DescriptionAnalyzes data, assesses trends and develops actionable insights and recommendations in support of business objectives.Core Responsibilities1. Engages with internal partners to understand business strategy, questions and goals. Brings structure to business requests, translates requirements into an analytical...