AWS Data Engineer

21 hours ago

Newark, NJ, United States CData Software Full time

Skill: AWS Data Engineer

  • AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python.
  • Minimum 5 years of professional experience in data integration and management.
  • 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark.
  • Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud,Talend etc.).
  • Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
  • Expertise with Python Language and Apache Spark.
  • Have working experience in projects involving these.
  • Strong hands on exposure to AWS Analytics services particulary Lambda,Step functions,EMR, Athena, Glue, Data-Pipelines.
  • Understanding and technical knowledge on AWS service like EC2, S3.
  • Should have used these technologies in previously executed projects.
  • Strong AWS development experience for data ETL/pipeline/integration/automation work.
  • Should have a deep understanding of BI & Analytics Solution development lifecycle.
  • Full Flexed in AWS cloud development & Automation for Analytics.
  • Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python.
  • Strong experience on real-time scalable workflow implementation.
Responsibilities:
  • Developer will be part of an Agile Development team focusing on Sprint Agile implementation.
  • Developer will be developing data ingestion pipelines from heterogenous sources like databases, Files, APIs, Kafka streaming etc using a variety of services.
  • Developer may be assigned to deliver the data from AWS data platform for different consumption use cases and services.
  • Developer may be engaged in peer reviews to ensure code accuracy and well architected architecture and implementation.
  • Developer may be asked to do client demo or another project demo.
  • Developer must be proactive in escalating impacting issues and be resourceful to look for alternative.
  • Developer may have to work on tight timelines sometimes.

  • AWS Data Engineer

    15 hours ago

    Newark, NJ, United States Seven Seven Software Full time

    Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code. Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc) Ensure the best possible performance and quality of high scale data engineering project Participate in the architecture and system design discussions Independently...

  • AWS Data Engineer

    2 weeks ago

    Newark, NJ, United States Seven Seven Software Full time

    Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code. Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc) Ensure the best possible performance and quality of high scale data engineering project Participate in the architecture and system design discussions Independently...

  • AWS Data Engineer

    2 weeks ago

    Newark, NJ, United States Damco Solutions Full time

    Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 monthsMust have at least 12 years of experience. Job Description: Data Engineer Job Description for Data Journey USBIE Experience developing and deploying application code using SQL, Python, spark. 3-5 years' experience developing and deploying data pipeline in cloud. 3-5...

  • AWS Data Engineer

    2 hours ago

    Newark, NJ, United States Damco Solutions Full time

    Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 monthsMust have at least 12 years of experience. Job Description: Data Engineer Job Description for Data Journey USBIE Experience developing and deploying application code using SQL, Python, spark. 3-5 years' experience developing and deploying data pipeline in cloud. 3-5...

  • AWS Data Engineer

    1 day ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    1 day ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    1 day ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    1 day ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • Senior AWS Data Engineer

    3 days ago

    Newark, NJ, United States Inizio Partners Full time

    About the job Senior AWS Data Engineer Role Overview: The person will be part of the Global Technology team for a major Insurance client. He/ She will work as a Senior Cloud Engineer within the CDO EDP team and will have the opportunity to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and...

  • AWS Data Analyst

    1 week ago

    Newark, NJ, United States The Computer Merchant Full time

    JOB TITLE: AWS Data Analyst JOB LOCATION: Newark, NJ (hybrid) WAGE RANGE: 48.00-51.00 PER HOUR JOB NUMBER: SAIJP00038429 REQUIRED EXPERIENCE: 5+ years of experience in data analyst roles Proficiency in SQL, Python, or Scala for data transformation and processing. Working Knowledge of AWS services Experience with SSIS Bachelors degree in Computer Science,...