AWS Data Engineer

1 day ago

Newark, NJ, United States Seven Seven Software Full time

Responsibilities:

  • Designing, building and maintaining efficient, reusable, and reliable architecture and code.
  • Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc)
  • Ensure the best possible performance and quality of high scale data engineering project
  • Participate in the architecture and system design discussions
  • Independently perform hands on development and unit testing of the applications;
  • Collaborate with the development team and build individual components into complex enterprise web systems;
  • Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle;
  • Responsible to identify and resolve any performance issues
  • Keep up to date with new technology development and implementation
  • Participate in code review to make sure standards and best practices are met.
Job Requirements

Qualifications
  • Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
  • Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
  • Programming experience with Python, Shell scripting and SQL
  • Solid experience of AWS services such as CloudFormation, S3, Athena , Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
  • Solid experience implementing solutions on AWS based data lakes.
  • Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, ElasticSearch
  • Serverless application development using AWS Lambda
  • Experience in AWS data lake/data warehouse/business analytics
  • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
  • Knowledge of ETL/ELT
  • End-to-end data solutions (ingest, storage, integration, processing, access) on AWS
  • Architect and implement CI/CD strategy for EDP
  • Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)
  • Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
  • Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift
  • Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case
  • AWS Solutions Architect or AWS Developer Certification preferred
  • Good understanding of Lakehouse/data cloud architecture

  • AWS Data Engineer

    2 weeks ago

    Newark, NJ, United States Damco Solutions Full time

    Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 monthsMust have at least 12 years of experience. Job Description: Data Engineer Job Description for Data Journey USBIE Experience developing and deploying application code using SQL, Python, spark. 3-5 years' experience developing and deploying data pipeline in cloud. 3-5...

  • AWS Data Engineer

    12 hours ago

    Newark, NJ, United States Damco Solutions Full time

    Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 monthsMust have at least 12 years of experience. Job Description: Data Engineer Job Description for Data Journey USBIE Experience developing and deploying application code using SQL, Python, spark. 3-5 years' experience developing and deploying data pipeline in cloud. 3-5...

  • AWS Data Engineer

    1 day ago

    Newark, NJ, United States CData Software Full time

    Skill: AWS Data Engineer AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. Minimum 5 years of professional experience in data integration and management. 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark. Hands on working experience in AWS GLUE ETL tool and...

  • AWS Data Engineer

    2 days ago

    Newark, NJ, United States CData Software Full time

    Skill: AWS Data Engineer AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. Minimum 5 years of professional experience in data integration and management. 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark. Hands on working experience in AWS GLUE ETL tool and...

  • AWS Data Engineer

    2 days ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    2 days ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    2 days ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • AWS Data Engineer

    2 days ago

    Newark, NJ, United States TechDigital Corporation Full time

    Job Posting Coding skill in SQL, Python and PySpark is mandatory. Unix scripting is desired. Having worked on real 2 to 3 projects as AWS data engineer and ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue and Redshift/RDS is needed. Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired. AWS So...

  • Senior AWS Data Engineer

    3 days ago

    Newark, NJ, United States Inizio Partners Full time

    About the job Senior AWS Data Engineer Role Overview: The person will be part of the Global Technology team for a major Insurance client. He/ She will work as a Senior Cloud Engineer within the CDO EDP team and will have the opportunity to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and...

  • AWS Data Analyst

    1 week ago

    Newark, NJ, United States The Computer Merchant Full time

    JOB TITLE: AWS Data Analyst JOB LOCATION: Newark, NJ (hybrid) WAGE RANGE: 48.00-51.00 PER HOUR JOB NUMBER: SAIJP00038429 REQUIRED EXPERIENCE: 5+ years of experience in data analyst roles Proficiency in SQL, Python, or Scala for data transformation and processing. Working Knowledge of AWS services Experience with SSIS Bachelors degree in Computer Science,...