Engineer, Data Engineering
3 days ago
United States
Omni Inclusive
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Job Title Coding skill in SQL, Python, and PySpark is mandatory. Unix scripting is desired.
Having worked on real 2 to 3 projects as an AWS data engineer and the ability to work on "Data pipeline, ingest, transform, and deliver" using S3, Glue, and Redshift/RDS is needed.
Knowledge of streaming ingestion using KAFKA/Kinesis or Spark Streaming is desired.
AWS Solution Architect associate or Developer Associate is needed but AWS Data Analytics Certification is desired.
Skill/Competency
- Rating
- Years of Experience
- Comments on primary skills
- Skill/Competency AWS Certifications AWS Solution Architect associate or Developer Associate (desired) AWS Data Analytics Certification (nice to have) Data pipeline, ingest, transform, and deliver using S3, Glue, RDS, Redshift, Athena, Lambda (Real 2-3 projects as AWS data engineer) SQL, Python, Spark (mandatory) Complex SQL scripting & Performance Tuning (mandatory) Lake formation, Cloud Formation templates, CI/CD, Jenkins, Cloud watch (mandatory) Streaming ingestion using "KAFKA/kinesis" or spark stream (desired) Unix Shell Scripting (desired) Step Functions/Autosys Knowledge Implementing ETL/ELT for data solutions
- CDC, Data Modeling, Data Governance Ingest, Storage, Integration, Processing, Access Code Versioning Jira and Confluence QA/Testing Security (IAM, security cred,..) Omni Inclusive
- Rating
- Years of Experience
- Comments on primary skills
- Skill/Competency AWS Certifications AWS Solution Architect associate or Developer Associate (desired) AWS Data Analytics Certification (nice to have) Data pipeline, ingest, transform, and deliver using S3, Glue, RDS, Redshift, Athena, Lambda (Real 2-3 projects as AWS data engineer) SQL, Python, Spark (mandatory) Complex SQL scripting & Performance Tuning (mandatory) Lake formation, Cloud Formation templates, CI/CD, Jenkins, Cloud watch (mandatory) Streaming ingestion using "KAFKA/kinesis" or spark stream (desired) Unix Shell Scripting (desired) Step Functions/Autosys Knowledge Implementing ETL/ELT for data solutions
- CDC, Data Modeling, Data Governance Ingest, Storage, Integration, Processing, Access Code Versioning Jira and Confluence QA/Testing Security (IAM, security cred,..) Omni Inclusive