Bigdata Developer
6 days ago
Costa Mesa, United States
SysMind Tech
Full time
Role : Spark, Scala, Big data developerLocation : Costa Mesa, CA
Job Description :
Technical/Functional Skills
Experienced engineer with hands on and strong coding skills, preferably with Java, Scala, Python.
AWS Cloud experience - S3, EFS, ECS, EMR, etc.
Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
Great attention to details with analytical/curious mind.
Organizational and communication skills
Experience Required
8 - 10 years
Roles & Responsibilities
• Perform large-scale data processing using Python and Apache Spark.
• Utilize AWS services like S3, EMR, EC2 for data storage and processing.
• Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
• Ensure the data quality, observability, and integrity across all our data infrastructure.
