Big Data Developer

2 weeks ago

Philadelphia, PA, United States ClifyX Full-time

Big Data DeveloperPhiladelphia5+ year of experience workingDemonstrable experience with big data tools: Hadoop, Apache Spark, KafkaDemonstrable experience with data pipeline and workflow management tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc.
Exp with relational SQL, Snowflake and NoSQL databases, including Postgres and CassandraExp with Amazon Web Services (AWS) (VPC, EC2, EMR, RDS, DynamoDB, Route 53, ELB, VPN, Direct Connect, CloudTrail, CloudWatch, S3, IAM, WAF, Lambda scripting with Python/Node.
JS, Messaging, Kinesis, Glue, Redshift, etc.)Experience with network monitoring and packet analysis toolsExperience working with Unix/Linux systems from kernel to shell and beyond, with experience working with system libraries, file systems, and client-server protocols.
Experience with network protocols e.g. TCP/IP, UDP, ICMP, etc., MAC addresses, IP packets, DNS, OSI layers, and load balancing.
Work in an agile environment, ability to write epics and stories and familiar with tools such as Confluence and Jira