Bigdata Lead

2 weeks ago

Iselin, United States Tanisha Systems, Inc. Full time
Position : Big Data Lead / Data Engineer
Location : Philadelphia, PA (Remote) EST Prefer
Duration : Contract

JOB DESCRIPTION :
Primary Skill :

1 Azure data bricks- Build Data Pipelines using ADB-Leveraging Python and Spark
Build Data Transformation in ADB
Convert Scala Pgms to Py Spark Pgms
Understand the SCALA program in Data Bricks
2 ADF
Secondary Skills
1 Azure data lake gen 2
2. Synapse analytics (dedicated SQL pool)
3. Exp in delta Lake
4. Pyspark
Nice to Have : Tidal Scheduler , Exp in Healthcare Domain Bigdata Lead