Cloud Data Engineer
6 days ago
Location - NYC, NY or Iselin, NJ
12+ months - hybrid 3 days in office / 2 days remote
W2 Rate - $120-122/hr
Key Requirements
- Must have pipeline development, platform setup and configuration experience
- Strong SQL and PySpark skills (must be able to answer SQL merge statements and SCD-related questions)
- MUST HAVE Hands-on experience with Databricks, ADF, and Snowflake platform setup and configuration
- Solid understanding of Azure cloud environment and DevOps/IaC concepts
- Experience with pipeline development and platform configuration of Databricks, ADF and Snowflake
- Ability to explain how and why solutions were implemented - not just tasks completed
- Strong problem-solving, communication, and independent working skills
Databricks -must be able to
- Configure and manage clusters (auto-scaling, runtime versions, troubleshooting)
- Build ETL pipelines with PySpark and Databricks notebooks
- Set up and manage Unity Catalog for data governance
- Optimize performance (Delta Lake tuning, caching, partitioning)
- Build and manage end-to-end data pipelines
- Connect to multiple data sources (SQL, REST APIs, Blob storage, Snowflake)
- Implement triggers, parameters, variables, and monitoring
- Design and maintain data warehouses and ETL/ELT pipelines
- Apply SQL and Data Warehousing concepts (SCD Type 1/2, star schema, partitioning)
- Configure virtual warehouses, access control, and performance tuning
- Integrate with Databricks, ADF, and BI tools
-
Cloud Data engineer
2 weeks ago
New York, NY, United States Damco Solutions Full timeRole: Cloud Data engineer Location: NYC NY (Onsite)(Hybrid) Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities:...
-
Cloud Data Platform Engineer
6 days ago
New York, NY, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
Cloud Data Platform Engineer
2 days ago
New York, NY, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
Sr. Azure Data Engineer
1 week ago
New York, NY, United States Hudson Data Full timeJob Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...
-
Data Engineer BI Developer Cloud Data Platform
2 weeks ago
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Data Engineer BI Developer Cloud Data Platform
24 minutes ago
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Senior Cloud Data Platform Engineer
2 days ago
New York, NY, United States Global Channel Management Full timeAbout the job Senior Cloud Data Platform Engineer Senior Cloud Data Platform Engineer needs 5+ years of implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. Senior Cloud Data Platform Engineer requires: Locations: Charlotte, NC; Iselin, NJ; NY, NY Hybrid role must be in office 2 days a wee Ability to type...