Sr. Cloud Data Engineer

3 weeks ago


New York, United States EZDynamic, LLC Full time

No Visa sponsorship (Only GC holders or U.S. Citizens may apply)

- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -


Cloud Data Engineer: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.


Role & Responsibilities

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.


Skills

  • 5+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.


Education

  • Minimally a BA degree within an engineering and/or computer science discipline
  • Master’s degree strongly preferred


Job Type: Contract


  • SR DATA ENGINEER

    2 weeks ago


    New York, United States Galaxy i Technologies, Inc. Full time

    POSITION: SR. DATA ENGINEER LOCATION: NYC, NY FULLTIME||ONSITE JOB DESCRIPTION: Relevant Experience (in Yrs.) 8-10 yrs. Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySpark Experience Required Min. 5-7 years hands on experience working in data modeling Work on migrating applications from an on-premises location to the cloud...


  • New York, United States Tech Tammina LLC Full time

    Job DescriptionJob DescriptionTitle: Sr Oracle Fusion Cloud EngineersWork Location: 26th Street and Madison Ave, NY, NYDuration: 1yr renewable contracts.Start: ASAPNOTE #1: Must report to the work site for 4 month then will offer a remote option.NOTE #2: The Job is Data migration and Oracle Fusion Cloud ERP Transformation Financials.The JOB:Data Engineering...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Sr Data Engineer

    1 week ago


    New York, United States enexusglobal Full time

    Job DescriptionJob DescriptionWe are looking to hire a Sr. Data Engineer in New York City, NY Summary:We are looking to hire Sr. Data Engineer with a financial background. Who will play a crucial role in a cloud-based data warehousing platform, to manage and analyze financial data.Job ResponsibilitiesDesign and develop robust, scalable software solutions for...


  • New York, New York, United States ESTÉE LAUDER COMPANIES Full time

    About Estée Lauder CompaniesThe Estée Lauder Companies is the global leader in prestige beauty - delighting consumers with transformative products and experiences, inspiring them to express their individual beauty. We are the only company focused solely on prestige makeup, skin care, fragrance, and hair care with a diverse portfolio of 25+ brands sold in...

  • Cloud Data Engineer

    2 weeks ago


    New York, United States Synechron Full time

    Role: Cloud Data Engineer Location: NYCJob Description:This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.Major Responsibilities:Build and optimize data...

  • Cloud Data Engineer

    2 weeks ago


    New York, United States Synechron Full time

    Role: Cloud Data Engineer Location: NYCJob Description:This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.Major Responsibilities:Build and optimize data...

  • Cloud Data Engineer

    2 weeks ago


    New York, United States Synechron Full time

    Role: Cloud Data Engineer Location: NYCJob Description:This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.Major Responsibilities:Build and optimize data...

  • Sr. Data Engineer

    10 hours ago


    New York, United States Dexian Full time

    Job Summary:Dexian is seeking a Sr. Data Engineer for an opportunity with a client located in New York, NY. Responsibilities:Implement new mechanisms for modeling and predicting reader behaviorDesign and implement experiments and models to answer targeted questionsLead technical efforts to modernize and replace legacy reporting solutionsLead daily...

  • Sr. Azure Engineer

    2 weeks ago


    New York, United States Creative Data Resources Full time

    Required 8+ years overall IT experience. 4+ years in a cloud engineering role using service and hosting solutions such as private/public cloud IaaS, PaaS and SaaS platforms. SME Level knowledge of: ASP.NET ,C#,XML,YAML,SQL,CSS, JavaScript Angular UI development experience Azure SQL Server Stored Procedure Development (TSQL) Azure Services Knowledge Azure...


  • New York, United States Synechron Full time

    Position: Cloud Data Engineer Location: NYC, NYExperience: 10+ YearsType: Hybrid (2-3 days in a week)Job Description :Synechron is looking for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business...


  • New York, United States Synechron Full time

    Position: Cloud Data Engineer Location: NYC, NYExperience: 10+ YearsType: Hybrid (2-3 days in a week)Job Description :Synechron is looking for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business...


  • New York, United States Synechron Full time

    Position: Cloud Data Engineer Location: NYC, NYExperience: 10+ YearsType: Hybrid (2-3 days in a week)Job Description :Synechron is looking for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business...


  • New York, United States Synechron Full time

    Position: Cloud Data Engineer Location: NYC, NYExperience: 10+ YearsType: Hybrid (2-3 days in a week)Job Description :Synechron is looking for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business...


  • New York, New York, United States TEKsystems Full time

    Job TitleSr. Storage/Network AnalystTop Required Skills1) 7+ yrs experience in Storage Engineering in an enterprise level environment2) Experience helping to lead and drive project activities in the storage area3) Experience with NetApp and Pure Storage**Experience with storage in Azure would be a major plus**One of our principal healthcare clients is...


  • New York, United States Diverse Lynx Full time

    Job Title - Sr. Azure Cloud Engineer Location: New York NY (Day one onsite/Hybrid) Position: Contract Summary: Top Qualifications: Setup for Databricks subscription, network, VNET, monitoring, logging, data factory, storage, key vault, AD integration, NSG, Firewall - using Terraform Job Summary We are seeking a highly skilled and experienced Program Manager...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...


  • New York, United States Lumen Solutions Group Inc. Full time

    Company Description Lumen Solutions Group Inc. is a technology consulting Services Company based in Virginia. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in strategy development, portfolio management and enterprise architecture. Role: Sr. Azure Cloud...

  • Data Engineer

    2 weeks ago


    New York, United States Ztek Consulting Full time

    Job Title Sr Data EngineerRole:- New York- onsiteRelevant Experience (in Yrs) 8-10 yrs Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySparkExperience Required Min. 5-7 years hands on experience working in data modelingRoles & Responsibilities• Work on migrating applications from an on-premises location to the cloud service...