Sr. Data Architect Azure

4 weeks ago


New York, United States Diverse Lynx Full time
Title Sr. Data Architect Azure & Databricks Duration 12 Months Location New York / Weehawken, NJ (Day 1 onsite ) Mandatory Skills Databricks, Azure Datalake, PySpark, Java. No of Open Positions 1
Job Description :
Minimum 12+ years of IT experience and at least 5+ years in cloud native data engineering solution design/architecture and development.
Strong hands-on expertise in building Data engineering solutions using Apache Spark and Scala.
Deep expertise in Performance tuning and optimization of Spark/Scala programs.
bility to design and build data engineering tasks using Data bricks framework.
Hands on experience working with Azure Cloud services like Azure Data Factory, Azure Data Lake Storage, Azure Even hub, Azure SQL, Azure Analytical services, Azure Cosmos DB,
Should be able to demonstrate expertise in designing and building efficient and scalable data engineering solutions using Massively Parallel Processing (MPP) architecture.
Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules
Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL
Experience building and optimizing big data data pipelines, architectures and data sets.
Experience in writing HQL queries in Hive Data warehouse and performance tuning of HIVE scripts
Well versed with Relational and Dimensional Modeling techniques like Star, Snowflake Schema, OLTP, OLAP, Normalization, Fact and Dimensional Tables
Proficient in creating Technical Design Documents (TDD).
Familiar with DevOps principles and experience in CD/CI implementations using Azure native services.
Very good customer relationship and stakeholder management skills
Excellent communication and presentation skills.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Azure Cloud Architect

    2 months ago


    New York, New York, United States Donato technologies Full time

    Job Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications Hands-on experience with Azure Data & Analytics PaaS Services Azure Data Factory...


  • New London, United States ClifyX Full time

    Job title=Data Architect with azure Location=Connecticut 190K is also okay - CT local onsite. EAST COAST (Hybrid and next 2-3 months onsite) initial only onsite 15-18 years - will manage Cheveron account full resume should be on DATA only Hands on Data leader .. No Project Manager . Pls only look for Data Technical Program manager Azure .. Cloud...

  • Azure Cloud Architect

    2 months ago


    New York City, United States Donato technologies Full time

    Job Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications ·Hands-on experience with Azure Data & Analytics PaaS Services Azure Data...

  • Data Architect

    2 weeks ago


    New York, United States The Astor Group Full time

    Our Firm is responding to the growing demand for alternative data by modernizing their process of building data pipelines. In doing so, we are looking for a senior data architect/engineer:The Senior Azure Data Architect/Engineer s main responsibilities will be:Designing and implementing high-volume data ingestion and transformation pipelines.Experience in...

  • Azure Architect

    4 days ago


    New York, United States Collabera Full time

    Job DescriptionJob DescriptionTitle: Azure ArchitectLocation: New York, NY 10003 (Hybrid)Duration: 7 MonthsPay Range: $75/hr - $80/hrNote: Looking for someone with utility background in Energy and Gas.About The Role:Architectural Design:Design and develop high-performance, scalable, and secure cloud architectures using MS Azure. Hands on development is a...

  • Sr. Azure Engineer

    2 weeks ago


    New York, United States Creative Data Resources Full time

    Required 8+ years overall IT experience. 4+ years in a cloud engineering role using service and hosting solutions such as private/public cloud IaaS, PaaS and SaaS platforms. SME Level knowledge of: ASP.NET ,C#,XML,YAML,SQL,CSS, JavaScript Angular UI development experience Azure SQL Server Stored Procedure Development (TSQL) Azure Services Knowledge Azure...


  • New York, United States AA2IT Full time

    Azure Solutions Architect Atlanta, GA Hybrid: (On-Site 3 Days in a week) Rate : $40/hr - 45/hr  • The role and responsibility of an Azure Solutions Architect Expert typically involve designing, implementing, and maintaining complex cloud-based solutions using Microsoft Azure technologies. • Architecting and designing solutions that meet functional and...

  • Azure Architect

    2 weeks ago


    New York, United States USEReady Full time

    Job Title: Azure Architect & EngineerLocation: New York, NY 10011Duration: Direct Hire/Full Time USEReady has a great career opportunity for an Azure Architect and Engineer in New York City. This role provides a competitive salary and amazing benefits. This role will be primarily onsite with one remote day per week. Summary: The ideal candidate will...

  • Data Architect

    3 days ago


    New York, United States Coforge Full time

    We at Coforge are seeking Data Architect with mentioned skill-set and who can work onsite from Orlando, FL or Princeton, NJ or Jersey City, NJ locations.Role: Data ArchitectLocation: Orlando, FL, Princeton, NJ and Jersey City, NJExperience: 09+ yearsKey Skills: Data architecture, SQL, AWS, data modelingMode of Hire: Full TimeSkills Required :- Bachelor's...

  • Azure Architect

    2 months ago


    New York, United States Atechstar Full time

    Job descriptionSolid experience leading data teams in developing data engineering platforms. Good working Experience of Azure Data Bricks Data Bricks Delta Lake Azure Data Factory (ADF) ADF metadata driven pipelines Azure DevOps MS SQL Server SSMS Python and PySpark Knowledge of Azure connectivity in general Azure Key Vault Azure Functions Azure...

  • Azure Architect

    1 month ago


    New York, New York, United States Atechstar Full time

    Job descriptionSolid experience leading data teams in developing data engineering platforms. Good working Experience of Azure Data Bricks Data Bricks Delta Lake Azure Data Factory (ADF) ADF metadata driven pipelines Azure DevOps MS SQL Server SSMS Python and PySpark Knowledge of Azure connectivity in general Azure Key Vault Azure Functions Azure integration...


  • New York, United States Commfinity Technologies Pvt. Ltd Full time

    Job DescriptionJob DescriptionRole: Azure Architect/Microsoft Technology Stack Architect (with Utility Background must) Location: New York, NY 10003 (Hybrid) Responsibilities: Architectural Design: Design and develop high-performance, scalable, and secure cloud architectures using Microsoft Azure. Hands on development is a must, 8+ years of development...


  • New York, United States Diverse Lynx Full time

    Job Title - Sr. Azure Cloud Engineer Location: New York NY (Day one onsite/Hybrid) Position: Contract Summary: Top Qualifications: Setup for Databricks subscription, network, VNET, monitoring, logging, data factory, storage, key vault, AD integration, NSG, Firewall - using Terraform Job Summary We are seeking a highly skilled and experienced Program Manager...


  • New York, United States Pierce Technology Corp Full time

    Job DescriptionJob DescriptionSolutions/data architect who understands data, can create a data model and design a new solution for an enterprise data warehouse. Legacy system is limited in documentation, no real data model or map, and no user interface. Internal clients are looking for easier, better, and more efficient ways to access data. Looking for...


  • New York, United States Pierce Technology Corp Full time

    Job DescriptionJob DescriptionSolutions/data architect who understands data, can create a data model and design a new solution for an enterprise data warehouse. Legacy system is limited in documentation, no real data model or map, and no user interface. Internal clients are looking for easier, better, and more efficient ways to access data. Looking for...


  • New York, United States S&P Global Full time

    About the Role : Grade Level (for internal use): 11 The Team: You will be part of a world class Product Services & Engineering team architecting various solutions for business requirements within different product offerings of S&P Dow Jones, used by tens of thousands of users globally. The team is responsible for ensuring cloud solutions that...


  • New York, United States DTI (Diversified Technology Inc.) Full time

    Azure Technical Architect for a 1 year plus contract opportunity in New York NYLocation: New York NY– Hybrid 3 days a weekMust work on W2 Responsibilities: Responsible for project/work stream architectureDefines Principles and Patterns to drive the technical architectureDefines Runtime, Operations, Development capabilities required in the...


  • New York, United States DTI (Diversified Technology Inc.) Full time

    Azure Technical Architect for a 1 year plus contract opportunity in New York NYLocation: New York NY– Hybrid 3 days a weekMust work on W2 Responsibilities: Responsible for project/work stream architectureDefines Principles and Patterns to drive the technical architectureDefines Runtime, Operations, Development capabilities required in the...


  • New York, United States DTI (Diversified Technology Inc.) Full time

    Azure Technical Architect for a 1 year plus contract opportunity in New York NYLocation: New York NY– Hybrid 3 days a weekMust work on W2 Responsibilities: Responsible for project/work stream architectureDefines Principles and Patterns to drive the technical architectureDefines Runtime, Operations, Development capabilities required in the...


  • New York, United States Element6 Talent Full time

    Element6's client is looking for an Azure Cloud Architect to join their team in Brookfield, WI and provide leadership-level guidance and thought leadership through the design and implementation of a major network to cloud transformation project. You will be responsible for ensuring the high availability, performance, and security of the company's network...