Azure Data Engineer

6 days ago


New York, New York, United States Chelsoft Solutions Co Full time
Job Description

**Job Summary**

Chelsoft Solutions Co is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and architectures on our Enterprise Data & Analytics Platform.

Key Responsibilities

  • Design and implement data pipelines using Databricks, Spark, and other Big Data technologies.
  • Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and build solutions that meet those needs.
  • Develop and maintain ETL workflows, including data transformation, validation, and loading.
  • Implement and maintain data security policies and procedures to ensure the confidentiality, integrity, and availability of data.
  • Build and maintain monitoring, alerting, and logging solutions to ensure the health and performance of data pipelines.
  • Optimize data pipelines for performance, scalability, and cost.

Requirements

  • Experience with data engineering in both cloud and on-premises environments.
  • Experience implementing solutions using Azure Data Lake, Azure Data Factory, Azure Databricks.
  • Experience creating data ingestion and data pipelines using Python/Databricks.
  • Experience with pipeline automation and orchestration.
  • Experience with Python or Spark SQL development.
  • Experience supporting big data and analytics projects and/or products.

Preferred Qualifications

  • Excellent communication skills, verbal and written.
  • Experience in facilitating meetings and working sessions.
  • Experience in Azure DevOps and working in an Agile methodology.
  • Able to lead the direction on design decisions.


  • New York, New York, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at NTT DATA. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing cloud infrastructure solutions for our clients.Key ResponsibilitiesDesign and implement cloud infrastructure solutions using Azure services such as...

  • Azure Data Engineer

    4 months ago


    New York, New York, United States Atechstar Full time

    Job descriptionAzure Data Factory Databricks ADLS Azure SQL IoT hub Stream analytics SQL NoSQL Spark Kafka Power BI Python/R Azure Synapse Power BI Should have around 5.5-8 yrs. of experience in Microsoft technologies Demonstrated experience in end-to-end deployment of MS Azure BI solution Hands on experience in developing solutions using Azure data factory...

  • azure data engineer

    5 months ago


    New York, New York, United States Atechstar Full time

    Job DescriptionRoles and ResponsibilitiesExperience in Perform Design Development & Deployment using Azure Services (Data Factory Databricks PySpark SQL) Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity. Experience in create the Technical Specification Design...

  • azure data engineer

    4 months ago


    New York, New York, United States Atechstar Full time

    Job Description Roles and ResponsibilitiesExperience in Perform Design Development & Deployment using Azure Services (Data Factory Databricks PySpark SQL) Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity. Experience in create the Technical Specification...


  • New York, New York, United States Prudential Ins Co of America Full time

    Job Classification:Technology - Engineering & CloudA GLOBAL FIRM WITH A DIVERSE & INCLUSIVE CULTUREAs the Global Asset Management business of Prudential, we're always looking for ways to improve financial services. We're passionate about making a meaningful impact - touching the lives of millions and solving financial challenges in an ever-changing world.We...

  • Data Engineer

    1 month ago


    New York, New York, United States Phaxis, LLC Full time

    Salary is 120k to 140k bonus2 days remote and 3 days onsiteWe are seeking a highly skilled Data Engineer with expertise in financial services to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, creating visually compelling reports and dashboards using Power BI, and optimizing data storage and...

  • Azure Architect

    5 months ago


    New York, New York, United States Atechstar Full time

    Job descriptionSolid experience leading data teams in developing data engineering platforms. Good working Experience of Azure Data Bricks Data Bricks Delta Lake Azure Data Factory (ADF) ADF metadata driven pipelines Azure DevOps MS SQL Server SSMS Python and PySpark Knowledge of Azure connectivity in general Azure Key Vault Azure Functions Azure integration...

  • Fabric Engineer

    5 days ago


    New York, New York, United States MDMS Recruiting LLC Full time

    Job DescriptionMicrosoft Fabric Engineer / Data EngineerWe are seeking a highly skilled Microsoft Fabric Engineer / Data Engineer to join our team at MDMS Recruiting LLC. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems using Microsoft Fabric and Azure.Key...

  • Azure DevOps Engineer

    3 months ago


    New York, New York, United States Mitchell Martin Inc Full time

    Our client, a financial services company, is seeking an Azure DevOps EngineerLocation: New York, NY / Remote Position Type: Full TimePosition Purpose: To support this growing business, we are embarking upon major tech initiatives by which we will revamp the front to back and post transaction technology landscape of our business in coming 2 years. This...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States tapwage Full time

    Impact you will makeThe ideal candidate will have a natural curiosity about solving problems – familiar with the complexity of healthcare datasets. They will be critical thinkers with advanced problem solving, data mining, and data engineering skills that enables them to answer ambiguous questions in data that help leaders make great data driven...


  • New York, New York, United States Motion Recruitment Full time

    Job Description**Company Overview**Motion Recruitment is seeking a highly skilled Senior Data Engineer to join our team. As a leading recruitment agency, we specialize in connecting top talent with innovative companies in the tech industry.**Job Summary**We are looking for a seasoned data engineer with expertise in Azure technologies to design, build, and...


  • New York, New York, United States Motion Recruitment Full time

    Location: HybridEmployment Type: Direct HireSalary Range: $150k - $165kAbout the Role:As a key player in the Financial Sector, you will take on the role of an Azure DevOps Engineer, where your expertise will be vital in constructing, deploying, and managing cloud infrastructure on Microsoft Azure.Key Responsibilities:Design and implement CI/CD pipelines...


  • New York, New York, United States Motion Recruitment Full time

    Are you ready to advance your career in the Financial Sector?As a Cloud Infrastructure Engineer, you will play a vital role in the design, deployment, and management of cloud solutions on Microsoft Azure. Collaborating closely with software development teams, you will enhance the software development lifecycle, implement industry best practices, and ensure...


  • New York, New York, United States Motion Recruitment Full time

    Location: New York, New YorkType: HybridSalary: $150k - $165kAbout the Role:In the Financial Sector, we are seeking an experienced Azure DevOps Engineer who will play a pivotal role in the development, deployment, and management of cloud infrastructure on Microsoft Azure. Your contributions will be vital in enhancing the software development lifecycle,...


  • New York, New York, United States Motion Recruitment Full time

    Are you ready to take your career to the next level in the Financial Sector?As a Cloud Infrastructure Engineer, you will play a vital role in the design, deployment, and management of cloud systems on Microsoft Azure. Collaborating closely with software development teams, you will enhance the software development lifecycle, implement industry best practices,...


  • New York, New York, United States Motion Recruitment Full time

    Location: New York, New YorkType: HybridSalary: $150k - $165kAbout the Role:As a pivotal member of our team, you will leverage your skills as an Azure DevOps Engineer to enhance our cloud infrastructure within the Financial Sector. Your role will be essential in the design, deployment, and management of cloud solutions on Microsoft Azure.Key...


  • New York, New York, United States Motion Recruitment Full time

    Location: HybridType: Direct HireSalary: $150k - $165kAre you ready to take your career to the next level with a reputable organization in the Financial Sector?As an Azure DevOps Engineer, you will play a pivotal role in the design, deployment, and management of cloud infrastructure utilizing Microsoft Azure. Your collaboration with development teams will be...

  • Data Engineer

    2 months ago


    New York, New York, United States Hunter Bond Ltd Full time

    A world-leading FinTech firm in NYC is looking for a Data Engineer to join their world-class team. Desired Experience Strong Python experienceStrong SQL experienceStrong experience in Data Warehousing, ETL, etc.Experience with Big Data Technologies (Kafka, Hadoop, Spark)Experience with Public Cloud (AWS, Azure, GCP) Benefits of working there Strong research...


  • New York, New York, United States Oakridge Staffing Full time

    About Oakridge StaffingWe are a leading staffing firm that specializes in connecting top talent with innovative companies. Our team is dedicated to providing exceptional service and support to our clients and candidates.Job SummaryWe are seeking a highly skilled Senior Data Architect/Engineer to join our client's team. As a key member of the data function,...


  • New York, New York, United States Motion Recruitment Full time

    Location: New York, New YorkType: HybridCompensation: $150k - $165kAbout the Role:As a pivotal member of our team, you will play a key role in the Financial Sector, focusing on the development, deployment, and management of cloud infrastructure utilizing Microsoft Azure. Your contributions will enhance the software development lifecycle and promote best...