Azure Data Engineer

3 weeks ago


Bellevue, United States Tata Consultancy Services Full time

Experience Required

5

Roles & Responsibilities

Data Engineering

Data pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE

Data automation / processing using lens

Data pipeline automation using ADF

Data Engineering support

Data Preparation, Exploration and Sustenance

1. Investigate and understand business questions

2. Explore data, identify the right sources; performing data extraction and

transformation

3. Perform data validation

Experimentation: Control Tower and Scorecards:

Knowledge of how Control Tower works

How to update metrics

Update scorecard layouts

Run Scorecard Validation

Run exploratory analysis

Skills needed for this:

Python (only for investigations)

XML

Git

PySpark (only for investigations)

4. Implement and provide support for data pipelines and reports

5. Implement monitoring on all critical data pipelines

6. Support migration to Azure Lens Orchestrator from Xflow

Self Service/Datawarehouse

Support ADF /lens pipelines to ingress into Synapse on a regularly basis (performance,

reprocessing and monitoring)

2. Support visualization/reporting on top of data via Cube, PowerBI premium (based

on cost/size needs), excel or Spark

Rhythm of Business

1. Maintenance and Sustenance of existing Data Pipelines

2. Workflow Monitoring and Fixes

3. Maintained and monitored existing data



  • Bellevue, United States Diverse Lynx Full time

    Technical/Functional Skills Data; Digital : Microsoft Power BI; SQL Server 2012 Development; SQL Server Analysis Services 2008 (SSAS); Cosmos; scope; azure data factory; Digital : Microsoft Azure; Azure Synapse; Data Automation; Jason; Azure File system; Data Engineering; Azure Data Engineering Experience Required 5 Roles & Responsibilities Data Engineering...

  • Azure Data Engineer

    1 month ago


    Bellevue, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionJob Description:Position: Azure Data Engineer Location: Bellevue, WA Duration: Full Time Experience in data visualization, data cleaning, data manipulation (extract, transform, load), and tool usage of Talend, SSIS, DataStage, Oracle Data Integrator Advanced working SQL knowledge and experience working with relational databases,...

  • AZURE VMware Engineer

    1 month ago


    Bellevue, United States Anicca Data Science Solutions Full time

    Benefits: 401(k) matching Competitive salary Dental insurance Health insurance Paid time off Vision insurance Qualifications 8+ years of IT experience and minimum 3 years of experience on Azure VMware Solution and 5+ years of experience on VMware vSphere, Azure cloud services deployments, and cloud migrations. Relevant experience in architecting and...

  • AZURE VMware Engineer

    3 weeks ago


    Bellevue, United States Anicca Data Science Solutions Full time

    Benefits: 401(k) matching Competitive salary Dental insurance Health insurance Paid time off Vision insurance Qualifications 8+ years of IT experience and minimum 3 years of experience on Azure VMware Solution and 5+ years of experience on VMware vSphere, Azure cloud services deployments, and cloud migrations. Relevant experience in architecting and...

  • Data Engineer

    3 weeks ago


    Bellevue, United States Larsen & Toubro Infotech Ltd Full time

    Data Engineer Job Req Id: 1293687 Job Description:Experience in SQL Programming language.Knowledge of end-to-end process on creation maintenance of Data pipelines. Working experience on Azure DevOps is a must.Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage. Proficiency in Azure synapse. Implement end end data pipelines...

  • Data Engineer

    5 days ago


    Bellevue, Washington, United States Larsen & Toubro Infotech Ltd Full time

    Data Engineer Job Req Id: Job Description:Experience in SQL Programming language.Knowledge of end-to-end process on creation maintenance of Data pipelines. Working experience on Azure DevOps is a must.Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage. Proficiency in Azure synapse. Implement end end data pipelines using...

  • Azure Data Engineer

    1 week ago


    Bellevue, United States Tata Consultancy Services Full time

    Experience Required5Roles & ResponsibilitiesData EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE Data automation / processing using lensData pipeline automation using ADF Data Engineering supportData Preparation, Exploration and Sustenance1. Investigate and understand business questions2. Explore data,...

  • Azure Data Engineer

    3 weeks ago


    Bellevue, United States Tata Consultancy Services Full time

    Roles & Responsibilities :Data EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE Data automation / processing using lensData pipeline automation using ADF Data Engineering supportData Preparation, Exploration and Sustenance1. Investigate and understand business questions2. Explore data, identify the right...

  • Azure Data Engineer

    3 weeks ago


    Bellevue, United States Tata Consultancy Services Full time

    Experience Required5Roles & ResponsibilitiesData EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE Data automation / processing using lensData pipeline automation using ADF Data Engineering supportData Preparation, Exploration and Sustenance1. Investigate and understand business questions2. Explore data,...

  • Azure Data Engineer

    1 month ago


    Bellevue, United States Tata Consultancy Services Full time

    Roles & Responsibilities :Data EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE Data automation / processing using lensData pipeline automation using ADF Data Engineering supportData Preparation, Exploration and Sustenance1. Investigate and understand business questions2. Explore data, identify the right...

  • Azure Data Engineer

    1 month ago


    Bellevue, United States Tata Consultancy Services Full time

    Experience Required5Roles & ResponsibilitiesData EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE Data automation / processing using lensData pipeline automation using ADF Data Engineering supportData Preparation, Exploration and Sustenance1. Investigate and understand business questions2. Explore data,...

  • Azure Cloud Engineer

    4 weeks ago


    Bellevue, United States Tata Consultancy Services Full time

    Technical/Functional Skills Microsoft Entra; RHEL; Azure; Virtualization; OneIdentity;Storage Technologies; JITBIT; Kusto Experience Required 7 Roles & Responsibilities •Prior Microsoft workingExperience in Microsoft Entra product. •Experience in managing Red HatRHEL Operating Systems •7-8 years experience as AzureBuild Engineer to deploy, configure,...

  • Azure Cloud Engineer

    3 weeks ago


    Bellevue, United States Tata Consultancy Services Full time

    Technical/Functional Skills Microsoft Entra; RHEL; Azure; Virtualization; OneIdentity;Storage Technologies; JITBIT; Kusto Experience Required 7 Roles & Responsibilities •Prior Microsoft workingExperience in Microsoft Entra product. •Experience in managing Red HatRHEL Operating Systems •7-8 years experience as AzureBuild Engineer to deploy, configure,...


  • Bellevue, United States Diverse Lynx Full time

    1.Proficient in Python and PySpark. 2. Strong knowledge of SQL. 3.Experience in building and optimizing complex data pipelines in Azure. 4.Hand on experience on Azure Databricks. 5.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log...


  • Bellevue, United States Diverse Lynx Full time

    1.Proficient in Python and PySpark. 2. Strong knowledge of SQL. 3.Experience in building and optimizing complex data pipelines in Azure. 4.Hand on experience on Azure Databricks. 5.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log...


  • Bellevue, United States Diverse Lynx Full time

    1.Proficient in Python and PySpark. 2. Strong knowledge of SQL. 3.Experience in building and optimizing complex data pipelines in Azure. 4.Hand on experience on Azure Databricks. 5.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log...


  • Bellevue, Washington, United States Diverse Lynx Full time

    Proficient in Python and PySpark. 2. Strong knowledge of SQL. 3.Experience in building and optimizing complex data pipelines in Azure. 4.Hand on experience on Azure Databricks. 5.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log...

  • Data Engineer

    2 months ago


    Bellevue, United States The Dignify Solutions LLC Full time

    Data Engineering experience primarily on Spark. Someone who has worked on Azure cloud with knowledge on Azure DEVOPS (CI/CD & Infrastructure as a code), ADF, ADW & Power BI. Apache Nifi will be good to have.Power BI: Understand business requirements to set functional specifications for reporting applications Build automated reports and dashboards with the...

  • Data Engineer

    2 weeks ago


    Bellevue, United States The Dignify Solutions LLC Full time

    Data Engineering experience primarily on Spark. Someone who has worked on Azure cloud with knowledge on Azure DEVOPS (CI/CD & Infrastructure as a code), ADF, ADW & Power BI. Apache Nifi will be good to have.Power BI: Understand business requirements to set functional specifications for reporting applications Build automated reports and dashboards with the...

  • Data Engineer

    4 weeks ago


    Bellevue, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...