Lead Azure Data Engineer

3 weeks ago

Dallas, United States InfoVision Inc. Full time

Qualifications:

  • 15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data Warehousing
  • Should have excellent leadership, communication & client-facing skills
  • Should have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure Synapse, Azure SQL, SQL Server and good working knowledge on Tableau.
  • Should have executed at least 2 Azure Cloud Data Warehousing projects
  • Should have worked on Batch, API, Event & Streaming data processing,
  • Should have working experience in building CI\CD pipelines using tools like Azure DevOps, GitHub, Jenkins, etc
  • Should have working knowledge on handling various file formats like JSON, XML, CSV, Parquet, Delta, etc.
  • Should have good knowledge of Agile methodology and able to work in a Scrum Master capacity.
  • Should have worked in creating repeatable modules to support automation to drive dynamic data ingestion, processing, quality checks & error handling.
  • Should have working knowledge on creating complex Databricks notebooks and integrate with Azure Ecosystem.
  • Should have working knowledge of creating SQL queries to analyze and extract semi-structured data
  • Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping
  • Should have cross global location experience and led a team of at least 10+ members in a global delivery model
  • Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions


Responsibilities:

  • Work with business and technology stakeholders to gather, understand their business requirements and manage their expectations
  • Design, build and deploy data pipelines using state-of-the-art techniques.
  • Design, build and deploy repeatable modules using state-of-the-art techniques.
  • Technical owner/lead and the scrum master for the entire workstream.
  • Provide technical leadership to a team of data engineers, guiding them in implementing the best practices and innovation.
  • Collaborate with cross-functional teams including data scientists, business analysts, solution architects, and DevOps engineers, to deliver end-to-end data solutions that meet business requirements.
  • Integrate data from various sources, including on-prem systems, Cloud-based applications, APIs, to provide a unified view of data for analytics, and reporting purpose.
  • Analyze the different source systems, profile data, understand, document & fix Data Quality issues
  • Create design documents and review Source to Target Mapping documents and any supporting documents needed for deployment/migration
  • Implement CI\CD pipelines for automating the deployment
  • Review Test cases, Test plans and Test results
  • Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
  • Document best practices, code base, and share knowledge
  • Maintain and improve already existing processes
  • Ensure that the data pipelines are stable, secure, maintainable and highly available

  • Azure Data Engineer, Tech Lead

    1 month ago

    Dallas, United States tlnt Full time

    Job DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 10+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...

  • Lead Data Engineer

    14 hours ago

    Dallas, United States Amtex Systems Inc Full time

    Job DescriptionJob Description Lead Data Engineer - Azure Data Platform (Las Colinas, TX) About the RoleWe are searching for a talented and experienced Lead Data Engineer to join our growing team in Las Colinas, TX! As a Lead Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure built on Azure Data...

  • Azure Data Engineer

    2 weeks ago

    Dallas, United States Anblicks Full time

    Position: Senior Azure Data EngineerLocation: Dallas, TXFulltimeSkills:• 8+ years of overall experience developing data solutions leveraging Microsoft technologies (SSIS, SSAS, SQL Server, Azure) • 2+ years of experience building data pipelines on cloud leveraging Azure Data Factory and Azure Synapse• Exposure to Azure Data Factory and Azure Synapse...

  • Azure Data Engineer

    2 weeks ago

    Dallas, United States Anblicks Full time

    Position: Senior Azure Data EngineerLocation: Dallas, TXFulltimeSkills:• 8+ years of overall experience developing data solutions leveraging Microsoft technologies (SSIS, SSAS, SQL Server, Azure) • 2+ years of experience building data pipelines on cloud leveraging Azure Data Factory and Azure Synapse• Exposure to Azure Data Factory and Azure Synapse...

  • Azure Data Engineer

    3 weeks ago

    Dallas, United States Anblicks Full time

    Position: Senior Azure Data EngineerLocation: Dallas, TXFulltimeSkills:• 8+ years of overall experience developing data solutions leveraging Microsoft technologies (SSIS, SSAS, SQL Server, Azure) • 2+ years of experience building data pipelines on cloud leveraging Azure Data Factory and Azure Synapse• Exposure to Azure Data Factory and Azure Synapse...

  • Azure Sr. Data Engineer

    4 days ago

    Dallas, United States Cyclotron, Inc. Full time

    Job DescriptionJob DescriptionSr. Data EngineerLevel: SeniorDepartment: AzureLocation: Anywhere in US (fully remote)Type: FTE  GENERAL DESCRIPTION & RESPONSIBILITIES The Sr. Azure Data Engineer will lead the creation of high-value data driven solutions leveraging Cyclotron’s proven implementation methodology and solutions for enterprise projects, as...

  • Azure Principal Data Engineer.

    2 weeks ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you. Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a remote opportunity. The Azure Principal Data Engineer will be responsible...

  • Azure Principal Data Engineer.

    2 weeks ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a remote opportunity.The Azure Principal Data Engineer will be responsible for...

  • Azure Principal Data Engineer.

    1 week ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you. Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a remote opportunity. Have you got what it takes to succeed The following...

  • Azure Principal Data Engineer.

    2 weeks ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a remote opportunity.The Azure Principal Data Engineer will be responsible for...

  • Azure Principal Data Engineer.

    2 days ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a Hybrid opportunity.The Azure Principal Data Engineer will be responsible for...

  • Azure Principal Data Engineer.

    2 weeks ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a remote opportunity.The Azure Principal Data Engineer will be responsible for...

  • Azure Principal Data Engineer.

    3 days ago

    Dallas, United States Tiger Analytics Full time

    If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.Now hiring for multiple opportunities in Data Engineering (Azure) for an immediate full-time role. This is a Hybrid opportunity.The Azure Principal Data Engineer will be responsible for...

  • Azure Databricks

    1 week ago

    Dallas, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Azure Databricks

    1 week ago

    Dallas, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Azure Databricks

    6 days ago

    Dallas, United States Tredence Full time

    About Tredence: Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale empowering end users to improve decision making....

  • Sr. Azure Data Engineer

    6 days ago

    Dallas, United States ShiftCode Analytics Full time

    -Client Location - Dallas (will go in 2 days a month now but likely to start 1 time a week soon or more depending on project needs)-Visa - USC,GC,GC-EAD,H4, L2-Duration - 6+ months (need 6 months conversion waiver)-Interview Process - 2 video interview Must Have - Requirements:Must have:3+ years for Engineer and 5 years for Sr. of professional experience in...

  • Senior Data Technical Lead

    4 days ago

    Dallas, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Technical Lead (Life/Annuity exp, Databricks Expertise) to join our team in Dallas, Texas (US-TX),...

  • Senior Data Technical Lead

    4 days ago

    Dallas, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Technical Lead (Life/Annuity exp, Databricks Expertise) to join our team in Dallas, Texas (US-TX),...

  • Azure Devops Lead

    2 weeks ago

    Dallas, United States Diverse Lynx Full time

    Job Title : Azure Devops Lead Job Title : Dallas , TX Contract Job Description: Objectives of this role Deliver Consultancy and implementation strategies around Azure infrastructure (IaaS | PaaS | SaaS). Understanding the needs of stakeholders and conveying them to required teams. Working on ways to automate and improve development and release processes....