Lead Data Engineer

4 weeks ago


Dallas, United States Infovision Full time

Title: Lead ETL Support Engineer(ADF, SSIS, PowerBI)

Need Local in Dallas, TX

Qualifications:

12+ years of experience in ETL & Data Warehousing

Should have excellent leadership & communication skills

Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI

Should have worked on data sources such as SAP and Salesforce

Should have very good knowledge of SSIS (ETL Tool), StreamSets (ETL Tool), Azure Cloud, ADF, Azure Synapse Analytics & Azure Hub Events

Should have executed at least 2 Azure Cloud Data Warehousing projects

Should have worked at least 4 projects using Agile/SAFe methodology

Should have demonstrated working knowledge on ITIL V4 concepts such as Incident Management, Problem Management, Change Management & Knowledge Management

Should have working experience on any DevOps tools like GitHub, Jenkins, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction

Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping

Should have cross global location experience and led a team of at least 15+ members in a global delivery model

Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions

Responsibilities:

Senior candidate to do production support of existing EDW, design, build & deploy enhancements and bug fixes to existing EDW

Support the existing EDW system built using Azure SQL, Microsoft SSIS, StreamSets & Power BI

Be on call to support job incidents on rotational basis

Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations

Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge

Analyze the different source systems, profile data, understand, document & fix Data Quality issues

Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users

Write complex SQLs to extract & format source data for ETL/data pipeline

Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration

Design, Develop and Test ETL/Data pipelines

Write Unit Test cases, execute Unit Testing and document Unit Test results

Deploy ETL/Data pipelines

Use DevOps tools to version, push/pull code and deploy across environments

Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests

Maintain and improve already existing processes

Ensure that the data pipelines are stable, secure, maintainable and highly available

Lokesh Kumar

Lokesh.Kumar@infovision.com

by Jobble


  • Lead Data Engineer

    4 days ago


    Dallas, United States Employer Direct Healthcare Full time

    About Employer Direct HealthcareEmployer Direct healthcare (EDH) is on a mission to transform access to excellent care for the moments that matter most. As the leading provider of surgical benefits for self-insured employers, we bring guided access to high-quality, affordable care for employers, their employees and the family members. We understand and have...

  • Lead Data Engineer

    4 days ago


    Dallas, United States Employer Direct Healthcare Full time

    About Employer Direct HealthcareEmployer Direct healthcare (EDH) is on a mission to transform access to excellent care for the moments that matter most. As the leading provider of surgical benefits for self-insured employers, we bring guided access to high-quality, affordable care for employers, their employees and the family members. We understand and have...


  • Dallas, United States tlnt Full time

    Job DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 10+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...

  • Azure Databricks

    10 hours ago


    Dallas, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....


  • Dallas, United States ARK Infotech Spectrum Full time

    Role: Data Technical LeadLocation: Dallas, TXDuration: 12 months with possible extension(s) Requirements:Technical Lead with 12+ yrs of experience as well as expertise in data engineering and analytics in In-depth knowledge of Apache Spark, Pyspark and Databricks architecture. Strong programming skills in languages such as Python or Scala. Experience with...

  • Data Engineer

    7 days ago


    Dallas, United States Addison Group Full time

    On-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...

  • Data Engineer

    6 days ago


    Dallas, United States Addison Group Full time

    On-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...

  • Data Engineer

    6 days ago


    Dallas, United States Addison Group Full time

    On-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...

  • Snowflake Data Lead

    3 days ago


    Dallas, United States Triunity Software Full time

    Must Haves:10+ years of experience within data engineeringPython experienceSnowflake experience (developing ETL pipelines)IDMC (intelligent data management cloud) experienceKnowledge of AWSFluent in English (written and verbal)Job Description:This role will be part of a team focused on cloud transformation, modernizing analytics platforms and improving...


  • Dallas, Texas, United States TXU Energy Full time

    Job SummaryWe are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. You will provide technical leadership, drive innovation, and...

  • Senior Data Engineer

    2 weeks ago


    Dallas, United States Mitchell Martin Inc. Full time

    Senior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...

  • Senior Data Engineer

    2 weeks ago


    Dallas, United States Mitchell Martin Inc. Full time

    Senior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...


  • Dallas, United States TXU Energy Full time

    Job Summary We are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. You will provide technical leadership, drive innovation,...


  • Dallas, United States InfoVision Inc. Full time

    Qualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...


  • Dallas, United States InfoVision Inc. Full time

    Qualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...


  • Dallas, United States InfoVision Inc. Full time

    Qualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...

  • Senior Data Engineer

    4 weeks ago


    Dallas, United States tlnt Full time

    Job DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 5+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...

  • Lead Software Engineer

    23 hours ago


    Dallas, United States JPMorgan Chase Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking - Corporate Data Services team, you are an integral part of an agile team that works to enhance, build, and deliver trusted...


  • Dallas, United States NationsBenefits, LLC Full time

    NationsBenefits is recognized as one of the fastest-growing companies in America and a Healthcare Fintech provider of supplemental benefits, flex cards, and member engagement solutions. We partner with managed care organizations to provide innovative healthcare solutions that drive growth, improve outcomes, reduce costs, and bring value to their members....

  • Data Engineer

    4 weeks ago


    Dallas, United States IT Vision Group Full time

    Job DescriptionJob DescriptionTitle : Data EngineerLocation: RemoteDuration: 12 Months+    We are looking for an onshore Data engineer with the following requirement to start ASAP:Must have: SQL,  data profiling, data cleansing, and data modeling experience; comfortable working with raw data and converting them into insightful outcomes; comfortable...