Lead Data Engineer
4 weeks ago
Title: Lead ETL Support Engineer(ADF, SSIS, PowerBI)
Need Local in Dallas, TX
Qualifications:
12+ years of experience in ETL & Data Warehousing
Should have excellent leadership & communication skills
Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI
Should have worked on data sources such as SAP and Salesforce
Should have very good knowledge of SSIS (ETL Tool), StreamSets (ETL Tool), Azure Cloud, ADF, Azure Synapse Analytics & Azure Hub Events
Should have executed at least 2 Azure Cloud Data Warehousing projects
Should have worked at least 4 projects using Agile/SAFe methodology
Should have demonstrated working knowledge on ITIL V4 concepts such as Incident Management, Problem Management, Change Management & Knowledge Management
Should have working experience on any DevOps tools like GitHub, Jenkins, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction
Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping
Should have cross global location experience and led a team of at least 15+ members in a global delivery model
Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions
Responsibilities:
Senior candidate to do production support of existing EDW, design, build & deploy enhancements and bug fixes to existing EDW
Support the existing EDW system built using Azure SQL, Microsoft SSIS, StreamSets & Power BI
Be on call to support job incidents on rotational basis
Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations
Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge
Analyze the different source systems, profile data, understand, document & fix Data Quality issues
Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users
Write complex SQLs to extract & format source data for ETL/data pipeline
Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration
Design, Develop and Test ETL/Data pipelines
Write Unit Test cases, execute Unit Testing and document Unit Test results
Deploy ETL/Data pipelines
Use DevOps tools to version, push/pull code and deploy across environments
Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
Maintain and improve already existing processes
Ensure that the data pipelines are stable, secure, maintainable and highly available
Lokesh Kumar
Lokesh.Kumar@infovision.com
by Jobble
-
Lead Data Engineer
4 days ago
Dallas, United States Employer Direct Healthcare Full timeAbout Employer Direct HealthcareEmployer Direct healthcare (EDH) is on a mission to transform access to excellent care for the moments that matter most. As the leading provider of surgical benefits for self-insured employers, we bring guided access to high-quality, affordable care for employers, their employees and the family members. We understand and have...
-
Lead Data Engineer
4 days ago
Dallas, United States Employer Direct Healthcare Full timeAbout Employer Direct HealthcareEmployer Direct healthcare (EDH) is on a mission to transform access to excellent care for the moments that matter most. As the leading provider of surgical benefits for self-insured employers, we bring guided access to high-quality, affordable care for employers, their employees and the family members. We understand and have...
-
Azure Data Engineer, Tech Lead
4 weeks ago
Dallas, United States tlnt Full timeJob DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 10+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...
-
Azure Databricks
10 hours ago
Dallas, United States Tredence Inc. Full timeAbout Tredence:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....
-
Databricks - Data Technical Lead
3 days ago
Dallas, United States ARK Infotech Spectrum Full timeRole: Data Technical LeadLocation: Dallas, TXDuration: 12 months with possible extension(s) Requirements:Technical Lead with 12+ yrs of experience as well as expertise in data engineering and analytics in In-depth knowledge of Apache Spark, Pyspark and Databricks architecture. Strong programming skills in languages such as Python or Scala. Experience with...
-
Data Engineer
7 days ago
Dallas, United States Addison Group Full timeOn-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...
-
Data Engineer
6 days ago
Dallas, United States Addison Group Full timeOn-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...
-
Data Engineer
6 days ago
Dallas, United States Addison Group Full timeOn-site, Monday-Friday, in Dallas, TX, 75229. Remote days can and will be earned. The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibility for business intelligence, data warehouse needs and data analytics...
-
Snowflake Data Lead
3 days ago
Dallas, United States Triunity Software Full timeMust Haves:10+ years of experience within data engineeringPython experienceSnowflake experience (developing ETL pipelines)IDMC (intelligent data management cloud) experienceKnowledge of AWSFluent in English (written and verbal)Job Description:This role will be part of a team focused on cloud transformation, modernizing analytics platforms and improving...
-
Principal Data Engineer
4 weeks ago
Dallas, Texas, United States TXU Energy Full timeJob SummaryWe are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. You will provide technical leadership, drive innovation, and...
-
Senior Data Engineer
2 weeks ago
Dallas, United States Mitchell Martin Inc. Full timeSenior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...
-
Senior Data Engineer
2 weeks ago
Dallas, United States Mitchell Martin Inc. Full timeSenior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...
-
Principal Data Engineer
1 month ago
Dallas, United States TXU Energy Full timeJob Summary We are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. You will provide technical leadership, drive innovation,...
-
Data Engineer Tech Lead
6 days ago
Dallas, United States InfoVision Inc. Full timeQualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...
-
Data Engineer Tech Lead
2 weeks ago
Dallas, United States InfoVision Inc. Full timeQualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...
-
Data Engineer Tech Lead
2 weeks ago
Dallas, United States InfoVision Inc. Full timeQualifications:15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data WarehousingShould have excellent leadership, communication & client-facing skillsShould have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure...
-
Senior Data Engineer
4 weeks ago
Dallas, United States tlnt Full timeJob DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 5+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...
-
Lead Software Engineer
23 hours ago
Dallas, United States JPMorgan Chase Full timeJob Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking - Corporate Data Services team, you are an integral part of an agile team that works to enhance, build, and deliver trusted...
-
Director, Data Engineering
2 days ago
Dallas, United States NationsBenefits, LLC Full timeNationsBenefits is recognized as one of the fastest-growing companies in America and a Healthcare Fintech provider of supplemental benefits, flex cards, and member engagement solutions. We partner with managed care organizations to provide innovative healthcare solutions that drive growth, improve outcomes, reduce costs, and bring value to their members....
-
Data Engineer
4 weeks ago
Dallas, United States IT Vision Group Full timeJob DescriptionJob DescriptionTitle : Data EngineerLocation: RemoteDuration: 12 Months+ We are looking for an onshore Data engineer with the following requirement to start ASAP:Must have: SQL, data profiling, data cleansing, and data modeling experience; comfortable working with raw data and converting them into insightful outcomes; comfortable...