Data Quality Engineer

1 week ago

Dallas, United States GBIT (Global Bridge InfoTech Inc) Full time

PURPOSE

The Senior Data Quality Engineer will help develop and implement an automated testing framework and test process that can be used for testing our Next Generation WWEX Group Data Platform. This Data Platform testing framework will be used in agile scrum Development efforts, regression and continuous testing efforts. In addition, this position will utilize appropriate test tools, process and practices as defined by the QA Leaders for functional, systems-integration, ETL migration testing, as well as building in quality standards throughout the SDLC to avoid defects and minimize rework and waste.


ESSENTIAL DUTIES, RESPONSIBILITIES & OUTCOMES

  • Support design, build and implement automated test framework and tools to automate the Data platform services and applications.
  • Develop and implement testing practices and tools as part of the framework which ensure releases are defect-free and perform at or better than expected levels
  • Learn the Worldwide Express business and ensure the Quality Assurance team understands business requirements at a detailed level
  • Provide technical directions, mentor quality assurance team as well as the scrum teams on effective testing practices, including test driven development
  • Use SQL queries and analyze log files to test various ETL and data pipelines
  • Develop data quality testing plans and scripts. Perform data validity, accuracy and integrity test across different components of the Data platform.
  • Automate the regression testing and ensure quality practices are built into the SDLC and DevOps practices
  • Ensure that business requirements are fully met before each release; certify releases for quality and completeness of functionality
  • Closely collaborate with other technology and business users to ensure business and technical requirements are understood and met


Minimum Qualifications:


  • Bachelor’s Degree, Computer Science, Engineering or related is requirement
  • 5+ years of work experience in QA, preferably in data science or relevant space
  • 5+ yrs applied experience writing complex SQL / Spark SQL on large data sets to transform data, facilitate accurate and reliable data analytics across various functions.
  • Strong coding abilities in Python, PySpark, Pandas or other similar tools for large scale data processing, data quality checks, validations and analysis.
  • Advanced proficiency in SQL and familiarity with other relational data via Oracle, Postgres, and/or SQL Server
  • Proficiency with industry recognized ETL/ELT testing methodologies, techniques, processes and standards
  • Hands-on experience with Databricks in AWS environment
  • Experience in automation of data pipelines, data services, cloud data warehouses, business intelligence, and machine learning platforms
  • Experience in developing Databricks notebook to test data quality and business requirements
  • Passionate and highly skilled in utilizing programming languages and analytics tools/technologies to validate products, machine learning models, data pipelines, and data deliverables


KNOWLEDGE OF

  • Understanding of the industry, specific WWEX business model, and unique characteristics of the Company.
  • Detailed understanding of Quality Assurance tools, practices and success measures. Known to others for knowledge and leadership in this area.
  • Agile development methodologies.
  • Common business practices and software product design and development.
  • Building collaborative relationships.


SKILLS AND ABILITIES IN

  • Influencing, leading change that drives business performance.
  • Verbal and written communication skills.
  • Conflict management and problem-solving.
  • Assessment and decision-making skills.
  • Relationship building both within the organization and with external sources.
  • Presentation and facilitation skills.
  • Analytical
  • Deductive and inductive reasoning.
  • Critical thinking.
  • Forward thinking.
  • Technical Expertise.

  • Data Engineer

    5 months ago

    Dallas, United States NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...

  • Data Quality Engineer

    4 weeks ago

    Dallas, United States Loopback LLC Full time

    About Loopback Loopback is a leading provider of data-driven solutions for health systems and life science organizations. The company's comprehensive analytics platform drives growth for specialty pharmacy programs while connecting pharmacy activities with clinical and economic outcomes. Loopback partners with Life Science leaders to tackle their most...

  • Data Engineering

    4 weeks ago

    Dallas, United States Maintec Technologies Full time

    Job Title: Data Engineering (Quality and Governance) Job Location:-Dallas, TX/ Salt Lake City, Utah/ New York City, NY (Day 1 Onsite)- Candidate needs to work 5 Days in Week from Client Office Experience :- 12+ Years Rate:-$65-H1-b,USC,GC Data Engineers with experience in Data Quality and Governance Working with cloud and on-prem, able to write code,...

  • IT - Data Engineer

    21 hours ago

    Dallas, United States ADEX Full time

    Job Title: Data Engineer Job Description: Client is looking for a Data Engineer to join their Advanced Analytics team under the Wholesale organization. This engineer will design and deliver data solutions for the analytics and data science teams in the consumer organization. The engineer will be able to work with all types of interesting data: fiber network...

  • "Data Engineer"

    21 hours ago

    Dallas, United States TechnoGen Full time

    Job Title: Data Engineer Job Location: Remote Mandatory Skills: • Strong hands-on Experience with GCP • Strong Experience with Python Developemnt • Experience with GCP, SQL, Pyspark, Python, Airflow Job Description: We are seeking a talented Data Engineer with a strong hands-on experience with Snowflake, expertise in Python development, and...

  • Data Engineer

    1 day ago

    Dallas, United States Omni Inclusive Full time

    We are seeking a talented Data Engineer with 7+ years of experience to join our team in the telecom industry. The ideal candidate will have a strong background in data engineering, with specific experience in telecom data processing, ETL development, and data pipeline optimization. You will work closely with our data scientists and business analysts to help...

  • Data Engineer

    5 months ago

    Dallas, United States Diverse Lynx Full time

    Skill: Data Engineer Must have Python, AWS skills. As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development. Collaborating with cross-functional teams, you will be responsible for designing,...

  • Data Engineer

    2 months ago

    Dallas, United States BuzzClan Full time

    BuzzClan is an elite business consulting firm collaborating to provide software, advisory and implementation services. BuzzClan is a certified partner for most of the tier 1 cloud, hardware and software providers. Being a vertically integrated solutions company, BuzzClan is known for their capability in the IT Services space.Job Title: Data Engineer...

  • Lead Data Engineer

    3 weeks ago

    Dallas, United States INSPYR Solutions Full time

    Title: Lead Data Engineer Location: Irving, TX 75039 (Hybrid) Duration: Direct Hire Compensation: $175K - $200K Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Skillset / Experience: We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in...

  • Lead Data Engineer

    21 hours ago

    Dallas, United States CV Library Full time

    Job Title: Lead Data EngineerDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data...

  • Lead Data Engineer

    3 months ago

    Dallas, United States Anblicks Full time

    Job Title: Lead Data EngineerLocation: Dallas, TXDesign and implement Snowflake data pipelines and data warehouses to support business intelligence, analytics, and machine learning initiatives.Optimize data models and query performance to ensure efficient data access and analysis.Develop and maintain data governance policies and procedures to ensure data...

  • Lead Data Engineer

    1 month ago

    dallas, United States Anblicks Full time

    Job Title: Lead Data EngineerLocation: Dallas, TXDesign and implement Snowflake data pipelines and data warehouses to support business intelligence, analytics, and machine learning initiatives.Optimize data models and query performance to ensure efficient data access and analysis.Develop and maintain data governance policies and procedures to ensure data...

  • Lead Data Engineer

    2 months ago

    dallas, United States Anblicks Full time

    Job Title: Lead Data EngineerLocation: Dallas, TXDesign and implement Snowflake data pipelines and data warehouses to support business intelligence, analytics, and machine learning initiatives.Optimize data models and query performance to ensure efficient data access and analysis.Develop and maintain data governance policies and procedures to ensure data...

  • Data Engineer

    1 day ago

    Dallas, United States Hunt Corporation Full time

    Job DescriptionJob Description: We're seeking a talented and experienced Data Engineer to join our team. In this role, you'll be the go-to person for managing and optimizing our data infrastructure, ensuring our data pipelines are efficient, scalable, and secure. You'll play a pivotal role in enabling data-driven decisions across the organization by...

  • Lead Data Engineer

    22 hours ago

    Dallas, United States INSPYR Solutions Full time

    Title: Lead Data Engineer Location: Irving, TX 75039 (Hybrid) Duration: Direct Hire Compensation: $175K - $200K Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Skillset / Experience: We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in...

  • Data Engineer Architect

    22 hours ago

    Dallas, United States Pan Asia Resources Full time

    Job Title: Data Engineer Architect (PySpark) Location: Dallas, TX Job Type: Full-Time Department: Data Engineering We are seeking a talented Data Engineer Architect with expertise in PySpark. Job Summary: As a Data Engineer Architect, you will play a pivotal role in designing and implementing scalable data pipelines and architecture that facilitate data...

  • Senior Data Engineer

    1 month ago

    dallas, United States Murphy USA Full time

    DATA ENGINEER VMurphy USA is in the midst of a technological transformation, investing heavily in our team and technologies to drive business impact. We are looking for a talented Data Engineer to build and maintain our data infrastructure, ensuring our analytical capabilities stay ahead of the curve.GENERAL DESCRIPTION OF POSITIONThe Data Engineer will be...

  • Data Engineer

    3 months ago

    Dallas, United States Clinicapro Full time

    About:Jesica is a recruiting agency that utilizes AI to source, screen and match candidates to right career opportunities. We work on behalf on our clients who are actively seeking qualified candidates to these roles. If you are a candidate either actively looking or just browsing, we highly encourage you to complete the application process as you never know...

  • Data Engineer

    6 months ago

    Dallas, United States Capgemini Full time

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings...

  • Data Engineer

    1 week ago

    Dallas, United States PDS Tech Commercial Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer - Advanced Analytics Team (Wholesale Organization)PDS Tech Commercial, Inc. is seeking an experienced Data Engineer to join our Advanced Analytics team under the Wholesale organization. This role will focus on designing and building ETL pipelines to migrate data from SQL Server to Databricks, optimizing...