Data Quality Engineer

5 days ago

Blue Ash, United States CoStrategix Full time

Summary

We are seeking an experienced Data Quality Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Engineer, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging automation to uphold the integrity of our data throughout its lifecycle. This role requires a deep understanding of quality assurance, data quality principles, strong analytical and technical skills, and the ability to collaborate with cross-functional teams to identify and resolve data quality issues.

Responsibilities

1. Data Quality Framework Development:

o Design, implement, and maintain a robust data quality framework leveraging automation to assess, monitor, and enhance the quality of data across various systems and platforms.

o Design and implementation of E2E data testing strategies leading to successful execution of test cases to ensure high quality across the data platforms.

o Leverage automation in to the testing quality framework (Databricks, PySpark/Spark, SQL, Python)

2. Data Profiling and Analysis:

o Conduct thorough data testing and data profiling to identify anomalies, inconsistencies, and inaccuracies in datasets.

3. Data Quality Standards and Policies:

o Define and enforce data quality standards and policies, collaborating with stakeholders to establish guidelines for data accuracy, completeness, and timeliness.

o Leadership role in defect life cycle management: logging, replication, triage, verification, etc.

4. Quality Assurance Testing:

o Develop and execute comprehensive data quality testing strategies and plans to validate data accuracy and integrity in various data sources.

5. Data Cleansing and Remediation:

o Implement data cleansing and remediation processes to address identified data quality issues, ensuring data is accurate and compliant with organizational standards.

6. Collaboration:

o Collaborate with data engineers, data scientists, and other cross-functional teams to integrate data quality checks into the data pipeline and maintain quality throughout.

7. Documentation:

o Create and maintain documentation related to data quality processes, standards, and issue resolution procedures.

8. Monitoring and Reporting:

o Establish monitoring mechanisms to proactively identify data quality issues, and generate regular reports on data quality metrics for management review.

o Acquire high volumes of test data to support test execution.

9. Continuous Improvement:

o Continuously assess and enhance data quality processes and methodologies to adapt to evolving business needs and industry best practices.

10. Training and Knowledge Sharing:

o Provide training and guidance to team members on data quality best practices and principles. Facilitate knowledge sharing sessions to promote a culture of data quality awareness.

Required

1. Technology & Tooling:

o Strong skills and experience in using PySpark/Spark to automate test cases

o Apply strong SQL skills for querying with extensive join conditions and updating data based on specified conditions.

o Strong Python skills, key in scripting automation into the quality process.

2. CI/CD Lifecycle:

o Contribute to and enhance the continuous integration and continuous delivery (CI/CD) lifecycles.

3. Testing:

o Design and implement unit, integration, and regression tests to ensure the reliability of data quality processes.

o Experience in defect life cycle management: logging, replication, triage, verification, etc.

o Experience in validating and testing workflows in Databricks, with a focus on data extraction, transformation, and loading into Delta tables. Proficient in using Databricks notebooks and Delta Lake features for implementing and testing data transformations.

o Skilled in leveraging PySpark/Spark SQL and Delta Lake optimizations to ensure data quality and performance.

o Experience in E2E product features testing and business report testing.

4. Agile SCRUM Projects:

o Collaborate effectively within an Agile SCRUM framework, participating in sprint planning, reviews, and retrospectives.

Highly Desired

1. Data Management:

o Utilize expert level skills in Databricks, PySpark, Spark Structured Streaming, Delta Live Tables, and Delta Sharing for advanced data management.

2. Expert SQL Knowledge:

o Demonstrate expert-level knowledge of SQL for complex data querying and manipulation.

3. Python Development:

o Utilize expert level skills to develop and maintain data quality scripts, tools, and frameworks to support data quality.

4. Streaming Technologies:

o Apply experience with streaming technologies such as Apache Kafka, Azure EventHubs, and Avro to enhance data processing capabilities.

5. DevOps Proficiency:

o Work within a DevOps environment, demonstrating expertise in Linux, GitHub, and Bash scripting.

Education and Experience

  • Bachelor's or Master's degree in Computer Science, Information Technology or related field.
  • Proven experience as a Data Quality Assurance Pipeline Specialist or in a similar role.
  • Strong understanding of data quality concepts, methodologies, and best practices.
  • Familiarity with data governance frameworks and practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
  • Strong skills and experience with data quality tools and technologies.
  • Relevant certifications (e.g., Certified Data Management Professional) are advantageous.

If you are a data quality enthusiast with a strong technical background, we invite you to join our team and contribute to the excellence of our data-driven solutions.

  • Data Quality Engineer

    4 weeks ago

    blue ash, United States CoStrategix Full time

    SummaryWe are seeking an experienced Data Quality Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Engineer, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging...

  • Data Quality Engineer

    2 weeks ago

    Blue Ash, United States CoStrategix Full time

    SummaryWe are seeking an experienced Data Quality Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Engineer, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging...

  • Data Quality Engineer

    4 weeks ago

    Blue Ash, United States CoStrategix Full time

    SummaryWe are seeking an experienced Data Quality Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Engineer, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging...

  • Data Quality Assurance Engineer

    2 days ago

    blue ash, United States CoStrategix Full time

    SummaryWe are seeking an experienced Data Quality Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Engineer, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging...

  • Data Quality Assurance Specialist

    4 weeks ago

    Blue Ash, Ohio, United States CoStrategix Full time

    Job Title: Data Quality EngineerWe are seeking a highly skilled Data Quality Engineer to join our team at CoStrategix. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets.Key Responsibilities:Data Quality Framework Development: Design, implement, and maintain a robust data quality...

  • Data Quality Assurance Specialist

    3 weeks ago

    Blue Ash, Ohio, United States CoStrategix Full time

    Job Title: Data Quality EngineerWe are seeking an experienced Data Quality Engineer to join our dynamic team at CoStrategix. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets.Key Responsibilities:Data Quality Framework Development:Design, implement, and maintain a robust data...

  • Data Quality Assurance Specialist

    5 days ago

    Blue Ash, Ohio, United States CoStrategix Full time

    Job Title: Data Quality Assurance SpecialistWe are seeking a highly skilled Data Quality Assurance Specialist to join our team at CoStrategix. As a key member of our data quality team, you will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets.Key Responsibilities:Design, implement, and maintain a robust...

  • Data Engineer Level 2

    4 days ago

    Blue Ash, Ohio, United States Apidel Technologies Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Apidel Technologies. The successful candidate will be responsible for designing, building, and deploying scalable cloud-based solution architectures.The ideal candidate will have expertise in creating lakehouses in Azure and building Realtime Streaming Analytics Platforms leveraging...

  • Data Analyst

    19 hours ago

    Blue Ash, Ohio, United States Apex Systems Full time

    Job Summary:We are seeking a highly skilled Data Scientist to join our team at Apex Systems. As a Data Scientist, you will be responsible for analyzing and interpreting complex data to inform business decisions. Key Responsibilities:Develop and implement data analysis and machine learning models to drive business insightsCollaborate with cross-functional...

  • QA Engineer

    3 days ago

    Blue Ash, United States NLign Analytics Full time

    Quality Assurance EngineerAbout the Company:NLign Analytics provides unique, patented software-based solutions used in the manufacture and maintenance of aircraft to capture, organize, and visualize detailed structural inspection and repair data. The NLign software solution is currently used in aerospace manufacturing applications to improve first-pass yield...

  • QA Engineer

    2 days ago

    blue ash, United States NLign Analytics Full time

    Quality Assurance EngineerAbout the Company:NLign Analytics provides unique, patented software-based solutions used in the manufacture and maintenance of aircraft to capture, organize, and visualize detailed structural inspection and repair data. The NLign software solution is currently used in aerospace manufacturing applications to improve first-pass yield...

  • QA Engineer

    4 days ago

    Blue Ash, United States NLign Analytics Full time

    Quality Assurance EngineerAbout the Company:NLign Analytics provides unique, patented software-based solutions used in the manufacture and maintenance of aircraft to capture, organize, and visualize detailed structural inspection and repair data. The NLign software solution is currently used in aerospace manufacturing applications to improve first-pass yield...

  • Process Engineering Internship Opportunity

    4 weeks ago

    Blue Ash, Ohio, United States H.B. Fuller Full time

    About the InternshipH.B. Fuller, a leading global adhesives company, is seeking a talented Process Engineering Intern to join our team. As a member of our engineering team, you will have the opportunity to work on impactful projects that drive business growth and innovation.Job SummaryThe Process Engineering Intern will work closely with our plant manager,...

  • Quality Assurance Specialist

    3 weeks ago

    Blue Ash, Ohio, United States Thinkpath Engineering Services Full time

    Job OpportunityWe are seeking a highly skilled Quality Engineer to join our team at Thinkpath Engineering Services. This is a one-year contract position with potential for extension or direct hire.Key Responsibilities:Develop and implement quality processes to meet AS9100 certification standards.Break down complex assembly drawings into detailed...

  • Software Engineer in Test

    4 weeks ago

    Blue Ash, Ohio, United States Eviden Full time

    Job Title: Software Engineer in TestEviden, a global leader in data-driven digital transformation, is seeking a skilled Software Engineer in Test to join our team. As a key member of our cross-functional project teams, you will be responsible for ensuring quality is driven into the heart of our development process.Key Responsibilities:Design, develop, and...

  • Electrical Engineer Associate

    2 weeks ago

    Blue Ash, Ohio, United States L3Harris Technologies Full time

    Job Title: Electrical Engineer AssociateAs an Electrical Engineer Associate at L3Harris Technologies, you will play a key role in designing and developing electrical systems and components. Your responsibilities will include determining design approaches and parameters, performing system analysis to ensure feasibility within time and cost constraints, and...

  • Backend Software Engineer

    5 days ago

    Blue Ash, Ohio, United States Apidel Technologies Full time

    {"h1": "Backend Developer Level 2", "p": "Apidel Technologies is seeking a skilled Backend Developer to join our team. As a Backend Developer, you will be responsible for designing, building, testing, and maintaining the backend components of our highly scalable e-commerce web and merchandizing applications. Key Responsibilities: * Develop backend...

  • Python Engineer

    9 hours ago

    blue ash, United States Insight Global Full time

    Position: Python EngineerLocation: Blue Ash, OH (3 days on site)Hire Type: 6 month contract-to-hirePay Range: $55-75/hr (contingent on experience, relevant skills, education)Must Haves:5 years of experience with object oriented programmingStrong knowledge of Python programmingAdvanced SQL (or similar database experience)Experience working in the cloud...

  • Python Engineer

    15 hours ago

    Blue Ash, United States Insight Global Full time

    Position: Python EngineerLocation: Blue Ash, OH (3 days on site)Hire Type: 6 month contract-to-hirePay Range: $55-75/hr (contingent on experience, relevant skills, education)Must Haves:5 years of experience with object oriented programmingStrong knowledge of Python programmingAdvanced SQL (or similar database experience)Experience working in the cloud...

  • Program Manager

    5 days ago

    Blue Ash, Ohio, United States ACL Digital Full time

    Job Title: Program ManagerACL Digital is seeking a highly skilled Program Manager to lead the integration of technology and operational infrastructure following the merger of Client and Albertsons. This role will be critical in delivering new data mapping technology, systems, and reporting solutions to support the rebannering of newly acquired stores and...