Current jobs related to Data Pipeline QA Specialist - Cincinnati - CoStrategix LTD
-
Senior Data Engineer
2 weeks ago
Cincinnati, Ohio, United States Gravity IT Resources Full timeJob SummaryWe are seeking a skilled Data Engineer to join our Data Science team at Gravity IT Resources. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows.Key...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States Apex Systems Full timeJob Summary:Alex Systems is seeking a skilled Data Engineer to join our Data Science team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows.Key...
-
Data Integration Specialist
1 week ago
Cincinnati, Ohio, United States Capgemini Full timeJob Title: Data Integration SpecialistCapgemini is seeking a skilled Data Integration Specialist to join our team. As a Data Integration Specialist, you will be responsible for designing and building data provisioning workflows/pipelines, physical data schemas, extracts, data transformations, and data integrations using ETL tools like Informatica Talend.Key...
-
Data Provisioning Specialist
1 week ago
Cincinnati, Ohio, United States Capgemini Full timeData Provisioning SpecialistAt Capgemini, we're looking for a skilled Data Provisioning Specialist to join our team. As a Data Provisioning Specialist, you will be responsible for designing and building data provisioning workflows/pipelines, physical data schemas, extracts, data transformations, and data integrations using ETL tools like Informatica...
-
Mobile QA Automation Specialist
4 weeks ago
Cincinnati, Ohio, United States Matlen Silver Full timeMobile QA Engineer Job DescriptionWe are seeking a skilled Mobile QA Engineer to join our client's innovative team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by optimizing supplier selection, reducing transit time, enhancing merchandising,...
-
Data Quality Assurance Specialist
2 weeks ago
Cincinnati, Ohio, United States CoStrategix LTD Full timeJob Title: Data Quality Assurance SpecialistWe are seeking a highly skilled Data Quality Assurance Specialist to join our team at CoStrategix LTD. As a key member of our data quality team, you will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets.Key Responsibilities:Design and implement a robust data...
-
Mobile QA Engineer
2 months ago
Cincinnati, United States Matlen Silver Full timeJob Title: Mobile QA EngineerHybrid: 2 Days Onsite Each Week Cincinnati OhioCompensation: $70 - $85/HourWe are seeking an experienced Mobile QA Engineer to join our client's cutting-edge team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by...
-
Mobile QA Engineer
2 months ago
Cincinnati, United States Matlen Silver Full timeJob Title: Mobile QA EngineerHybrid: 2 Days Onsite Each Week Cincinnati OhioCompensation: $70 - $85/HourWe are seeking an experienced Mobile QA Engineer to join our client's cutting-edge team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by...
-
Mobile QA Engineer
2 weeks ago
cincinnati, United States Matlen Silver Full timeJob Title: Mobile QA EngineerHybrid: 2 Days Onsite Each Week Cincinnati OhioCompensation: $70 - $85/HourWe are seeking an experienced Mobile QA Engineer to join our client's cutting-edge team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by...
-
Mobile QA Engineer
3 weeks ago
Cincinnati, United States Matlen Silver Full timeJob Title: Mobile QA EngineerHybrid: 2 Days Onsite Each Week Cincinnati OhioCompensation: $70 - $85/HourWe are seeking an experienced Mobile QA Engineer to join our client's cutting-edge team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by...
-
Mobile QA Engineer
2 weeks ago
Cincinnati, United States Matlen Silver Full timeJob Title: Mobile QA EngineerHybrid: 2 Days Onsite Each Week Cincinnati OhioCompensation: $70 - $85/HourWe are seeking an experienced Mobile QA Engineer to join our client's cutting-edge team working on the In-store End-to-End Fresh Initiative. This initiative focuses on delivering fresher food to shoppers and keeping perishables on the shelf longer by...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States CostQuest Associates Full timeJob Title: Data Engineer - SQL Server & PostgreSQL SpecialistWe are seeking a skilled and analytical Data Engineer to join our team at CostQuest Associates.Job Summary:The successful candidate will be responsible for designing, developing, and maintaining database infrastructure, creating and managing data pipelines, and collaborating with various teams to...
-
Data Quality Assurance Specialist
2 weeks ago
Cincinnati, Ohio, United States TechnoGen Full timeJob Title: QA LeadJob Summary:We are seeking a highly skilled QA Lead to join our team at TechnoGen. As a key member of our fast-paced team, you will contribute to the testing of data capabilities that support applications across the enterprise.Key Responsibilities:Analyze and support Business Intelligence solutions based on business requirements and...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States JobRialto Full timeJob Title: Data EngineerJob SummaryJobRialto is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure to support analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows. The ideal candidate will have strong technical expertise, problem-solving skills,...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States ALTA IT Services Full timeJob Title: Data EngineerALTA IT Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.Key Responsibilities:Design and develop data...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States eTek IT Services, Inc. Full timeJob Title: Data EngineerJob Summary:eTek IT Services, Inc. is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure to support data analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows.Key Responsibilities:Data Pipeline Development: Design, develop,...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States System One Full timeJob Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at System One. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.Key Responsibilities:Design and develop...
-
Data Engineer
2 weeks ago
Cincinnati, Ohio, United States System One Full timeData Engineer Job DescriptionSystem One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.Key Responsibilities:Design and develop data...
-
Data Engineering Specialist
6 days ago
Cincinnati, Ohio, United States Purple Fly Solutions Full timeJob Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Purple Fly Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems. This role involves data engineering, data analysis, and programming, requiring a self-starter who can also coach others, with...
-
Building Maintenance Specialist
1 month ago
Cincinnati, Ohio, United States General Data Full timeAbout the Role:We are seeking a skilled Building Maintenance Specialist to join our team at General Data. As a key member of our facilities team, you will be responsible for ensuring the smooth operation of our buildings and equipment.Key Responsibilities:Perform preventative maintenance tasks as assigned to ensure optimal equipment performance.Conduct...
Data Pipeline QA Specialist
2 months ago
Summary
We are seeking an experienced Data Pipeline Quality Assurance Specialist to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Pipeline Quality Assurance Specialist, you will play a critical role in developing and implementing data quality standards, processes, and tools leveraging automation to uphold the integrity of our data throughout its lifecycle. This role requires a deep understanding of quality assurance, data quality principles, strong analytical and technical skills, and the ability to collaborate with cross-functional teams to identify and resolve data quality issues.
Responsibilities
1. Data Quality Framework Development:
o Design, implement, and maintain a robust data quality framework leveraging automation to assess, monitor, and enhance the quality of data across various systems and platforms.
o Design and implementation of E2E data testing strategies leading to successful execution of test cases to ensure high quality across the data platforms.
o Leverage automation in to the testing quality framework (Databricks, PySpark/Spark, SQL, Python)
2. Data Profiling and Analysis:
o Conduct thorough data testing and data profiling to identify anomalies, inconsistencies, and inaccuracies in datasets.
3. Data Quality Standards and Policies:
o Define and enforce data quality standards and policies, collaborating with stakeholders to establish guidelines for data accuracy, completeness, and timeliness.
o Leadership role in defect life cycle management: logging, replication, triage, verification, etc.
4. Quality Assurance Testing:
o Develop and execute comprehensive data quality testing strategies and plans to validate data accuracy and integrity in various data sources.
5. Data Cleansing and Remediation:
o Implement data cleansing and remediation processes to address identified data quality issues, ensuring data is accurate and compliant with organizational standards.
6. Collaboration:
o Collaborate with data engineers, data scientists, and other cross-functional teams to integrate data quality checks into the data pipeline and maintain quality throughout.
7. Documentation:
o Create and maintain documentation related to data quality processes, standards, and issue resolution procedures.
8. Monitoring and Reporting:
o Establish monitoring mechanisms to proactively identify data quality issues, and generate regular reports on data quality metrics for management review.
o Acquire high volumes of test data to support test execution.
9. Continuous Improvement:
o Continuously assess and enhance data quality processes and methodologies to adapt to evolving business needs and industry best practices.
10. Training and Knowledge Sharing:
o Provide training and guidance to team members on data quality best practices and principles. Facilitate knowledge sharing sessions to promote a culture of data quality awareness.
Required
1. Technology & Tooling:
o Strong skills and experience in using PySpark/Spark to automate test cases
o Apply strong SQL skills for querying with extensive join conditions and updating data based on specified conditions.
o Strong Python skills, key in scripting automation into the quality process.
2. CI/CD Lifecycle:
o Contribute to and enhance the continuous integration and continuous delivery (CI/CD) lifecycles.
3. Testing:
o Design and implement unit, integration, and regression tests to ensure the reliability of data quality processes.
o Experience in defect life cycle management: logging, replication, triage, verification, etc.
o Experience in validating and testing workflows in Databricks, with a focus on data extraction, transformation, and loading into Delta tables. Proficient in using Databricks notebooks and Delta Lake features for implementing and testing data transformations.
o Skilled in leveraging PySpark/Spark SQL and Delta Lake optimizations to ensure data quality and performance.
o Experience in E2E product features testing and business report testing.
4. Agile SCRUM Projects:
o Collaborate effectively within an Agile SCRUM framework, participating in sprint planning, reviews, and retrospectives.
Highly Desired
1. Data Management:
o Utilize expert level skills in Databricks, PySpark, Spark Structured Streaming, Delta Live Tables, and Delta Sharing for advanced data management.
2. Expert SQL Knowledge:
o Demonstrate expert-level knowledge of SQL for complex data querying and manipulation.
3. Python Development:
o Utilize expert level skills to develop and maintain data quality scripts, tools, and frameworks to support data quality.
4. Streaming Technologies:
o Apply experience with streaming technologies such as Apache Kafka, Azure EventHubs, and Avro to enhance data processing capabilities.
5. DevOps Proficiency:
o Work within a DevOps environment, demonstrating expertise in Linux, GitHub, and Bash scripting.
Education and Experience
- Bachelor's or Master's degree in Computer Science, Information Technology or related field.
- Proven experience as a Data Quality Assurance Pipeline Specialist or in a similar role.
- Strong understanding of data quality concepts, methodologies, and best practices.
- Familiarity with data governance frameworks and practices.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
- Strong skills and experience with data quality tools and technologies.
- Relevant certifications (e.g., Certified Data Management Professional) are advantageous.
If you are a data quality enthusiast with a strong technical background, we invite you to join our team and contribute to the excellence of our data-driven solutions.