English
Related papers

Related papers: Detecting Quality Problems in Research Data: A Mod…

200 papers

Data capture and use is vital for the continuous improvement of both student learning and behavior management. Previous studies on data use in the education sector have highlighted a number of problems associated with data quality and its…

Computers and Society · Computer Science 2016-05-26 Wayne Hellmuth , Glenn Stewart

The implementation of robust, stable, and user-centered data analytics and machine learning models is confronted by numerous challenges in production and manufacturing. Therefore, a systematic approach is required to develop, evaluate, and…

Software Engineering · Computer Science 2020-08-03 Shailesh Tripathi , David Muhr , Brunner Manuel , Frank Emmert-Streib , Herbert Jodlbauer , Matthias Dehmer

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

In the era of big data, ensuring the quality of datasets has become increasingly crucial across various domains. We propose a comprehensive framework designed to automatically assess and rectify data quality issues in any given dataset,…

Databases · Computer Science 2024-09-17 Djibril Sarr

Artificial intelligence (AI) has transformed various fields, significantly impacting our daily lives. A major factor in AI success is high-quality data. In this paper, we present a comprehensive review of the evolution of data quality (DQ)…

Databases · Computer Science 2024-11-06 Sijie Dong , Soror Sahri , Themis Palpanas

Training large language models (LLMs) for external tool usage is a rapidly expanding field, with recent research focusing on generating synthetic data to address the shortage of available data. However, the absence of systematic data…

Machine Learning · Computer Science 2024-09-27 Shadi Iskander , Nachshon Cohen , Zohar Karnin , Ori Shapira , Sofia Tolmach

Data-oriented applications, their users, and even the law require data of high quality. Research has divided the rather vague notion of data quality into various dimensions, such as accuracy, consistency, and reputation. To achieve the goal…

Databases · Computer Science 2024-12-09 Sedir Mohammed , Lisa Ehrlinger , Hazar Harmouch , Felix Naumann , Divesh Srivastava

We propose and apply a novel paradigm for characterization of genome data quality, which quantifies the effects of intentional degradation of quality. The rationale is that the higher the initial quality, the more fragile the genome and the…

Machine Learning · Statistics 2022-10-12 Alan F. Karr , Jason Hauzel , Adam A. Porter , Marcel Schaefer

Data catalogs play a crucial role in modern data-driven organizations by facilitating the discovery, understanding, and utilization of diverse data assets. However, ensuring their quality and reliability is complex, especially in open and…

Information Retrieval · Computer Science 2025-07-18 Jorge Martinez-Gil

In the past few decades, the life sciences have experienced an unprecedented accumulation of data, ranging from genomic sequences and proteomic profiles to heavy-content imaging, clinical assays, and commercial biological products for…

Databases · Computer Science 2025-09-22 Rosalia Moreddu

In an era dominated by data, the management and utilization of domain-specific language have emerged as critical challenges in various application domains, particularly those with industry-specific requirements. Our work is driven by the…

Artificial Intelligence · Computer Science 2024-10-08 Ricardo Di Pasquale , Soledad Represa

Model-based approaches for image reconstruction, analysis and interpretation have made significant progress over the last decades. Many of these approaches are based on either mathematical, physical or biological models. A challenge for…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Daniel Rueckert , Julia A. Schnabel

This tutorial overviews the state of the art in learning models over relational databases and makes the case for a first-principles approach that exploits recent developments in database research. The input to learning classification and…

Databases · Computer Science 2019-11-18 Maximilian Schleich , Dan Olteanu , Mahmoud Abo-Khamis , Hung Q. Ngo , XuanLong Nguyen

Recent advancements in deep learning have brought significant improvements to plant disease recognition. However, achieving satisfactory performance often requires high-quality training datasets, which are challenging and expensive to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Mingle Xu , Hyongsuk Kim , Jucheng Yang , Alvaro Fuentes , Yao Meng , Sook Yoon , Taehyun Kim , Dong Sun Park

Data quality assessment process is essential to ensure reliable analytical outcomes. This process depends on human supervision-driven approaches since it is impossible to determine a defect based only on data. Visualization systems belong…

Databases · Computer Science 2018-09-27 João Marcelo Borovina Josko , João Eduardo Ferreira

Context - The exponential growth of data is becoming a significant concern. Managing this data has become incredibly challenging, especially when dealing with various sources in different formats and speeds. Moreover, Ensuring data quality…

Software Engineering · Computer Science 2024-03-12 Moamin Abughazala

The research discusses how (open) data quality could be described, what should be considered developing a data quality management solution and how it could be applied to open data to check its quality. The proposed approach focuses on…

Databases · Computer Science 2022-06-16 Anastasija Nikiforova

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2022-08-23 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Foutse Khomh

Machine learning models are essential tools in various domains, but their performance can degrade over time due to changes in data distribution or other factors. On one hand, detecting and addressing such degradations is crucial for…

Machine Learning · Computer Science 2023-09-28 Florian Heinrichs

Storing data is easy, but finding and using data is not. It is desirable that the data is stored in a structured format, which can be preserved and retrieved in future. Creating Metadata for the data is one way of creating structured data…

Information Theory · Computer Science 2011-01-04 Ranjeet Devarakonda , Giri Palanisamy , Jim Green