English
Related papers

Related papers: Exploring Dataset-Scale Indicators of Data Quality

200 papers

Deep learning is now the gold standard in computer vision-based quality inspection systems. In order to detect defects, supervised learning is often utilized, but necessitates a large amount of annotated images, which can be costly:…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Pierre Gutierrez , Maria Luschkova , Antoine Cordier , Mustafa Shukor , Mona Schappert , Tim Dahmen

When selecting data for training large-scale models, standard practice is to filter for examples that match human notions of data quality. Such filtering yields qualitatively clean datapoints that intuitively should improve model behavior.…

Machine Learning · Computer Science 2024-01-24 Logan Engstrom , Axel Feldmann , Aleksander Madry

The efficacy of machine learning (ML) models depends on both algorithms and data. Training data defines what we want our models to learn, and testing data provides the means by which their empirical progress is measured. Benchmark datasets…

Machine Learning · Computer Science 2021-11-23 Lora Aroyo , Matthew Lease , Praveen Paritosh , Mike Schaekermann

Due to the over-emphasize of the quantity of data, the data quality has often been overlooked. However, not all training data points contribute equally to learning. In particular, if mislabeled, it might actively damage the performance of…

Machine Learning · Computer Science 2021-09-13 Vaibhav Pulastya , Gaurav Nuti , Yash Kumar Atri , Tanmoy Chakraborty

Since the behavior of a neural network model is adversely affected by a lack of diversity in training data, we present a method that identifies and explains such deficiencies. When a dataset is labeled, we note that annotations alone are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Dhasarathy Parthasarathy , Anton Johansson

Light fields become a popular representation of three dimensional scenes, and there is interest in their processing, resampling, and compression. As those operations often result in loss of quality, there is a need to quantify it. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Vamsi Kiran Adhikarla , Marek Vinkler , Denis Sumin , Rafał K. Mantiuk , Karol Myszkowski , Hans-Peter Seidel , Piotr Didyk

Computational aesthetics is an emerging field of research which has attracted different research groups in the last few years. In this field, one of the main approaches to evaluate the aesthetic quality of paintings and photographs is a…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Seyed Ali Amirshahi , Gregor Uwe Hayn-Leichsenring , Joachim Denzler , Christoph Redies

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Vishal Kaushal , Anurag Sahoo , Khoshrav Doctor , Narasimha Raju , Suyash Shetty , Pankaj Singh , Rishabh Iyer , Ganesh Ramakrishnan

High-quality data is key to interpretable and trustworthy data analytics and the basis for meaningful data-driven decisions. In practical scenarios, data quality is typically associated with data preprocessing, profiling, and cleansing for…

Databases · Computer Science 2019-07-19 Lisa Ehrlinger , Elisa Rusz , Wolfram Wöß

Data is a cornerstone of empirical software engineering (ESE) research and practice. Data underpin numerous process and project management activities, including the estimation of development effort and the prediction of the likely location…

Software Engineering · Computer Science 2020-12-22 Michael F. Bosu , Stephen G. MacDonell

Machine-vision-based defect classification techniques have been widely adopted for automatic quality inspection in manufacturing processes. This article describes a general framework for classifying defects from high volume data batches…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Wenbo Sun , Raed Al Kontar , Judy Jin , Tzyy-Shuh Chang

Cluster analysis is widely used in the areas of machine learning and data mining. Fuzzy clustering is a particular method that considers that a data point can belong to more than one cluster. Fuzzy clustering helps obtain flexible clusters,…

Machine Learning · Computer Science 2018-06-06 Aybükë Oztürk , Stéphane Lallich , Jérôme Darmont

Machine learning (ML) datasets, often perceived as neutral, inherently encapsulate abstract and disputed social constructs. Dataset curators frequently employ value-laden terms such as diversity, bias, and quality to characterize datasets.…

Machine Learning · Computer Science 2024-07-12 Dora Zhao , Jerone T. A. Andrews , Orestis Papakyriakopoulos , Alice Xiang

Label noise is a common problem in real-world datasets, affecting both model training and validation. Clean data are essential for achieving strong performance and ensuring reliable evaluation. While various techniques have been proposed to…

Machine Learning · Computer Science 2025-10-21 Henrique Pickler , Jorge K. S. Kamassury , Danilo Silva

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Large-scale datasets for single-label multi-class classification, such as \emph{ImageNet-1k}, have been instrumental in advancing deep learning and computer vision. However, a critical and often understudied aspect is the comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Esla Timothy Anzaku , Hyesoo Hong , Jin-Woo Park , Wonjun Yang , Kangmin Kim , JongBum Won , Deshika Vinoshani Kumari Herath , Arnout Van Messem , Wesley De Neve

Optimal viewpoint prediction is an essential task in many computer graphics applications. Unfortunately, common viewpoint qualities suffer from two major drawbacks: dependency on clean surface meshes, which are not always available, and the…

Graphics · Computer Science 2021-02-10 Michael Schelling , Pedro Hermosilla , Pere-Pau Vazquez , Timo Ropinski

Annotators exhibit disagreement during data labeling, which can be termed as annotator label uncertainty. Annotator label uncertainty manifests in variations of labeling quality. Training with a single low-quality annotation per sample…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib

The performance of face analysis and recognition systems depends on the quality of the acquired face data, which is influenced by numerous factors. Automatically assessing the quality of face data in terms of biometric utility can thus be…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Torsten Schlett , Christian Rathgeb , Olaf Henniger , Javier Galbally , Julian Fierrez , Christoph Busch

Data quality is commonly defined as fitness for use. The problem of identifying quality of data is faced by many data consumers. Data publishers often do not have the means to identify quality problems in their data. To make the task for…

Databases · Computer Science 2014-08-12 Jeremy Debattista , Christoph Lange , Sören Auer