中文
相关论文

相关论文: Effects of Training Data Quality on Classifier Per…

200 篇论文

Data quality issues have attracted widespread attention due to the negative impacts of dirty data on data mining and machine learning results. The relationship between data quality and the accuracy of results could be applied on the…

数据库 · 计算机科学 2021-04-27 Zhixin Qi , Hongzhi Wang , Jianzhong Li , Hong Gao

Data imbalance is a common problem in machine learning that can have a critical effect on the performance of a model. Various solutions exist but their impact on the convergence of the learning dynamics is not understood. Here, we elucidate…

机器学习 · 统计学 2024-02-20 Emanuele Francazi , Marco Baity-Jesi , Aurelien Lucchi

The accuracy and robustness of machine learning models against adversarial attacks are significantly influenced by factors such as training data quality, model architecture, the training process, and the deployment environment. In recent…

机器学习 · 计算机科学 2026-03-19 Alireza Aghabagherloo , Aydin Abadi , Sumanta Sarkar , Vishnu Asutosh Dasu , Bart Preneel

Collecting more diverse and representative training data is often touted as a remedy for the disparate performance of machine learning predictors across subpopulations. However, a precise framework for understanding how dataset properties…

机器学习 · 计算机科学 2021-06-08 Esther Rolf , Theodora Worledge , Benjamin Recht , Michael I. Jordan

Building trustworthy, effective, and responsible machine learning systems hinges on understanding how differences in training data and modeling decisions interact to impact predictive performance. In this work, we seek to better understand…

机器学习 · 计算机科学 2022-11-14 Esther Rolf , Ben Packer , Alex Beutel , Fernando Diaz

While learning with limited labelled data can improve performance when the labels are lacking, it is also sensitive to the effects of uncontrolled randomness introduced by so-called randomness factors (e.g., varying order of data). We…

计算与语言 · 计算机科学 2024-12-03 Branislav Pecher , Ivan Srba , Maria Bielikova

The popular softmax loss and its recent extensions have achieved great success in the deep learning-based image classification. However, the data for training image classifiers usually has different quality. Ignoring such problem, the…

计算机视觉与模式识别 · 计算机科学 2020-07-29 Weihua Liu , Xiabi Liu , Murong Wang , Ling Ma

Classifier calibration does not always go hand in hand with the classifier's ability to separate the classes. There are applications where good classifier calibration, i.e. the ability to produce accurate probability estimates, is more…

机器学习 · 计算机科学 2020-05-26 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

In this paper, we delve into the critical aspect of dataset quality assessment in machine learning classification tasks. Leveraging a variety of nine distinct datasets, each crafted for classification tasks with varying complexity levels,…

机器学习 · 计算机科学 2023-06-28 Szymon Mazurek , Maciej Wielgosz

Nowadays, people strive to improve the accuracy of deep learning models. However, very little work has focused on the quality of data sets. In fact, data quality determines model quality. Therefore, it is important for us to make research…

机器学习 · 计算机科学 2019-07-01 Tianxing He , Shengcheng Yu , Ziyuan Wang , Jieqiong Li , Zhenyu Chen

Large-scale models are pretrained on massive web-crawled datasets containing documents of mixed quality, making data filtering essential. A popular method is Classifier-based Quality Filtering (CQF), which trains a binary classifier to…

机器学习 · 计算机科学 2025-10-03 Thiziri Nait Saada , Louis Bethune , Michal Klein , David Grangier , Marco Cuturi , Pierre Ablin

Precise perception of the environment is essential in highly automated driving systems, which rely on machine learning tasks such as object detection and segmentation. Compression of sensor data is commonly used for data handling, while…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Christian Steinhauser , Philipp Reis , Hubert Padusinski , Jacob Langner , Eric Sax

While post-training quantization is widely adopted for efficient deployment of large language models, the mechanisms underlying quantization robustness remain unclear. We conduct a comprehensive analysis of quantization degradation across…

机器学习 · 计算机科学 2026-02-02 Albert Catalan-Tatjer , Niccolò Ajroldi , Jonas Geiping

A face recognition model is typically trained on large datasets of images that may be collected from controlled environments. This results in performance discrepancies when applied to real-world scenarios due to the domain gap between clean…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Erdi Sarıtaş , Hazım Kemal Ekenel

The quality and generality of deep image features is crucially determined by the data they have been trained on, but little is known about this often overlooked effect. In this paper, we systematically study the effect of variations in the…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Othman Sbai , Camille Couprie , Mathieu Aubry

Neural networks are not learning optimal decision boundaries. We show that decision boundaries are situated in areas of low training data density. They are impacted by few training samples which can easily lead to overfitting. We provide a…

机器学习 · 计算机科学 2023-10-09 Johannes Schneider

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

计算与语言 · 计算机科学 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Class imbalance in deep neural networks (DNNs) has witnessed a rapid increase in research attention in recent years. However, the varying accounts of the reasons behind the poor performance of DNN on imbalance data in pertinent literature…

机器学习 · 计算机科学 2026-05-26 Ismail B. Mustapha , Shafaatunnur Hasan , Sunday O. Olatunji , Hatem S. Y. Nabus

Recent large language models have been trained on vast datasets, but also often on repeated data, either intentionally for the purpose of upweighting higher quality data, or unintentionally because data deduplication is not perfect and the…

When training a machine learning classifier on data where one of the classes is intrinsically rare, the classifier will often assign too few sources to the rare class. To address this, it is common to up-weight the examples of the rare…

机器学习 · 计算机科学 2022-08-02 Sean E. Lake , Chao-Wei Tsai