English
Related papers

Related papers: An Exploration of How Training Set Composition Bia…

200 papers

Consider making a prediction over new test data without any opportunity to learn from a training set of labelled data - instead given access to a set of expert models and their predictions alongside some limited information about the…

Machine Learning · Computer Science 2022-10-12 Alex J. Chan , Mihaela van der Schaar

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

Machine Learning · Computer Science 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

Machine Learning · Computer Science 2019-01-15 Wouter M. Kouw , Marco Loog

In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair…

Machine Learning · Computer Science 2023-12-12 Mohit Sharma , Amit Deshpande , Rajiv Ratn Shah

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

When trained on diverse labeled data, machine learning models have proven themselves to be a powerful tool in all facets of society. However, due to budget limitations, deliberate or non-deliberate censorship, and other problems during data…

Machine Learning · Statistics 2022-03-25 Thomas Kehrenberg , Myles Bartlett , Viktoriia Sharmanska , Novi Quadrianto

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

Machine Learning · Computer Science 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

Supervised machine learning utilizes large datasets, often with ground truth labels annotated by humans. While some data points are easy to classify, others are hard to classify, which reduces the inter-annotator agreement. This causes…

Human-Computer Interaction · Computer Science 2023-02-14 Andrea Papenmeier , Dagmar Kern , Daniel Hienert , Yvonne Kammerer , Christin Seifert

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

In this study, we evaluate several classifiers and focus on selecting a minimal set of appropriate material features. Our objective is to propose and discuss general strategies for reducing the number of descriptors required for material…

Other Condensed Matter · Physics 2025-10-01 Giovanni Trezza , Eliodoro Chiavazzo

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

Machine learning from training data with a skewed distribution of examples per class can lead to models that favor performance on common classes at the expense of performance on rare ones. AudioSet has a very wide range of priors over its…

Machine Learning · Computer Science 2023-07-04 R. Channing Moore , Daniel P. W. Ellis , Eduardo Fonseca , Shawn Hershey , Aren Jansen , Manoj Plakal

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen

We propose a model to tackle classification tasks in the presence of very little training data. To this aim, we approximate the notion of exact match with a theoretically sound mechanism that computes a probability of matching in the input…

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser

The basic underlying assumption of machine learning (ML) models is that the training and test data are sampled from the same distribution. However, in daily practice, this assumption is often broken, i.e. the distribution of the test data…

Computation and Language · Computer Science 2026-01-16 Adriana Valentina Costache , Silviu Florin Gheorghe , Eduard Gabriel Poesina , Paul Irofti , Radu Tudor Ionescu

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are…

Machine Learning · Computer Science 2018-11-21 Jacob M. Springer , Charles S. Strauss , Austin M. Thresher , Edward Kim , Garrett T. Kenyon