English
Related papers

Related papers: Mitigating Overfitting in Supervised Classificatio…

200 papers

When a deep learning model is deployed in the wild, it can encounter test data drawn from distributions different from the training data distribution and suffer drop in performance. For safe deployment, it is essential to estimate the…

Machine Learning · Computer Science 2023-05-16 Jiefeng Chen , Frederick Liu , Besim Avci , Xi Wu , Yingyu Liang , Somesh Jha

Quantification is the supervised learning task that consists of training predictors of the class prevalence values of sets of unlabelled data, and is of special interest when the labelled data on which the predictor has been trained and the…

Machine Learning · Computer Science 2023-10-10 Pablo González , Alejandro Moreo , Fabrizio Sebastiani

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

Self-training is an important technique for solving semi-supervised learning problems. It leverages unlabeled data by generating pseudo-labels and combining them with a limited labeled dataset for training. The effectiveness of…

Machine Learning · Computer Science 2023-11-06 Banghua Zhu , Mingyu Ding , Philip Jacobson , Ming Wu , Wei Zhan , Michael Jordan , Jiantao Jiao

Many important classification problems, such as object classification, speech recognition, and machine translation, have been tackled by the supervised learning paradigm in the past, where training corpora of parallel input-output pairs are…

Machine Learning · Computer Science 2019-06-10 Yu Liu , Li Deng , Jianshu Chen , Chang Wen Chen

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

Cross-modal data matching refers to retrieval of data from one modality, when given a query from another modality. In general, supervised algorithms achieve better retrieval performance compared to their unsupervised counterpart, as they…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Devraj Mandal , Pramod Rao , Soma Biswas

Amortized Bayesian inference (ABI) with neural networks can solve probabilistic inverse problems orders of magnitude faster than classical methods. However, ABI is not yet sufficiently robust for widespread and safe application. When…

Machine Learning · Statistics 2026-03-04 Aayush Mishra , Daniel Habermann , Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

Unsupervised domain adaptive (UDA) person re-identification (re-ID) is a challenging task due to the missing of labels for the target domain data. To handle this problem, some recent works adopt clustering algorithms to off-line generate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yongxing Dai , Jun Liu , Yan Bai , Zekun Tong , Ling-Yu Duan

In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects,…

Machine Learning · Computer Science 2024-12-24 Ismail Hakki Karaman , Gulser Koksal , Levent Eriskin , Salih Salihoglu

The repeated community-wide reuse of test sets in popular benchmark problems raises doubts about the credibility of reported test-error rates. Verifying whether a learned model is overfitted to a test set is challenging as independent test…

Machine Learning · Computer Science 2019-11-15 Roman Werpachowski , András György , Csaba Szepesvári

This article addresses the problem of classification method based on both labeled and unlabeled data, where we assume that a density function for labeled data is different from that for unlabeled data. We propose a semi-supervised logistic…

Machine Learning · Statistics 2014-02-20 Shuichi Kawano

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

Machine Learning · Computer Science 2022-07-26 Ehsan Kazemi

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

In biomedical and public health association studies, binary outcome variables may be subject to misclassification, resulting in substantial bias in effect estimates. The feasibility of addressing binary outcome misclassification in…

Methodology · Statistics 2024-03-19 Kimberly A. Hochstedler Webb , Martin T. Wells

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu