English
Related papers

Related papers: Confidence sets with expected sizes for Multiclass…

200 papers

Semi-supervised learning approaches train on small sets of labeled data along with large sets of unlabeled data. Self-training is a semi-supervised teacher-student approach that often suffers from the problem of "confirmation bias" that…

Machine Learning · Computer Science 2023-01-19 Aswathnarayan Radhakrishnan , Jim Davis , Zachary Rabin , Benjamin Lewis , Matthew Scherreik , Roman Ilin

There is often a mixture of very frequent labels and very infrequent labels in multi-label datatsets. This variation in label frequency, a type class imbalance, creates a significant challenge for building efficient multi-label…

Machine Learning · Computer Science 2021-09-28 Payel Sadhukhan , Arjun Pakrashi , Sarbani Palit , Brian Mac Namee

Class imbalance is an intrinsic characteristic of multi-label data. Most of the labels in multi-label data sets are associated with a small number of training examples, much smaller compared to the size of the data set. Class imbalance…

Machine Learning · Computer Science 2018-11-07 Bin Liu , Grigorios Tsoumakas

Training neural networks with one-hot target labels often results in overconfidence and overfitting. Label smoothing addresses this issue by perturbing the one-hot target labels by adding a uniform probability vector to create a regularized…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

Semi-supervised learning (SSL) has long been proved to be an effective technique to construct powerful models with limited labels. In the existing literature, consistency regularization-based methods, which force the perturbed samples to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Xihong Yang , Xiaochang Hu , Sihang Zhou , Xinwang Liu , En Zhu

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

Machine Learning · Computer Science 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

In this article, we study rates of convergence of the generalization error of multi-class margin classifiers. In particular, we develop an upper bound theory quantifying the generalization error of various large margin classifiers. The…

Statistics Theory · Mathematics 2011-11-10 Xiaotong Shen , Lifeng Wang

In a variety of settings, limitations of sensing technologies or other sampling mechanisms result in missing labels, where the likelihood of a missing label in the training set is an unknown function of the data. For example, satellites…

Machine Learning · Statistics 2021-03-26 Hyebin Song , Garvesh Raskutti , Rebecca Willett

We address the problem of novelty detection in multiclass scenarios where some class labels are missing from the training set. Our method is based on the initial assignment of confidence values, which measure the affinity between a new test…

Computer Vision and Pattern Recognition · Computer Science 2016-05-17 Nomi Vinokurov , Daphna Weinshall

Multi-label image classification allows predicting a set of labels from a given image. Unlike multiclass classification, where only one label per image is assigned, such a setup is applicable for a broader range of applications. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Kirill Prokofiev , Vladislav Sovrasov

Multi-label text classification (MLTC) is the task of assigning multiple labels to a given text, and has a wide range of application domains. Most existing approaches require an enormous amount of annotated data to learn a classifier and/or…

Computation and Language · Computer Science 2023-09-26 Muberra Ozmen , Joseph Cotnareanu , Mark Coates

Pairwise similarities and dissimilarities between data points might be easier to obtain than fully labeled data in real-world classification problems, e.g., in privacy-aware situations. To handle such pairwise information, an empirical risk…

Machine Learning · Computer Science 2019-04-29 Takuya Shimada , Han Bao , Issei Sato , Masashi Sugiyama

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Marco Loog

Deep neural networks present impressive performance, yet they cannot reliably estimate their predictive confidence, limiting their applicability in high-risk domains. We show that applying a multi-label one-vs-all loss reveals…

Machine Learning · Computer Science 2022-06-29 Bartosz Wójcik , Jacek Grela , Marek Śmieja , Krzysztof Misztal , Jacek Tabor

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

Machine Learning · Computer Science 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

In semantic segmentation, the creation of pixel-level labels for training data incurs significant costs. To address this problem, semi-supervised learning, which utilizes a small number of labeled images alongside unlabeled images to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Takahiro Mano , Reiji Saito , Kazuhiro Hotta

In this paper, we investigate the use of an unsupervised label clustering technique and demonstrate that it enables substantial improvements in visual relationship prediction accuracy on the Person in Context (PIC) dataset. We propose to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Hsuan-Kung Yang , An-Chieh Cheng , Kuan-Wei Ho , Tsu-Jui Fu , Chun-Yi Lee

Recent advances in semi-supervised learning methods rely on estimating the categories of unlabeled data using a model trained on the labeled data (pseudo-labeling) and using the unlabeled data for various consistency-based regularization.…

Machine Learning · Computer Science 2019-06-14 Chia-Wen Kuo , Chih-Yao Ma , Jia-Bin Huang , Zsolt Kira