English
Related papers

Related papers: Something for (almost) nothing: Improving deep ens…

200 papers

We present a new flavor of Variational Autoencoder (VAE) that interpolates seamlessly between unsupervised, semi-supervised and fully supervised learning domains. We show that unlabeled datapoints not only boost unsupervised tasks, but also…

Machine Learning · Computer Science 2019-11-15 Felix Berkhahn , Richard Keys , Wajih Ouertani , Nikhil Shetty , Dominik Geißler

Deep learning revolution happened thanks to the availability of a massive amount of labelled data which have contributed to the development of models with extraordinary inference capabilities. Despite the public availability of a large…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jurandy Almeida , Cristiano Saltori , Paolo Rota , Nicu Sebe

We propose a novel framework for incorporating unlabeled data into semi-supervised classification problems, where scenarios involving the minimization of either i) adversarially robust or ii) non-robust loss functions have been considered.…

Overconfidence is a common issue for deep neural networks, limiting their deployment in real-world applications. To better estimate confidence, existing methods mostly focus on fully-supervised scenarios and rely on training labels. In this…

Machine Learning · Computer Science 2023-07-21 Chen Li , Xiaoling Hu , Chao Chen

In semi-supervised classification, one is given access both to labeled and unlabeled data. As unlabeled data is typically cheaper to acquire than labeled data, this setup becomes advantageous as soon as one can exploit the unlabeled data in…

Machine Learning · Computer Science 2022-02-10 Christina Göpfert , Shai Ben-David , Olivier Bousquet , Sylvain Gelly , Ilya Tolstikhin , Ruth Urner

Compressing giant neural networks has gained much attention for their extensive applications on edge devices such as cellphones. During the compressing process, one of the most important procedures is to retrain the pre-trained models using…

Machine Learning · Computer Science 2019-12-23 Yehui Tang , Shan You , Chang Xu , Boxin Shi , Chao Xu

This paper investigates novel classifier ensemble techniques for uncertainty calibration applied to various deep neural networks for image classification. We evaluate both accuracy and calibration metrics, focusing on Expected Calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Michael Schulze , Nikolas Ebert , Laurenz Reichardt , Oliver Wasenmüller

Cross-modal data matching refers to retrieval of data from one modality, when given a query from another modality. In general, supervised algorithms achieve better retrieval performance compared to their unsupervised counterpart, as they…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Devraj Mandal , Pramod Rao , Soma Biswas

Existing similarity-based weakly supervised learning approaches often rely on precise similarity annotations between data pairs, which may inadvertently expose sensitive label information and raise privacy risks. To mitigate this issue, we…

Machine Learning · Computer Science 2025-09-16 Meng Wei , Zhongnian Li , Peng Ying , Xinzheng Xu

We study the problem of fair binary classification using the notion of Equal Opportunity. It requires the true positive rate to distribute equally across the sensitive groups. Within this setting we show that the fair optimal classifier is…

Statistics Theory · Mathematics 2020-02-05 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri , Luca Oneto , Massimiliano Pontil

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama

Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a…

Machine Learning · Computer Science 2019-10-25 David Berthelot , Nicholas Carlini , Ian Goodfellow , Nicolas Papernot , Avital Oliver , Colin Raffel

Pairwise similarities and dissimilarities between data points might be easier to obtain than fully labeled data in real-world classification problems, e.g., in privacy-aware situations. To handle such pairwise information, an empirical risk…

Machine Learning · Computer Science 2019-04-29 Takuya Shimada , Han Bao , Issei Sato , Masashi Sugiyama

Labeling mistakes are frequently encountered in real-world applications. If not treated well, the labeling mistakes can deteriorate the classification performances of a model seriously. To address this issue, we propose an improved Naive…

Machine Learning · Computer Science 2023-04-14 Qianhan Zeng , Yingqiu Zhu , Xuening Zhu , Feifei Wang , Weichen Zhao , Shuning Sun , Meng Su , Hansheng Wang

Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data is challenging.…

Machine Learning · Computer Science 2026-05-19 Hong-Phuc Phan , Tuan-Anh Vu , Tung Kieu , Son Ha Xuan , Bin Yang , Christian S. Jensen

In semi-supervised representation learning frameworks, when the number of labelled data is very scarce, the quality and representativeness of these samples become increasingly important. Existing literature on semi-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shuvendu Roy , Ali Etemad

For classification tasks, deep neural networks are prone to overfitting in the presence of label noise. Although existing methods are able to alleviate this problem at low noise levels, they encounter significant performance reduction at…

Machine Learning · Computer Science 2021-05-31 Jingyi Xu , Tony Q. S. Quek , Kai Fong Ernest Chong

This paper addresses performance degradation in anomalous sound detection (ASD) when neither sufficiently similar machine data nor operational state labels are available. We present an integrated pipeline that combines three complementary…

Sound · Computer Science 2025-05-27 Ibuki Kuroyanagi , Takuya Fujimura , Kazuya Takeda , Tomoki Toda

Selecting informative data points for expert feedback can significantly improve the performance of anomaly detection (AD) in various contexts, such as medical diagnostics or fraud detection. In this paper, we determine a set of theoretical…

Machine Learning · Computer Science 2023-07-06 Aodong Li , Chen Qiu , Marius Kloft , Padhraic Smyth , Stephan Mandt , Maja Rudolph

We develop a worst-case analysis of aggregation of classifier ensembles for binary classification. The task of predicting to minimize error is formulated as a game played over a given set of unlabeled data (a transductive setting), where…

Machine Learning · Computer Science 2015-06-22 Akshay Balsubramani , Yoav Freund