English
Related papers

Related papers: Local Temperature Scaling for Probability Calibrat…

200 papers

Datasets with noisy labels are a common occurrence in practical applications of classification methods. We propose a simple probabilistic method for training deep classifiers under input-dependent (heteroscedastic) label noise. We assume an…

Machine Learning · Computer Science 2020-11-16 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

Although deep neural networks yield high classification accuracy given sufficient training data, their predictions are typically overconfident or under-confident, i.e., the prediction confidences cannot truly reflect the accuracy. Post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jiexin Wang , Jiahao Chen , Bing Su

For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing…

Machine Learning · Computer Science 2024-11-07 Adrien LeCoz , Stéphane Herbin , Faouzi Adjed

Despite the undeniable progress in visual recognition tasks fueled by deep neural networks, there exists recent evidence showing that these models are poorly calibrated, resulting in over-confident predictions. The standard practices of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Balamurali Murugesan , Bingyuan Liu , Adrian Galdran , Ismail Ben Ayed , Jose Dolz

Semi-supervised semantic segmentation learns a model for classifying pixels into specific classes using a few labeled samples and numerous unlabeled images. The recent leading approach is consistency regularization by selftraining with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jingi Ju , Hyeoncheol Noh , Yooseung Wang , Minseok Seo , Dong-Geol Choi

In this paper we develop a principled, probabilistic, unified approach to non-standard classification tasks, such as semi-supervised, positive-unlabelled, multi-positive-unlabelled and noisy-label learning. We train a classifier on the…

Machine Learning · Computer Science 2020-06-17 Jeppe Nørregaard , Lars Kai Hansen

Recent advances in deep learning have significantly improved predictive accuracy. However, modern neural networks remain systematically overconfident, posing risks for deployment in safety-critical scenarios. Current post-hoc calibration…

Machine Learning · Computer Science 2025-07-01 Haolan Guo , Linwei Tao , Haoyang Luo , Minjing Dong , Chang Xu

Leveraging multiple training datasets to scale up image segmentation models is beneficial for increasing robustness and semantic understanding. Individual datasets have well-defined ground truth with non-overlapping mask layouts and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Di Liu , Abhishek Aich , Dimitris Metaxas , Samuel Schulter

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Model calibration seeks to ensure that models produce confidence scores that accurately reflect the true likelihood of their predictions being correct. However, existing calibration approaches are fundamentally tied to datasets of one-hot…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Haoyang Luo , Linwei Tao , Minjing Dong , Chang Xu

In semantic segmentation, training data down-sampling is commonly performed due to limited resources, the need to adapt image size to the model input, or improve data augmentation. This down-sampling typically employs different strategies…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Roberto Alcover-Couso , Marcos Escudero-Vinolo , Juan C. SanMiguel , Jose M. Martinez

In this paper, we propose to employ semantic segmentation to improve person-related attribute prediction. The core idea lies in the fact that the probability of an attribute to appear in an image is far from being uniform in the spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Mahdi M. Kalayeh , Mubarak Shah

This paper proposes a multi-label classification algorithm capable of continual learning by applying an Adaptive Resonance Theory (ART)-based clustering algorithm and the Bayesian approach for label probability computation. The ART-based…

Machine Learning · Computer Science 2024-10-04 Naoki Masuyama , Yusuke Nojima , Chu Kiong Loo , Hisao Ishibuchi

Despite recent improvements using fully convolutional networks, in general, the segmentation produced by most state-of-the-art semantic segmentation methods does not show satisfactory adherence to the object boundaries. We propose a method…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Philipe A. Dias , Henry Medeiros

While the predictions produced by conformal prediction are set-valued, the data used for training and calibration is supposed to be precise. In the setting of superset learning or learning from partial labels, a variant of weakly supervised…

Machine Learning · Computer Science 2023-06-05 Alireza Javanmardi , Yusuf Sale , Paul Hofman , Eyke Hüllermeier

In binary classification tasks, accurate representation of probabilistic predictions is essential for various real-world applications such as predicting payment defaults or assessing medical risks. The model must then be well-calibrated to…

Machine Learning · Computer Science 2024-08-08 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

Large-scale training for semantic segmentation is challenging due to the expense of obtaining training data for this task relative to other vision tasks. We propose a novel training approach to address this difficulty. Given…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Paul Vernaza , Manmohan Chandraker

Probabilistic classifiers output confidence scores along with their predictions, and these confidence scores should be calibrated, i.e., they should reflect the reliability of the prediction. Confidence scores that minimize standard metrics…

Multilabel classification is a relatively recent subfield of machine learning. Unlike to the classical approach, where instances are labeled with only one category, in multilabel classification, an arbitrary number of categories is chosen…

Artificial Intelligence · Computer Science 2013-03-01 Alfonso E. Romero , Luis M. de Campos

Pixel-level labels are particularly expensive to acquire. Hence, pretraining is a critical step to improve models on a task like semantic segmentation. However, prominent algorithms for pretraining neural networks use image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Mathilde Caron , Neil Houlsby , Cordelia Schmid