English
Related papers

Related papers: Cautious Calibration in Binary Classification

200 papers

This paper is dedicated to a cautious learning methodology for predicting preferences between alternatives characterized by binary attributes (formally, each alternative is seen as a subset of attributes). By "cautious", we mean that the…

Artificial Intelligence · Computer Science 2022-06-16 Hugo Gilbert , Mohamed Ouaguenouni , Meltem Ozturk , Olivier Spanjaard

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

Machine Learning · Computer Science 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

Advanced classification algorithms are being increasingly used in safety-critical applications like health-care, engineering, etc. In such applications, miss-classifications made by ML algorithms can result in substantial financial or…

Machine Learning · Computer Science 2024-12-06 Disha Ghandwani , Neeraj Sarna , Yuanyuan Li , Yang Lin

We study the problem of semantic segmentation calibration. Lots of solutions have been proposed to approach model miscalibration of confidence in image classification. However, to date, confidence calibration research on semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dongdong Wang , Boqing Gong , Liqiang Wang

Trained DNN models are increasingly adopted as integral parts of software systems, but they often perform deficiently in the field. A particularly damaging problem is that DNN models often give false predictions with high confidence, due to…

Machine Learning · Computer Science 2020-09-16 Zenan Li , Xiaoxing Ma , Chang Xu , Jingwei Xu , Chun Cao , Jian Lü

Contextual optimization, also known as predict-then-optimize or prescriptive analytics, considers an optimization problem with the presence of covariates (context or side information). The goal is to learn a prediction model (from the…

Optimization and Control · Mathematics 2024-05-13 Chunlin Sun , Linyu Liu , Xiaocheng Li

Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks…

Machine Learning · Computer Science 2024-06-10 Yu-Chang Wu , Shen-Huan Lyu , Haopu Shang , Xiangyu Wang , Chao Qian

Calibration weighting has been widely used to correct selection biases in non-probability sampling, missing data, and causal inference. The main idea is to calibrate the biased sample to the benchmark by adjusting the subject weights.…

Methodology · Statistics 2023-05-30 Chenyin Gao , Shu Yang , Jae Kwang Kim

Calibration can reduce overconfident predictions of deep neural networks, but can calibration also accelerate training? In this paper, we show that it can when used to prioritize some examples for performing subset selection. We study the…

Machine Learning · Computer Science 2022-11-17 Ganesh Tata , Gautham Krishna Gudur , Gopinath Chennupati , Mohammad Emtiyaz Khan

Accurate probabilistic predictions are essential for optimal decision making. While neural network miscalibration has been studied primarily in classification, we investigate this in the less-explored domain of regression. We conduct the…

Machine Learning · Computer Science 2023-06-08 Victor Dheur , Souhaib Ben Taieb

Computer models, aiming at simulating a complex real system, are often calibrated in the light of data to improve performance. Standard calibration methods assume that the optimal values of calibration parameters are invariant to the model…

Methodology · Statistics 2017-09-01 Georgios Karagiannis , Bledar A. Konomi , Guang Lin

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

Accurately predicting the probabilities of user feedback, such as clicks and conversions, is critical for advertisement ranking and bidding. However, there often exist unwanted mismatches between predicted probabilities and true likelihoods…

Machine Learning · Computer Science 2024-05-22 Yuang Zhao , Chuhan Wu , Qinglin Jia , Hong Zhu , Jia Yan , Libin Zong , Linxuan Zhang , Zhenhua Dong , Muyu Zhang

Survival analysis deals with modeling the time until an event occurs, and accurate probability estimates are crucial for decision-making, particularly in the competing-risks setting where multiple events are possible. While recent work has…

Methodology · Statistics 2026-02-03 Julie Alberge , Tristan Haugomat , Gaël Varoquaux , Judith Abécassis

Confidence calibration is central to providing accurate and interpretable uncertainty estimates, especially under safety-critical scenarios. However, we find that existing calibration algorithms often overlook the issue of *proximity bias*,…

Machine Learning · Computer Science 2024-03-19 Miao Xiong , Ailin Deng , Pang Wei Koh , Jiaying Wu , Shen Li , Jianqing Xu , Bryan Hooi

Confidence calibration is a major concern when applying artificial neural networks in safety-critical applications. Since most research in this area has focused on classification in the past, confidence calibration in the scope of object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Franziska Schwaiger , Maximilian Henne , Fabian Küppers , Felippe Schmoeller Roza , Karsten Roscher , Anselm Haselhoff

This paper investigates the post-hoc calibration of confidence for "exploratory" machine learning classification problems. The difficulty in these problems stems from the continuing desire to push the boundaries of which categories have…

As we move away from the data, the predictive uncertainty should increase, since a great variety of explanations are consistent with the little available information. We introduce Distance-Aware Prior (DAP) calibration, a method to correct…

Machine Learning · Statistics 2022-07-19 Gianluca Detommaso , Alberto Gasparin , Andrew Wilson , Cedric Archambeau

For many applications of probabilistic classifiers it is important that the predicted confidence vectors reflect true probabilities (one says that the classifier is calibrated). It has been shown that common models fail to satisfy this…

Machine Learning · Statistics 2022-10-10 Michael Panchenko , Anes Benmerzoug , Miguel de Benito Delgado

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki