中文
相关论文

相关论文: Calibrating Bayesian Learning via Regularization, …

200 篇论文

The problem of detecting the Out-of-Distribution (OoD) inputs is of paramount importance for Deep Neural Networks. It has been previously shown that even Deep Generative Models that allow estimating the density of the inputs may not be…

机器学习 · 统计学 2023-01-02 Misha Glazunov , Apostolis Zarras

Out-of-distribution (OOD) detection is critical for identifying test samples that deviate from in-distribution (ID) data, ensuring network robustness and reliability. This paper presents a flexible framework for OOD knowledge distillation…

机器学习 · 计算机科学 2025-06-30 Zhilin Zhao , Longbing Cao , Yixuan Zhang , Kun-Yu Lin , Wei-Shi Zheng

Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to evaluate the…

机器学习 · 计算机科学 2023-11-13 Russell Alan Hart , Linlin Yu , Yifei Lou , Feng Chen

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

机器学习 · 计算机科学 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

机器学习 · 计算机科学 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

机器学习 · 计算机科学 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

Miscalibration in deep learning refers to there is a discrepancy between the predicted confidence and performance. This problem usually arises due to the overfitting problem, which is characterized by learning everything presented in the…

机器学习 · 计算机科学 2024-07-16 Zongbo Han , Yifeng Yang , Changqing Zhang , Linjun Zhang , Joey Tianyi Zhou , Qinghua Hu

Deep neural networks have been increasingly used in safety-critical applications such as medical diagnosis and autonomous driving. However, many studies suggest that they are prone to being poorly calibrated and have a propensity for…

机器学习 · 计算机科学 2025-06-02 Chengli Tan , Yubo Zhou , Haishan Ye , Guang Dai , Junmin Liu , Zengjie Song , Jiangshe Zhang , Zixiang Zhao , Yunda Hao , Yong Xu

Optimizing objectives under constraints, where both the objectives and constraints are black box functions, is a common scenario in real-world applications such as scientific experimental design, design of medical therapies, and industrial…

机器学习 · 计算机科学 2023-10-16 Fengxue Zhang , Zejie Zhu , Yuxin Chen

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

机器学习 · 计算机科学 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

Conventional frequentist learning is known to yield poorly calibrated models that fail to reliably quantify the uncertainty of their decisions. Bayesian learning can improve calibration, but formal guarantees apply only under restrictive…

机器学习 · 统计学 2022-10-07 Sangwoo Park , Kfir M. Cohen , Osvaldo Simeone

The pervasive issue of bias in AI presents a significant challenge to painting classification, and is getting more serious as these systems become increasingly integrated into tasks like art curation and restoration. Biases, often arising…

人工智能 · 计算机科学 2025-07-11 Mridula Vijendran , Shuang Chen , Jingjing Deng , Hubert P. H. Shum

The need to avoid confident predictions on unfamiliar data has sparked interest in out-of-distribution (OOD) detection. It is widely assumed that Bayesian neural networks (BNN) are well suited for this task, as the endowed epistemic…

机器学习 · 计算机科学 2021-07-27 Christian Henning , Francesco D'Angelo , Benjamin F. Grewe

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

机器学习 · 计算机科学 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

机器学习 · 统计学 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Typical Bayesian approaches to OOD detection use epistemic uncertainty. Surprisingly from the Bayesian perspective, there are a number of methods that successfully use aleatoric uncertainty to detect OOD points (e.g. Hendryks et al. 2018).…

机器学习 · 统计学 2021-10-29 Xi Wang , Laurence Aitchison

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

机器学习 · 计算机科学 2024-12-02 Yanzhe Bekkemoen , Helge Langseth

Ensuring that predicted probabilities align with observed frequencies is critical in high-stakes domains such as clinical decision support, autonomous driving and financial risk assessment. Existing calibration methods typically apply a…

机器学习 · 计算机科学 2026-05-26 Tomer Lavi , Bracha Shapira , Nadav Rappoport

Humans demonstrate a variety of interesting behavioral characteristics when performing tasks, such as selecting between seemingly equivalent optimal actions, performing recovery actions when deviating from the optimal trajectory, or…

机器人学 · 计算机科学 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

Technology of formal quantitative estimation of the conformity of the mathematical models to the available dataset is presented. Main purpose of the technology is to make easier the model selection decision-making process for the…

最优化与控制 · 数学 2020-04-21 Alexander Sokolov , Vladimir Voloshinov