English
Related papers

Related papers: Uncertainty-Aware Attention for Reliable Interpret…

200 papers

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

Neural networks with attention have proven effective for many natural language processing tasks. In this paper, we develop attention mechanisms for uncertainty detection. In particular, we generalize standardly used attention mechanisms by…

Computation and Language · Computer Science 2017-01-11 Heike Adel , Hinrich Schütze

The application of computer vision is gradually increasing across various domains. They employ deep learning models with a black-box nature. Without the ability to explain the behavior of neural networks, especially their decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Maryam Sadat Hosseini Azad , Shahriar Baradaran Shokouhi , Amir Abbas Hamidi Imani , Shahin Atakishiyev , Randy Goebel

Activity recognition in wearable computing faces two key challenges: i) activity characteristics may be context-dependent and change under different contexts or situations; ii) unknown contexts and activities may occur from time to time,…

Machine Learning · Computer Science 2020-03-05 Zepeng Huo , Arash PakBin , Xiaohan Chen , Nathan Hurley , Ye Yuan , Xiaoning Qian , Zhangyang Wang , Shuai Huang , Bobak Mortazavi

Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic…

Machine Learning · Computer Science 2023-12-21 Wang Zhang , Ziwen Ma , Subhro Das , Tsui-Wei Weng , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Attention mechanisms represent a fundamental paradigm shift in neural network architectures, enabling models to selectively focus on relevant portions of input sequences through learned weighting functions. This monograph provides a…

Machine Learning · Computer Science 2026-01-08 Hasi Hays

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Badri N. Patro , Mayank Lunayach , Vinay P. Namboodiri

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Image classification models have achieved satisfactory performance on many datasets, sometimes even better than human. However, The model attention is unclear since the lack of interpretability. This paper investigates the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Wenjia Xu , Jiuniu Wang , Yang Wang , Guangluan Xu , Wei Dai , Yirong Wu

Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty…

Machine Learning · Computer Science 2023-11-23 H. Linander , O. Balabanov , H. Yang , B. Mehlig

To address the intermittency of renewable energy source (RES) generation, scenario forecasting offers a series of stochastic realizations for predictive objects with superior flexibility and direct views. Based on a long time-series…

Machine Learning · Computer Science 2025-09-23 Yifei Wu , Bo Wang , Jingshi Cui , Pei-chun Lin , Junzo Watada

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

Predictive uncertainty-a model's self awareness regarding its accuracy on an input-is key for both building robust models via training interventions and for test-time applications such as selective classification. We propose a novel…

Machine Learning · Computer Science 2024-01-04 Nishant Jain , Karthikeyan Shanmugam , Pradeep Shenoy

The prevalence of employing attention mechanisms has brought along concerns on the interpretability of attention distributions. Although it provides insights about how a model is operating, utilizing attention as the explanation of model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Tristan Gomez , Suiyi Ling , Thomas Fréour , Harold Mouchère

OOD detection has become more pertinent with advances in network design and increased task complexity. Identifying which parts of the data a given network is misclassifying has become as valuable as the network's overall performance. We can…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Rishi Singhal , Srinath Srinivasan

Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This…

Machine Learning · Computer Science 2018-12-31 Rowan McAllister , Gregory Kahn , Jeff Clune , Sergey Levine

Deep neural networks (DNNs) provide state-of-the-art results for a multitude of applications, but the approaches using DNNs for multimodal audiovisual applications do not consider predictive uncertainty associated with individual…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Mahesh Subedar , Ranganath Krishnan , Paulo Lopez Meyer , Omesh Tickoo , Jonathan Huang