English
Related papers

Related papers: RADMI: Latent Information Aggregation as a Proxy f…

200 papers

Neural network classifiers trained with cross-entropy loss achieve strong predictive accuracy but lack the capability to provide inherent predictive uncertainty estimates, thus requiring external techniques to obtain these estimates. In…

Machine Learning · Statistics 2026-04-08 Courtney Franzen , Farhad Pourkamali-Anaraki

Estimating accurate and well-calibrated predictive uncertainty is important for enhancing the reliability of computer vision models, especially in safety-critical applications like traffic scene perception. While ensemble methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Svetlana Pavlitska , Beyza Keskin , Alwin Faßbender , Christian Hubschneider , J. Marius Zöllner

We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning models. To accurately estimate MI from a finite number of samples, we present GMM-MI…

Data Analysis, Statistics and Probability · Physics 2023-04-12 Davide Piras , Hiranya V. Peiris , Andrew Pontzen , Luisa Lucie-Smith , Ningyuan Guo , Brian Nord

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Xiao Yang , Roland Kwitt , Martin Styner , Marc Niethammer

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially…

Machine Learning · Statistics 2022-05-26 Lucas Kook , Andrea Götschi , Philipp FM Baumann , Torsten Hothorn , Beate Sick

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy…

Information Theory · Computer Science 2018-10-30 Arman Rahimzamani , Himanshu Asnani , Pramod Viswanath , Sreeram Kannan

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

This work proposes an evidence-retrieval mechanism for uncertainty-aware decision-making that replaces a single global cutoff with an evidence-conditioned, instance-adaptive criterion. For each test instance, proximal exemplars are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hassan Gharoun , Mohammad Sadegh Khorshidi , Kasra Ranjbarigderi , Fang Chen , Amir H. Gandomi

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

Machine Learning · Computer Science 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Reconstruction-based anomaly detection models achieve their purpose by suppressing the generalization ability for anomaly. However, diverse normal patterns are consequently not well reconstructed as well. Although some efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenrui Liu , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

This paper addresses the problem of dense depth predictions from sparse distance sensor data and a single camera image on challenging weather conditions. This work explores the significance of different sensor modalities such as camera,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Sadique Adnan Siddiqui , Axel Vierling , Karsten Berns

Automatic Mean Opinion Score (MOS) prediction is crucial to evaluate the perceptual quality of the synthetic speech. While recent approaches using pre-trained self-supervised learning (SSL) models have shown promising results, they only…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Hui Wang , Shiwan Zhao , Xiguang Zheng , Yong Qin

The key challenge in unaligned multimodal language sequences lies in effectively integrating information from various modalities to obtain a refined multimodal joint representation. Recently, the disentangle and fuse methods have achieved…

Computation and Language · Computer Science 2024-09-20 Fan Qian , Jiqing Han , Jianchen Li , Yongjun He , Tieran Zheng , Guibin Zheng

Uncertainty estimation has been extensively studied in recent literature, which can usually be classified as aleatoric uncertainty and epistemic uncertainty. In current aleatoric uncertainty estimation frameworks, it is often neglected that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jing Zhang , Yuchao Dai , Mehrtash Harandi , Yiran Zhong , Nick Barnes , Richard Hartley

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

In recent years, there has been a significant increase in applications of multimodal signal processing and analysis, largely driven by the increased availability of multimodal datasets and the rapid progress in multimodal learning systems.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-22 Hadi Hadizadeh , S. Faegheh Yeganli , Bahador Rashidi , Ivan V. Bajić

Accurate uncertainty quantification is a major challenge in deep learning, as neural networks can make overconfident errors and assign high confidence predictions to out-of-distribution (OOD) inputs. The most popular approaches to estimate…

Deploying depth estimation networks in the real world requires high-level robustness against various adverse conditions to ensure safe and reliable autonomy. For this purpose, many autonomous vehicles employ multi-modal sensor systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ukcheol Shin , Kyunghyun Lee , Jean Oh

We present layered ray intersections (LaRI), a new method for unseen geometry reasoning from a single image. Unlike conventional depth estimation that is limited to the visible surface, LaRI models multiple surfaces intersected by the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Rui Li , Biao Zhang , Zhenyu Li , Federico Tombari , Peter Wonka