English
Related papers

Related papers: IB-UQ: Information bottleneck based uncertainty qu…

200 papers

Neural Network (NN) models provide potential to speed up the drug discovery process and reduce its failure rates. The success of NN models require uncertainty quantification (UQ) as drug discovery explores chemical space beyond the training…

Machine Learning · Computer Science 2022-11-01 Ya Ju Fan , Jonathan E. Allen , Kevin S. McLoughlin , Da Shi , Brian J. Bennion , Xiaohua Zhang , Felice C. Lightstone

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN),…

Machine Learning · Computer Science 2020-12-08 João Caldeira , Brian Nord

Uncertainty quantification (UQ) is essential for assessing the reliability of Earth observation (EO) products. However, the extensive use of machine learning models in EO introduces an additional layer of complexity, as those models…

Machine Learning · Computer Science 2024-12-10 Yuanyuan Wang , Qian Song , Dawood Wasif , Muhammad Shahzad , Christoph Koller , Jonathan Bamber , Xiao Xiang Zhu

How can we quantify uncertainty if our favorite computational tool - be it a numerical, a statistical, or a machine learning approach, or just any computer model - provides single-valued output only? In this article, we introduce the Easy…

Methodology · Statistics 2023-07-25 Eva-Maria Walz , Alexander Henzi , Johanna Ziegel , Tilmann Gneiting

Graph Neural Networks (GNNs) have emerged as a prominent class of data-driven methods for molecular property prediction. However, a key limitation of typical GNN models is their inability to quantify uncertainties in the predictions. This…

Machine Learning · Computer Science 2024-07-02 Shengli Jiang , Shiyi Qin , Reid C. Van Lehn , Prasanna Balaprakash , Victor M. Zavala

Large molecular representation models pre-trained on massive unlabeled data have shown great success in predicting molecular properties. However, these models may tend to overfit the fine-tuning data, resulting in over-confident predictions…

Chemical Physics · Physics 2024-04-18 Yinghao Li , Lingkai Kong , Yuanqi Du , Yue Yu , Yuchen Zhuang , Wenhao Mu , Chao Zhang

Uncertainty Quantification (UQ) has gained traction in an attempt to improve the interpretability and robustness of machine learning predictions. Specifically (medical) biosignals such as electroencephalography (EEG), electrocardiography…

Signal Processing · Electrical Eng. & Systems 2025-06-06 Ivo Pascal de Jong , Andreea Ioana Sburlea , Matias Valdenegro-Toro

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

The information bottleneck (IB) method is a feasible defense solution against adversarial attacks in deep learning. However, this method suffers from the spurious correlation, which leads to the limitation of its further improvement of…

Machine Learning · Computer Science 2022-10-27 Huan Hua , Jun Yan , Xi Fang , Weiquan Huang , Huilin Yin , Wancheng Ge

Uncertainty Quantification (UQ) is a promising approach to improve model reliability, yet quantifying the uncertainty of Large Language Models (LLMs) is non-trivial. In this work, we establish a connection between the uncertainty of LLMs…

Computation and Language · Computer Science 2025-10-16 Mingda Li , Xinyu Li , Weinan Zhang , Longxuan Ma

Uncertainty quantification (UQ) has increasing importance in building robust high-performance and generalizable materials property prediction models. It can also be used in active learning to train better models by focusing on getting new…

Materials Science · Physics 2022-11-14 Daniel Varivoda , Rongzhi Dong , Sadman Sadeed Omee , Jianjun Hu

Graphical models have demonstrated their exceptional capabilities across numerous applications. However, their performance, confidence, and trustworthiness are often limited by the inherent randomness in data generation and the lack of…

Machine Learning · Computer Science 2026-04-15 Chao Chen , Chenghua Guo , Rui Xu , Jiujiu Chen , Xiangwen Liao , Xi Zhang , Sihong Xie , Hui Xiong , Philip Yu

We provide in this paper a concrete method for training a quantum neural network to maximize the relevant information about a property that is transmitted through the network. This is significant because it gives an operationally well…

Quantum Physics · Physics 2024-01-23 Ahmet Burak Catli , Nathan Wiebe

Machine learning methods are increasingly widely used in high-risk settings such as healthcare, transportation, and finance. In these settings, it is important that a model produces calibrated uncertainty to reflect its own confidence and…

Artificial Intelligence · Computer Science 2022-09-09 Sophia Sun

We are interested in estimating the uncertainties of deep neural networks, which play an important role in many scientific and engineering problems. In this paper, we present a striking new finding that an ensemble of neural networks with…

Machine Learning · Computer Science 2022-12-05 Jayaraman J. Thiagarajan , Rushil Anirudh , Vivek Narayanaswamy , Peer-Timo Bremer

Uncertainty Quantification (UQ) is an important building block for the reliable use of neural networks in real-world scenarios, as it can be a useful tool in identifying faulty predictions. Speech emotion recognition (SER) models can suffer…

Sound · Computer Science 2024-07-02 Oliver Schrüfer , Manuel Milling , Felix Burkhardt , Florian Eyben , Björn Schuller

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

A model's ability to express its own predictive uncertainty is an essential attribute for maintaining clinical user confidence as computational biomarkers are deployed into real-world medical settings. In the domain of cancer digital…

In recent years, large language models (LLMs) have become increasingly prevalent, offering remarkable text generation capabilities. However, a pressing challenge is their tendency to make confidently wrong predictions, highlighting the…

Computation and Language · Computer Science 2024-03-06 Xiang Gao , Jiaxin Zhang , Lalla Mouatadid , Kamalika Das

Deep learning is gaining increasing popularity for spatiotemporal forecasting. However, prior works have mostly focused on point estimates without quantifying the uncertainty of the predictions. In high stakes domains, being able to…

Artificial Intelligence · Computer Science 2021-06-15 Dongxia Wu , Liyao Gao , Xinyue Xiong , Matteo Chinazzi , Alessandro Vespignani , Yi-An Ma , Rose Yu