English
Related papers

Related papers: Uncertainty Quantification with Bayesian Higher Or…

200 papers

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

Artificial Intelligence · Computer Science 2025-03-11 Souradeep Dutta , Michele Caprio , Vivian Lin , Matthew Cleaveland , Kuk Jin Jang , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

This paper introduces a novel approach to uncertainty quantification for radiance fields by leveraging higher-order moments of the rendering equation. Uncertainty quantification is crucial for downstream tasks including view planning and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Parker Ewen , Hao Chen , Seth Isaacson , Joey Wilson , Katherine A. Skinner , Ram Vasudevan

Several multiscale methods account for sub-grid scale features using coarse scale basis functions. For example, in the Multiscale Finite Volume method the coarse scale basis functions are obtained by solving a set of local problems over…

Machine Learning · Computer Science 2017-11-15 Shing Chan , Ahmed H. Elsheikh

Accurately detecting crack boundaries is crucial for reliability assessment and risk management of structures and materials, such as structural health monitoring, diagnostics, prognostics, and maintenance scheduling. Uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Rahul Rathnakumar , Yutian Pang , Yongming Liu

In system analysis and design optimization, multiple computational models are typically available to represent a given physical system. These models can be broadly classified as high-fidelity models, which provide highly accurate…

Machine Learning · Computer Science 2024-11-01 Ruda Zhang , Negin Alemazkoor

Retrieval augmented Question Answering (QA) helps QA models overcome knowledge gaps by incorporating retrieved evidence, typically a set of passages, alongside the question at test time. Previous studies show that this approach improves QA…

Computation and Language · Computer Science 2025-09-12 Laura Perez-Beltrachini , Mirella Lapata

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Bayesian neural networks (BNN) promise to combine the predictive performance of neural networks with principled uncertainty modeling important for safety-critical systems and decision making. However, posterior uncertainty estimates depend…

Machine Learning · Computer Science 2025-06-06 Tristan Cinquin , Robert Bamler

Predictions made by deep learning models are prone to data perturbations, adversarial attacks, and out-of-distribution inputs. To build a trusted AI system, it is therefore critical to accurately quantify the prediction uncertainties. While…

Machine Learning · Computer Science 2023-04-12 Hanjing Wang , Dhiraj Joshi , Shiqiang Wang , Qiang Ji

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

Machine Learning · Computer Science 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Bayesian modelling allows for the quantification of predictive uncertainty which is crucial in safety-critical applications. Yet for many machine learning (ML) algorithms, it is difficult to construct or implement their Bayesian…

Machine Learning · Statistics 2024-10-22 Ziyu Wang , Chris Holmes

Kolmogorov-Arnold Network (KAN) has attracted growing interest for its strong function approximation capability. In our previous work, KAN and its variants were explored in score regression for blind image quality assessment (BIQA).…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Ze Chen , Shaode Yu

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

This paper presents a nonparametric statistical modeling method for quantifying uncertainty in stochastic gradient systems with isotropic diffusion. The central idea is to apply the diffusion maps algorithm to a training data set to produce…

Dynamical Systems · Mathematics 2015-02-10 Tyrus Berry , John Harlim

While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly understood. We study the quality of common variational…

Machine Learning · Statistics 2020-10-26 Andrew Y. K. Foong , David R. Burt , Yingzhen Li , Richard E. Turner

We propose a novel approach that enhances multivariate function approximation using learnable path signatures and Kolmogorov-Arnold networks (KANs). We enhance the learning capabilities of these networks by weighting the values obtained by…

Machine Learning · Computer Science 2024-12-10 Hugo Inzirillo , Remi Genet

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

Computation and Language · Computer Science 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Over the past few years, Large Language Models (LLMs) have developed rapidly and are widely applied in various domains. However, LLMs face the issue of hallucinations, generating responses that may be unreliable when the models lack…

Computation and Language · Computer Science 2025-05-12 Huan Ma , Jingdong Chen , Joey Tianyi Zhou , Guangyu Wang , Changqing Zhang

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig