English
Related papers

Related papers: Uncertainty Propagation through Trained Deep Neura…

200 papers

We study stochastic dynamical systems in settings where only partial statistical information about the noise is available, e.g., in the form of a limited number of noise realizations. Such systems are particularly challenging to analyze and…

Optimization and Control · Mathematics 2023-04-06 Liviu Aolaritei , Nicolas Lanzetti , Florian Dörfler

Recent research on graph neural networks (GNNs) has explored mechanisms for capturing local uncertainty and exploiting graph hierarchies to mitigate data sparsity and leverage structural properties. However, the synergistic integration of…

Machine Learning · Computer Science 2025-05-06 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Due to the imbalanced nature of networked observational data, the causal effect predictions for some individuals can severely violate the positivity/overlap assumption, rendering unreliable estimations. Nevertheless, this potential risk of…

Machine Learning · Computer Science 2023-09-18 Hechuan Wen , Tong Chen , Li Kheng Chai , Shazia Sadiq , Kai Zheng , Hongzhi Yin

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Deep neural networks are in the limelight of machine learning with their excellent performance in many data-driven applications. However, they can lead to inaccurate predictions when queried in out-of-distribution data points, which can…

Machine Learning · Computer Science 2023-03-01 Yana Stoyanova , Soroush Ghandi , Maryam Tavakol

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

There are increasing demands for understanding deep neural networks' (DNNs) behavior spurred by growing security and/or transparency concerns. Due to multi-layer nonlinearity of the deep neural network architectures, explaining DNN…

Machine Learning · Computer Science 2023-05-16 Xin Li , Deng Pan , Chengyin Li , Yao Qiang , Dongxiao Zhu

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

In many prediction problems, the predictive model affects the distribution of the prediction target. This phenomenon is known as performativity and is often caused by the behavior of individuals with vested interests in the outcome of the…

Machine Learning · Statistics 2024-06-03 Seamus Somerstep , Ya'acov Ritov , Yuekai Sun

Uncertainty can be classified as either aleatoric (intrinsic randomness) or epistemic (imperfect knowledge of parameters). The majority of frameworks assessing infectious disease risk consider only epistemic uncertainty. We only ever…

There are two reasons why uncertainty may not be adequately described by Probability Theory. The first one is due to unique or nearly-unique events, that either never realized or occurred too seldom for frequencies to be reliably measured.…

Artificial Intelligence · Computer Science 2023-03-17 Florian Ellsaesser , Guido Fioretti , Gail E. James

Uncertainty estimation for machine learning models is of high importance in many scenarios such as constructing the confidence intervals for model predictions and detection of out-of-distribution or adversarially generated points. In this…

Machine Learning · Computer Science 2022-05-06 Kirill Fedyanin , Evgenii Tsymbalov , Maxim Panov

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

While deep ensembles are widely considered to be the default method for uncertainty quantification in deep learning, their effectiveness for graph-structured data is often simply assumed based on successes in domains like computer vision.…

Machine Learning · Computer Science 2026-05-22 Pedro C. Vieira , Pedro Ribeiro , Viacheslav Borovitskiy

Technological and computational advances continuously drive forward the broad field of deep learning. In recent years, the derivation of quantities describing theuncertainty in the prediction - which naturally accompanies the modeling…

Machine Learning · Computer Science 2022-05-31 Christoph Koller , Göran Kauermann , Xiao Xiang Zhu

Uncertainty quantification in medical images has become an essential addition to segmentation models for practical application in the real world. Although there are valuable developments in accurate uncertainty quantification methods using…

Image and Video Processing · Electrical Eng. & Systems 2023-05-02 Christiaan G. A. Viviers , Amaan M. M. Valiuddin , Peter H. N. de With , Fons van der Sommen

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

Machine Learning · Computer Science 2023-02-28 Wei Cui , Wei Yu