English
Related papers

Related papers: SEF: A Method for Computing Prediction Intervals b…

200 papers

Uncertainty estimation methods using deep learning approaches strive against separating how uncertain the state of the world manifests to us via measurement (objective end) from the way this gets scrambled with the model specification and…

Machine Learning · Statistics 2023-04-21 Edgardo Solano-Carrillo

Parameter-space regularization in neural network optimization is a fundamental tool for improving generalization. However, standard parameter-space regularization methods make it challenging to encode explicit preferences about desired…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Sanyam Kapoor , Shikai Qiu , Andrew Gordon Wilson

The belief function approach to uncertainty quantification as proposed in the Demspter-Shafer theory of evidence is established upon the general mathematical models for set-valued observations, called random sets. Set-valued predictions are…

Machine Learning · Computer Science 2022-06-16 Shireen Kudukkil Manchingal , Fabio Cuzzolin

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Predicting future frames in natural video sequences is a new challenge that is receiving increasing attention in the computer vision community. However, existing models suffer from severe loss of temporal information when the predicted…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Junyan Wang , Bingzhang Hu , Yang Long , Yu Guan

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Ongoing developments in neural network models are continually advancing the state of the art in terms of system accuracy. However, the predicted labels should not be regarded as the only core output; also important is a well-calibrated…

Machine Learning · Statistics 2019-01-08 Gil Keren , Nicholas Cummins , Björn Schuller

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

Machine Learning · Computer Science 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Recurrent neural networks (RNNs) are instrumental in modelling sequential and time-series data. Yet, when using RNNs to inform decision-making, predictions by themselves are not sufficient; we also need estimates of predictive uncertainty.…

Machine Learning · Computer Science 2020-06-30 Ahmed M. Alaa , Mihaela van der Schaar

Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their…

Machine Learning · Computer Science 2023-02-09 Tung Nguyen , Aditya Grover

Ensembling is now recognized as an effective approach for increasing the predictive performance and calibration of deep networks. We introduce a new approach, Parameter Ensembling by Perturbation (PEP), that constructs an ensemble of…

Machine Learning · Computer Science 2020-10-27 Alireza Mehrtash , Purang Abolmaesumi , Polina Golland , Tina Kapur , Demian Wassermann , William M. Wells

Despite the Graph Neural Networks' (GNNs) proficiency in analyzing graph data, achieving high-accuracy and interpretable predictions remains challenging. Existing GNN interpreters typically provide post-hoc explanations disjointed from…

Machine Learning · Computer Science 2024-07-26 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Trustworthiness in neural networks is crucial for their deployment in critical applications, where reliability, confidence, and uncertainty play pivotal roles in decision-making. Traditional performance metrics such as accuracy and…

Machine Learning · Computer Science 2025-09-05 Koffi Ismael Ouattara , Ioannis Krontiris , Theo Dimitrakos , Frank Kargl

Understanding model performance on unlabeled data is a fundamental challenge of developing, deploying, and maintaining AI systems. Model performance is typically evaluated using test sets or periodic manual quality assessments, both of…

Machine Learning · Computer Science 2020-12-17 Benjamin Elder , Matthew Arnold , Anupama Murthi , Jiri Navratil

Recently, there has been an increased interest in NeRF methods which reconstruct differentiable representation of three-dimensional scenes. One of the main limitations of such methods is their inability to assess the confidence of the model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Vsevolod Skorokhodov , Darya Drozdova , Dmitry Yudin

Probabilistic electricity price forecasting (PEPF) is subject of increasing interest, following the demand for proper quantification of prediction uncertainty, to support the operation in complex power markets with increasing share of…

Machine Learning · Computer Science 2024-06-11 Alessandro Brusaferri , Andrea Ballarino , Luigi Grossi , Fabrizio Laurini

Physics-informed neural networks (PINNs) constitute a flexible deep learning approach for solving partial differential equations (PDEs), which model phenomena ranging from heat conduction to quantum mechanical systems. Despite their…

Machine Learning · Computer Science 2026-03-17 Aleksander Krasowski , René P. Klausen , Aycan Celik , Sebastian Lapuschkin , Wojciech Samek , Jonas Naujoks

Unrolled computation graphs arise in many scenarios, including training RNNs, tuning hyperparameters through unrolled optimization, and training learned optimizers. Current approaches to optimizing parameters in such computation graphs…

Machine Learning · Computer Science 2021-12-28 Paul Vicol , Luke Metz , Jascha Sohl-Dickstein

Deep neural networks (DNNs) have been widely applied in various domains in artificial intelligence including computer vision and natural language processing. A DNN is typically trained for many epochs and then a validation dataset is used…

Machine Learning · Computer Science 2022-03-17 Xiang Deng , Yun Xiao , Bo Long , Zhongfei Zhang