English
Related papers

Related papers: Information Aware Max-Norm Dirichlet Networks for …

200 papers

The problem of state estimation for unobservable distribution systems is considered. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning of…

Machine Learning · Statistics 2019-02-26 Kursat Rasim Mestav , Jaime Luengo-Rozas , Lang Tong

Deep neural networks (DNN) are versatile parametric models utilised successfully in a diverse number of tasks and domains. However, they have limitations---particularly from their lack of robustness and over-sensitivity to out of…

Machine Learning · Statistics 2020-01-01 John Mitros , Brian Mac Namee

Uncertainty quantification methods are required in autonomous systems that include deep learning (DL) components to assess the confidence of their estimations. However, to successfully deploy DL components in safety-critical autonomous…

Robotics · Computer Science 2021-11-02 Fabio Arnez , Huascar Espinoza , Ansgar Radermacher , François Terrier

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

When incorporating deep neural networks into robotic systems, a major challenge is the lack of uncertainty measures associated with their output predictions. Methods for uncertainty estimation in the output of deep object detectors (DNNs)…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Ali Harakeh , Michael Smart , Steven L. Waslander

Machine learning in asset pricing typically predicts expected returns as point estimates, ignoring uncertainty. We develop new methods to construct forecast confidence intervals for expected returns obtained from neural networks. We show…

Econometrics · Economics 2025-03-04 Yuan Liao , Xinjie Ma , Andreas Neuhierl , Linda Schilling

Deep Bayesian neural network has aroused a great attention in recent years since it combines the benefits of deep neural network and probability theory. Because of this, the network can make predictions and quantify the uncertainty of the…

Machine Learning · Computer Science 2019-03-25 Yikuan Li , Yajie Zhu

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Current person image retrieval methods have achieved great improvements in accuracy metrics. However, they rarely describe the reliability of the prediction. In this paper, we propose an Uncertainty-Aware Learning (UAL) method to remedy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zhaopeng Dou , Zhongdao Wang , Weihua Chen , Yali Li , Shengjin Wang

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is…

Machine Learning · Statistics 2020-01-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

Artificial Intelligence · Computer Science 2025-03-11 Souradeep Dutta , Michele Caprio , Vivian Lin , Matthew Cleaveland , Kuk Jin Jang , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

Accurate brain tumor segmentation from MRI scans is critical for diagnosis and treatment planning. Despite the strong performance of recent deep learning approaches, two fundamental limitations remain: (1) the lack of reliable uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bahram Mohammadi , Yanqiu Wu , Vu Minh Hieu Phan , Sam White , Minh-Son To , Jian Yang , Michael Sheng , Yang Song , Yuankai Qi

Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpredictable behavior. However,…

Machine Learning · Computer Science 2023-07-13 Jihao Andreas Lin , Joe Watson , Pascal Klink , Jan Peters

In many applications with real-world consequences, it is crucial to develop reliable uncertainty estimation for the predictions made by the AI decision systems. Targeting at the goal of estimating uncertainty, various deep neural network…

Machine Learning · Computer Science 2022-10-13 Huimin Zeng , Zhenrui Yue , Yang Zhang , Ziyi Kou , Lanyu Shang , Dong Wang

To deploy and operate deep neural models in production, the quality of their predictions, which might be contaminated benignly or manipulated maliciously by input distributional deviations, must be monitored and assessed. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Guy Bar-Shalom , Yonatan Geifman , Ran El-Yaniv

Uncertainty estimation is crucial in scientific data for machine learning. Current uncertainty estimation methods mainly focus on the model's inherent uncertainty, while neglecting the explicit modeling of noise in the data. Furthermore,…

Machine Learning · Computer Science 2024-09-13 Guangxuan Song , Dongmei Fu , Zhongwei Qiu , Jintao Meng , Dawei Zhang

Mutual Information (MI) is a crucial measure for capturing dependencies between variables, but exact computation is challenging in high dimensions with intractable likelihoods, impacting accuracy and robustness. One idea is to use an…

Machine Learning · Statistics 2025-03-13 Forough Fazeliasl , Michael Minyi Zhang , Bei Jiang , Linglong Kong

The deep neural network has attained significant efficiency in image recognition. However, it has vulnerable recognition robustness under extensive data uncertainty in practical applications. The uncertainty is attributed to the inevitable…

Machine Learning · Computer Science 2023-08-02 Ruoxi Qin , Linyuan Wang , Xuehui Du , Xingyuan Chen , Bin Yan