中文
相关论文

相关论文: Learning Expressive Priors for Generalization and …

200 篇论文

Deep Bayesian neural networks (BNNs) are a powerful tool, though computationally demanding, to perform parameter estimation while jointly estimating uncertainty around predictions. BNNs are typically implemented using arbitrary…

机器学习 · 计算机科学 2020-05-12 Daniele Silvestro , Tobias Andermann

Assessing the predictive uncertainty of deep neural networks is crucial for safety-related applications of deep learning. Although Bayesian deep learning offers a principled framework for estimating model uncertainty, the common approaches…

机器学习 · 计算机科学 2024-03-06 Yookoon Park , David M. Blei

Prior probability models are a fundamental component of many image processing problems, but density estimation is notoriously difficult for high-dimensional signals such as photographic images. Deep neural networks have provided…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Zahra Kadkhodaie , Eero P. Simoncelli

Data uncertainty in practical person reID is ubiquitous, hence it requires not only learning the discriminative features, but also modeling the uncertainty based on the input. This paper proposes to learn the sample posterior and the class…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Yan Zhang , Zhilin Zheng , Binyu He , Li Sun

A Bayesian treatment of deep learning allows for the computation of uncertainties associated with the predictions of deep neural networks. We show how the concept of Errors-in-Variables can be used in Bayesian deep regression to also…

机器学习 · 计算机科学 2023-05-15 Jörg Martin , Clemens Elster

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

机器学习 · 计算机科学 2024-08-12 Joaquin Alvarez

Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic…

机器学习 · 计算机科学 2023-12-21 Wang Zhang , Ziwen Ma , Subhro Das , Tsui-Wei Weng , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

机器学习 · 计算机科学 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla

Domain generalization is challenging due to the domain shift and the uncertainty caused by the inaccessibility of target domain data. In this paper, we address both challenges with a probabilistic framework based on variational Bayesian…

机器学习 · 计算机科学 2021-07-16 Zehao Xiao , Jiayi Shen , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Evidential deep learning, built upon belief theory and subjective logic, offers a principled and computationally efficient way to turn a deterministic neural network uncertainty-aware. The resultant evidential models can quantify…

机器学习 · 计算机科学 2023-06-27 Deep Pandey , Qi Yu

The lack of transparency of Deep Neural Networks continues to be a limitation that severely undermines their reliability and usage in high-stakes applications. Promising approaches to overcome such limitations are Prototype-Based…

机器学习 · 计算机科学 2025-07-21 Jon Vadillo , Roberto Santana , Jose A. Lozano , Marta Kwiatkowska

We introduce a new, efficient, principled and backpropagation-compatible algorithm for learning a probability distribution on the weights of a neural network, called Bayes by Backprop. It regularises the weights by minimising a compression…

机器学习 · 统计学 2015-05-22 Charles Blundell , Julien Cornebise , Koray Kavukcuoglu , Daan Wierstra

We describe Bayesian Layers, a module designed for fast experimentation with neural network uncertainty. It extends neural network libraries with drop-in replacements for common layers. This enables composition via a unified abstraction…

机器学习 · 计算机科学 2019-03-07 Dustin Tran , Michael W. Dusenberry , Mark van der Wilk , Danijar Hafner

This article presents the prediction difference analysis method for visualizing the response of a deep neural network to a specific input. When classifying images, the method highlights areas in a given input image that provide evidence for…

计算机视觉与模式识别 · 计算机科学 2017-02-16 Luisa M Zintgraf , Taco S Cohen , Tameem Adel , Max Welling

In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in…

机器学习 · 计算机科学 2024-01-01 Melrose Roderick , Felix Berkenkamp , Fatemeh Sheikholeslami , Zico Kolter

Deep neural networks(NNs) have achieved impressive performance, often exceed human performance on many computer vision tasks. However, one of the most challenging issues that still remains is that NNs are overconfident in their predictions,…

机器学习 · 计算机科学 2019-12-30 Chanwoo Park , Jae Myung Kim , Seok Hyeon Ha , Jungwoo Lee

A simple, flexible approach to creating expressive priors in Gaussian process (GP) models makes new kernels from a combination of basic kernels, e.g. summing a periodic and linear kernel can capture seasonal variation with a long term…

机器学习 · 统计学 2019-07-01 Tim Pearce , Russell Tsuchida , Mohamed Zaki , Alexandra Brintrup , Andy Neely

Robust quantification of predictive uncertainty is critical for understanding factors that drive weather and climate outcomes. Ensembles provide predictive uncertainty estimates and can be decomposed physically, but both physics and machine…

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

机器学习 · 计算机科学 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

Uncertainty quantification of deep neural networks has become an active field of research and plays a crucial role in various downstream tasks such as active learning. Recent advances in evidential deep learning shed light on the direct…

机器学习 · 计算机科学 2023-11-21 Ruxiao Duan , Brian Caffo , Harrison X. Bai , Haris I. Sair , Craig Jones