中文
相关论文

相关论文: An Approximate Bayesian Long Short-Term Memory Alg…

200 篇论文

In this article, we consider the problem of outlier-robust state estimation where the measurement noise can be correlated. Outliers in data arise due to many reasons like sensor malfunctioning, environmental behaviors, communication…

信号处理 · 电气工程与系统科学 2024-08-21 Aamir Hussain Chughtai , Muhammad Tahir , Momin Uppal

This study proposes the first Bayesian approach for learning high-dimensional linear Bayesian networks. The proposed approach iteratively estimates each element of the topological ordering from backward and its parent using the inverse of a…

机器学习 · 统计学 2023-11-28 Seyong Hwang , Kyoungjae Lee , Sunmin Oh , Gunwoong Park

Bayesian neural networks promise calibrated uncertainty but require $O(mn)$ parameters for standard mean-field Gaussian posteriors. We argue this cost is often unnecessary, particularly when weight matrices exhibit fast singular value…

机器学习 · 统计学 2026-05-05 Mame Diarra Toure , David A. Stephens

Anomaly detecting as an important technical in cloud computing is applied to support smooth running of the cloud platform. Traditional detecting methods based on statistic, analysis, etc. lead to the high false-alarm rate due to…

机器学习 · 计算机科学 2019-01-29 Jing Zhang

We present different methods of unsupervised learning which can be used for outlier detection in high energy nuclear collisions. The UrQMD model is used to generate the bulk background of events as well as different variants of outlier…

高能物理 - 实验 · 物理学 2021-05-26 Punnathat Thaprasop , Kai Zhou , Jan Steinheimer , Christoph Herold

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

机器学习 · 计算机科学 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov

It is common practice to combine deep neural networks into ensembles. These deep ensembles can benefit from the cancellation of errors effect: Errors by ensemble members may average out, leading to better generalization performance than…

机器学习 · 计算机科学 2025-01-07 Nick Hauptvogel , Christian Igel

The ensemble Kalman inversion is widely used in practice to estimate unknown parameters from noisy measurement data. Its low computational costs, straightforward implementation, and non-intrusive nature makes the method appealing in various…

数值分析 · 数学 2019-09-04 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

Grouping objects into clusters based on similarities or weights between them is one of the most important problems in science and engineering. In this work, by extending message passing algorithms and spectral algorithms proposed for…

物理与社会 · 物理学 2018-04-04 Cheng Shi , Yanchen Liu , Pan Zhang

Bayesian Neural Networks (BNNs) are trained to optimize an entire distribution over their weights instead of a single set, having significant advantages in terms of, e.g., interpretability, multi-task learning, and calibration. Because of…

机器学习 · 计算机科学 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

We introduce a new, efficient, principled and backpropagation-compatible algorithm for learning a probability distribution on the weights of a neural network, called Bayes by Backprop. It regularises the weights by minimising a compression…

机器学习 · 统计学 2015-05-22 Charles Blundell , Julien Cornebise , Koray Kavukcuoglu , Daan Wierstra

This paper presents a framework for classifying and detecting spatial commission outliers in maritime environments using seabed acoustic sensor networks and log Gaussian Cox processes (LGCPs). By modeling target arrivals as a mixture of…

机器学习 · 计算机科学 2025-08-19 Mingyu Kim , Daniel Stilwell , Jorge Jimenez

Deep neural networks are prone to overconfident predictions on outliers. Bayesian neural networks and deep ensembles have both been shown to mitigate this problem to some extent. In this work, we aim to combine the benefits of the two…

机器学习 · 计算机科学 2021-11-08 Runa Eschenhagen , Erik Daxberger , Philipp Hennig , Agustinus Kristiadi

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

机器学习 · 计算机科学 2023-02-15 Brian Staber , Sébastien Da Veiga

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

机器学习 · 统计学 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

In order to integrate uncertainty estimates into deep time-series modelling, Kalman Filters (KFs) (Kalman et al., 1960) have been integrated with deep learning models, however, such approaches typically rely on approximate inference…

机器学习 · 计算机科学 2019-05-20 Philipp Becker , Harit Pandya , Gregor Gebhardt , Cheng Zhao , James Taylor , Gerhard Neumann

Uncertainty quantification (UQ) to detect samples with large expected errors (outliers) is applied to reactive molecular potential energy surfaces (PESs). Three methods - Ensembles, Deep Evidential Regression (DER), and Gaussian Mixture…

化学物理 · 物理学 2024-02-28 Luis Itza Vazquez-Salazar , Silvan Käser , Markus Meuwly

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

机器学习 · 计算机科学 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

Uncertainty estimation is essential for robust decision-making in the presence of ambiguous or out-of-distribution inputs. Gaussian Processes (GPs) are classical kernel-based models that offer principled uncertainty quantification and…

机器学习 · 统计学 2026-04-30 Albert Saiapin , Kim Batselier