English
Related papers

Related papers: Ensemble Kalman filter for uncertainty in human la…

200 papers

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties…

Numerical Analysis · Mathematics 2019-10-15 Neil K. Chada , Claudia Schillings , Simon Weissmann

The ensemble Kalman filter (EnKF) is widely used for data assimilation in high-dimensional systems, but its performance often deteriorates for strongly nonlinear dynamics due to the structural mismatch between the Kalman update and the…

Machine Learning · Computer Science 2026-04-30 Xin T. Tong , Yanyan Wang , Liang Yan

Recommending items to users has long been a fundamental task, and studies have tried to improve it ever since. Most well-known models commonly employ representation learning to map users and items into a unified embedding space for matching…

Information Retrieval · Computer Science 2025-04-16 Radin Cheraghi , Amir Mohammad Mahfoozi , Sepehr Zolfaghari , Mohammadshayan Shabani , Maryam Ramezani , Hamid R. Rabiee

Data assimilation is concerned with sequentially estimating a temporally-evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and…

Machine Learning · Statistics 2021-07-21 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

A new ensemble filter that allows for the uncertainty in the prior distribution is proposed and tested. The filter relies on the conditional Gaussian distribution of the state given the model-error and predictability-error covariance…

Data Analysis, Statistics and Probability · Physics 2016-12-19 Michael Tsyrulnikov , Alexander Rakitko

Data assimilation (DA) for compressible flows with shocks is challenging because many classical DA methods generate spurious oscillations and nonphysical features near uncertain shocks. We focus here on the ensemble Kalman filter (EnKF). We…

Graph Neural Networks (GNN) provide a powerful framework that elegantly integrates Graph theory with Machine learning for modeling and analysis of networked data. We consider the problem of quantifying the uncertainty in predictions of GNN…

Machine Learning · Computer Science 2022-05-23 Sai Munikoti , Deepesh Agarwal , Laya Das , Balasubramaniam Natarajan

Both uncertainty estimation and interpretability are important factors for trustworthy machine learning systems. However, there is little work at the intersection of these two areas. We address this gap by proposing a novel method for…

Machine Learning · Statistics 2021-03-19 Javier Antorán , Umang Bhatt , Tameem Adel , Adrian Weller , José Miguel Hernández-Lobato

In this paper, the ensemble consider Kalman filter is proposed to mitigate the negative effects of uncertain parameters in nonlinear dynamic and measurement models. The ensemble Kalman filter can avoid using the Jacobian matrices and reduce…

Systems and Control · Electrical Eng. & Systems 2019-06-18 Tai-shan Lou , Nan-hua Chen , Hua Xiong , Ya-xi Li , Lei Wang

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…

Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods…

Machine Learning · Computer Science 2018-09-18 Jessica S. Titensky , Hayden Jananthan , Jeremy Kepner

We propose a generalised framework for the updating of a prior ensemble to a posterior ensemble, an essential yet challenging part in ensemble-based filtering methods. The proposed framework is based on a generalised and fully Bayesian view…

Methodology · Statistics 2021-03-29 Margrethe Kvale Loe , Håkon Tjelmeland

Climate change poses significant challenges for accurate climate modeling due to the complexity and variability of non-Gaussian climate systems. To address the complexities of non-Gaussian systems in climate modeling, this thesis proposes a…

Applications · Statistics 2024-06-28 Yunjin Tong

As a sequence-to-sequence generation task, neural machine translation (NMT) naturally contains intrinsic uncertainty, where a single sentence in one language has multiple valid counterparts in the other. However, the dominant methods for…

Computation and Language · Computer Science 2020-10-12 Xiangpeng Wei , Heng Yu , Yue Hu , Rongxiang Weng , Luxi Xing , Weihua Luo

We analyze the Ensemble and Polynomial Chaos Kalman filters applied to nonlinear stationary Bayesian inverse problems. In a sequential data assimilation setting such stationary problems arise in each step of either filter. We give a new…

Numerical Analysis · Mathematics 2015-04-15 Oliver G. Ernst , Björn Sprungk , Hans-Jörg Starkloff

An Ensemble Kalman Filter (EnKF, the predictor) is used make a large change in the state, followed by a Particle Filer (PF, the corrector) which assigns importance weights to describe non-Gaussian distribution. The weights are obtained by…

Computation · Statistics 2009-07-20 Jan Mandel , Jonathan D. Beezley

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

State-of-the-art neural network language models (NNLMs) represented by long short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming highly complex. They are prone to overfitting and poor generalization when…

Computation and Language · Computer Science 2022-08-30 Boyang Xue , Shoukang Hu , Junhao Xu , Mengzhe Geng , Xunying Liu , Helen Meng

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally…

Methodology · Statistics 2018-08-17 Weixuan Li , W. Steven Rosenthal , Guang Lin