English
Related papers

Related papers: Ensemble Transport Filter via Optimized Maximum Me…

200 papers

We propose a simple subsampling scheme for fast randomized approximate computation of optimal transport distances. This scheme operates on a random subset of the full data and can use any exact algorithm as a black-box back-end, including…

Computation · Statistics 2020-12-17 Max Sommerfeld , Jörn Schrieber , Yoav Zemel , Axel Munk

Particle filtering (PF) is an often used method to estimate the states of dynamical systems. A major limitation of the standard PF method is that the dimensionality of the state space increases as the time proceeds and eventually may cause…

Computation · Statistics 2019-08-30 Linjie Wen , Jiangqi Wu , Linjun Lu , Jinglai Li

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from low robustness against…

Computation and Language · Computer Science 2025-04-22 Behzad Shayegh , Hobie H. -B. Lee , Xiaodan Zhu , Jackie Chi Kit Cheung , Lili Mou

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang

Multi-task learning has gained popularity due to the advantages it provides with respect to resource usage and performance. Nonetheless, the joint optimization of parameters with respect to multiple tasks remains an active research topic.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Lucas Pascal , Pietro Michiardi , Xavier Bost , Benoit Huet , Maria A. Zuluaga

We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method…

Machine Learning · Computer Science 2018-10-30 Nhat Ho , Viet Huynh , Dinh Phung , Michael I. Jordan

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

This paper uses a probabilistic approach to analyze the converge of an ensemble Kalman filter solution to an exact Kalman filter solution in the simplest possible setting, the scalar case, as it allows us to build upon a rich literature of…

Optimization and Control · Mathematics 2020-03-31 Andrey A Popov , Adrian Sandu

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear…

Methodology · Statistics 2021-03-15 Gregor Robinson , Ian Grooms

We investigate the application of ensemble transform approaches to Bayesian inference of logistic regression problems. Our approach relies on appropriate extensions of the popular ensemble Kalman filter and the feedback particle filter to…

Numerical Analysis · Mathematics 2021-09-27 Jakiw Pidstrigach , Sebastian Reich

Conventional approximations to Bayesian inference rely on either approximations by statistics such as mean and covariance or by point particles. Recent advances such as the ensemble Gaussian mixture filter have generalized these notions to…

Optimization and Control · Mathematics 2025-04-10 Andrey A Popov

The problem of incorporating information from observations received serially in time is widespread in the field of uncertainty quantification. Within a probabilistic framework, such problems can be addressed using standard filtering…

Methodology · Statistics 2024-12-02 Chatchuea Kimchaiwong , Jeremie Houssineau , Adam M. Johansen

Mutual learning, in which multiple networks learn by sharing their knowledge, improves the performance of each network. However, the performance of ensembles of networks that have undergone mutual learning does not improve significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Naoki Okamoto , Soma Minami , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

We show that modifying a Bayesian data assimilation scheme by incorporating kinematically-consistent displacement corrections produces a scheme that is demonstrably better at estimating partially observed state vectors in a setting where…

Data Analysis, Statistics and Probability · Physics 2016-12-06 W. Steven Rosenthal , Shankar C. Venkataramani , Arthur J. Mariano , Juan M. Restrepo

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

Diffusion Models (DMs) have achieved remarkable progress in generative modeling. However, the mismatch between the forward terminal distribution and reverse initial distribution introduces prior error, leading to deviations of sampling…

Machine Learning · Computer Science 2026-02-06 Zhanpeng Wang , Shenghao Li , Jiameng Che , Chen Wang , Shangling Jui , Na Lei , Zhongxuan Luo

Kalman filters constitute a scalable and robust methodology for approximate Bayesian inference, matching first and second order moments of the target posterior. To improve the accuracy in nonlinear and non-Gaussian settings, we extend this…

Statistics Theory · Mathematics 2024-09-04 L. Wang , N. Nüsken

In the process of reproducing the state dynamics of parameter dependent distributed systems, data from physical measurements can be incorporated into the mathematical model to reduce the parameter uncertainty and, consequently, improve the…

Numerical Analysis · Mathematics 2022-10-06 Francesco A. B. Silva , Cecilia Pagliantini , Martin Grepl , Karen Veroy