English
Related papers

Related papers: Ensemble Transport Filter via Optimized Maximum Me…

200 papers

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

We propose the application of iterative regularization for the development of ensemble methods for solving Bayesian inverse problems. In concrete, we construct (i) a variational iterative regularizing ensemble Levenberg-Marquardt method…

Numerical Analysis · Mathematics 2014-06-25 Marco A. Iglesias

Diversity plays a crucial role in evolutionary computation. While diversity has been mainly used to prevent the population of an evolutionary algorithm from premature convergence, the use of evolutionary algorithms to obtain a diverse set…

Neural and Evolutionary Computing · Computer Science 2018-02-16 Aneta Neumann , Wanru Gao , Carola Doerr , Frank Neumann , Markus Wagner

We study Sinkhorn EM (sEM), a variant of the expectation maximization (EM) algorithm for mixtures based on entropic optimal transport. sEM differs from the classic EM algorithm in the way responsibilities are computed during the expectation…

Machine Learning · Statistics 2020-07-01 Gonzalo Mena , Amin Nejatbakhsh , Erdem Varol , Jonathan Niles-Weed

This paper proposes an efficient implementation of the Poisson multi-Bernoulli mixture (PMBM) trajectory filter. The proposed implementation performs track-oriented N-scan pruning to limit complexity, and uses dual decomposition to solve…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Yuxuan Xia , Karl Granström , Lennart Svensson , Ángel F. García-Fernández

The Ensemble Kalman Filter method can be used as an iterative numerical scheme for parameter identification or nonlinear filtering problems. We study the limit of infinitely large ensemble size and derive the corresponding mean-field limit…

Numerical Analysis · Mathematics 2019-03-20 Michael Herty , Giuseppe Visconti

Practical data assimilation algorithms often contain hyper-parameters, which may arise due to, for instance, the use of certain auxiliary techniques like covariance inflation and localization in an ensemble Kalman filter, the…

Computation · Statistics 2022-06-08 Xiaodong Luo , Chuan-An Xia

In recent years there has been a growing interest in developing "streaming algorithms" for efficient processing and querying of continuous data streams. These algorithms seek to provide accurate results while minimizing the required storage…

Data Structures and Algorithms · Computer Science 2016-06-06 Reuven Cohen , Liran Katzir , Aviv Yehezkel

We consider the optimization problem of minimizing a functional defined over a family of probability distributions, where the objective functional is assumed to possess a variational form. Such a distributional optimization problem arises…

Machine Learning · Computer Science 2024-04-02 Zhuoran Yang , Yufeng Zhang , Yongxin Chen , Zhaoran Wang

A new ensemble filter that allows for the uncertainty in the prior distribution is proposed and tested. The filter relies on the conditional Gaussian distribution of the state given the model-error and predictability-error covariance…

Data Analysis, Statistics and Probability · Physics 2016-12-19 Michael Tsyrulnikov , Alexander Rakitko

The chaotic nature of fluid flow and the uncertainties in initial conditions limit predictability. Small errors that occur in the initial condition can grow exponentially until they saturate at $\mathcal{O}$(1). Ensemble forecasting…

Numerical Analysis · Mathematics 2024-07-16 Rui Fang

Data assimilation algorithms are used to estimate the states of a dynamical system using partial and noisy observations. The ensemble Kalman filter has become a popular data assimilation scheme due to its simplicity and robustness for a…

Numerical Analysis · Mathematics 2021-06-23 Gottfried Hastermann , Maria Reinhardt , Rupert Klein , Sebastian Reich

Estimating conditional average treatment effect from observational data is highly challenging due to the existence of treatment selection bias. Prevalent methods mitigate this issue by aligning distributions of different treatment groups in…

Machine Learning · Computer Science 2025-05-07 Hao Wang , Zhichao Chen , Jiajun Fan , Haoxuan Li , Tianqiao Liu , Weiming Liu , Quanyu Dai , Yichao Wang , Zhenhua Dong , Ruiming Tang

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Data assimilation combines dynamical models with observations to improve state estimates. Ensemble filters sequentially assimilate observations by updating a set of samples over time, alternating between a forecast and an analysis step.…

Computation · Statistics 2026-05-26 Mathieu Le Provost , Jan Glaubitz , Youssef Marzouk

Filtering - the task of estimating the conditional distribution for states of a dynamical system given partial and noisy observations - is important in many areas of science and engineering, including weather and climate prediction.…

Machine Learning · Computer Science 2025-03-25 Eviatar Bach , Ricardo Baptista , Enoch Luk , Andrew Stuart

This article shows that increasing the observation variance at small scales can reduce the ensemble size required to avoid collapse in particle filtering of spatially-extended dynamics and improve the resulting uncertainty quantification at…

Applications · Statistics 2018-08-15 Gregor Robinson , Ian Grooms , William Kleiber

This paper introduces a novel distributed optimization technique for networked systems, which removes the dependency on specific parameter choices, notably the learning rate. Traditional parameter selection strategies in distributed…

Optimization and Control · Mathematics 2024-04-23 Rodrigo Aldana-López , Alessandro Macchelli , Giuseppe Notarstefano , Rosario Aragüés , Carlos Sagüés

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Ensemble learning has been widely recognized as a pivotal technique for boosting predictive performance by combining multiple base models. Nevertheless, conventional margin-based ensemble methods predominantly focus on maximizing the…

Machine Learning · Computer Science 2025-09-15 Zexu Jin