English
Related papers

Related papers: Ensemble Kalman Sampler: mean-field limit and conv…

200 papers

We propose a unified mixture sampler (UMS) that provides a universal estimation framework for nonlinear state-space models with "exp-exp" likelihood kernels. Unlike existing methods that require deriving new mixture approximations for each…

Methodology · Statistics 2026-04-07 Daichi Hiraki , Yasuhiro Omori

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

In this paper, we consider a mixed ensemble containing a mixture of cesium-type and hydrogen maser-type atomic clocks. For the mixed ensemble, the conventional Kalman filtering algorithm has certain limitations due to divergence of the…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Priyanka Dey , Takahiro Kawaguchi , Yuichiro Yano , Yuko Hanado , Takayuki Ishizaki

Stochastic hybrid systems combine continuous-time stochastic dynamics with discrete reset events, producing intrinsically non-Gaussian and often multimodal uncertainty. A consistent propagation law must also account for boundary-induced…

Systems and Control · Electrical Eng. & Systems 2026-05-21 Kaito Iwasaki , Tejaswi K. C. , Anthony Bloch , Maani Ghaffari , Taeyoung Lee

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

Global information about dynamical systems can be extracted by analysing associated infinite-dimensional transfer operators, such as Perron-Frobenius and Koopman operators as well as their infinitesimal generators. In practice, these…

Numerical Analysis · Mathematics 2024-06-21 Liam Llamazares-Elias , Samir Llamazares-Elias , Jonas Latz , Stefan Klus

To deal with very large datasets a mini-batch version of the Monte Carlo Markov Chain Stochastic Approximation Expectation-Maximization algorithm for general latent variable models is proposed. For exponential models the algorithm is shown…

Computation · Statistics 2023-08-30 Tabea Rebafka , Estelle Kuhn , Catherine Matias

In this work, we study the convergence of the empirical measure of moderately interacting particle systems with singular interaction kernels. First, we prove quantitative convergence of the time marginals of the empirical measure of…

Probability · Mathematics 2021-12-22 Christian Olivera , Alexandre Richard , Milica Tomasevic

This work studies how to estimate the mean-field density of large-scale systems in a distributed manner. Such problems are motivated by the recent swarm control technique that uses mean-field approximations to represent the collective…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Tongjia Zheng , Qing Han , Hai Lin

We demonstrate that the extended Kalman filter converges locally for a broad class of nonlinear systems. If the initial estimation error of the filter is not too large then the error goes to zero exponentially as time goes to infinity. To…

Optimization and Control · Mathematics 2007-05-23 Arthur J. Krener

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

This paper studies the problem of estimating the means $\pm\theta_{*}\in\mathbb{R}^{d}$ of a symmetric two-component Gaussian mixture $\delta_{*}\cdot N(\theta_{*},I)+(1-\delta_{*})\cdot N(-\theta_{*},I)$ where the weights $\delta_{*}$ and…

Statistics Theory · Mathematics 2021-03-30 Nir Weinberger , Guy Bresler

We present a novel algorithm based on the ensemble Kalman filter to solve inverse problems involving multiscale elliptic partial differential equations. Our method is based on numerical homogenization and finite element discretization and…

Numerical Analysis · Mathematics 2020-12-16 Assyr Abdulle , Giacomo Garegnani , Andrea Zanoni

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

Existing extremum-seeking control (ESC) approaches typically rely on applying repeated perturbations to input parameters and performing measurements of the corresponding performance output. The required separation between the different…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Wouter Weekers , Alessandro Saccon , Nathan van de Wouw

Gaussian mixture models (GMMs) are fundamental statistical tools for modeling heterogeneous data. Due to the nonconcavity of the likelihood function, the Expectation-Maximization (EM) algorithm is widely used for parameter estimation of…

Statistics Theory · Mathematics 2025-11-10 Xin Bing , Dehan Kong , Bingqing Li

Consider the class of Ensemble Square Root filtering algorithms for the numerical approximation of the posterior distribution of nonlinear Markovian signals partially observed with linear observations corrupted with independent measurement…

Probability · Mathematics 2021-02-01 Theresa Lange , Wilhelm Stannat

This work proposes a novel Alternating Direction Method of Multipliers (ADMM)-based Ensemble Kalman Inversion (EKI) algorithm for solving constrained nonlinear model predictive control (NMPC) problems. First, stage-wise nonlinear inequality…

Optimization and Control · Mathematics 2026-03-26 Ahmed Khalil , Mohamed Safwat , Efstathios Bakolas

This paper concerns the nonparametric estimation problem of the distribution-state dependent drift vector field in an interacting $N$-particle system. Observing single-trajectory data for each particle, we derive the mean-field rate of…

Statistics Theory · Mathematics 2022-06-28 Rentian Yao , Xiaohui Chen , Yun Yang

In this paper, we address the distributed filtering and prediction of time-varying random fields represented by linear time-invariant (LTI) dynamical systems. The field is observed by a sparsely connected network of agents/sensors…

Information Theory · Computer Science 2016-10-14 Subhro Das , José M. F. Moura