English
Related papers

Related papers: Ensemble Kalman Inversion for Sparse Learning of D…

200 papers

Ensemble Kalman inversion (EKI) is a sequential Monte Carlo method used to solve inverse problems within a Bayesian framework. Unlike backpropagation, EKI is a gradient-free optimization method that only necessitates the evaluation of…

Machine Learning · Computer Science 2023-07-18 Lucas Böttcher

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang

Sparse regression has emerged as a popular technique for learning dynamical systems from temporal data, beginning with the SINDy (Sparse Identification of Nonlinear Dynamics) framework proposed by arXiv:1509.03580. Quantifying the…

Methodology · Statistics 2023-08-21 Sara Venkatraman , Sumanta Basu , Martin T. Wells

In stochastic systems, informative approaches select key measurement or decision variables that maximize information gain to enhance the efficacy of model-related inferences. Neural Learning also embodies stochastic dynamics, but…

Machine Learning · Computer Science 2020-08-25 Margaret Trautner , Gabriel Margolis , Sai Ravela

The ensemble Kalman inversion (EKI) is a particle based method which has been introduced as the application of the ensemble Kalman filter to inverse problems. In practice it has been widely used as derivative-free optimization method in…

Numerical Analysis · Mathematics 2022-09-21 Simon Weissmann

Solving inverse problems without the use of derivatives or adjoints of the forward model is highly desirable in many applications arising in science and engineering. In this paper, we propose a new version of such a methodology, a framework…

Dynamical Systems · Mathematics 2019-10-17 Alfredo Garbuno-Inigo , Franca Hoffmann , Wuchen Li , Andrew M. Stuart

Finding the governing equations from data by sparse optimization has become a popular approach to deterministic modeling of dynamical systems. Considering the physical situations where the data can be imperfect due to disturbances and…

Chaotic Dynamics · Physics 2025-09-05 Zheng-Meng Zhai , Valerio Lucarini , Ying-Cheng Lai

Equation discovery is a fundamental learning task for uncovering the underlying dynamics of complex systems, with wide-ranging applications in areas such as brain connectivity analysis, climate modeling, gene regulation, and physical…

Machine Learning · Computer Science 2026-01-29 Jiaqiang Li , Jianbin Tan , Xueqin Wang

We describe a stochastic, dynamical system capable of inference and learning in a probabilistic latent variable model. The most challenging problem in such models - sampling the posterior distribution over latent variables - is proposed to…

Machine Learning · Statistics 2022-07-26 Michael Y. -S. Fang , Mayur Mudigonda , Ryan Zarcone , Amir Khosrowshahi , Bruno A. Olshausen

Ensemble Kalman Inversion (EKI) has been a very popular algorithm used in Bayesian inverse problems. It samples particles from a prior distribution, and introduces a motion to move the particles around in pseudo-time. As the pseudo-time…

Numerical Analysis · Mathematics 2025-03-07 Zhiyan Ding , Qin Li

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

Numerical Analysis · Mathematics 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

The ensemble Kalman filter is a well-known and celebrated data assimilation algorithm. It is of particular relevance as it used for high-dimensional problems, by updating an ensemble of particles through a sample mean and covariance…

Numerical Analysis · Mathematics 2022-07-27 Neil K. Chada

In recent years, operator learning, particularly the DeepONet, has received much attention for efficiently learning complex mappings between input and output functions across diverse fields. However, in practical scenarios with limited and…

Machine Learning · Computer Science 2024-03-07 Andrew Pensoneault , Xueyu Zhu

The ensemble Kalman inversion (EKI), as a derivative-free methodology, has been widely used in the parameter estimation of inverse problems. Unfortunately, its cost may become moderately large for systems described by high dimensional…

Numerical Analysis · Mathematics 2018-09-25 Liang Yan , Tao Zhou

We propose a sparse regression method capable of discovering the governing partial differential equation(s) of a given system by time series measurements in the spatial domain. The regression framework relies on sparsity promoting…

Pattern Formation and Solitons · Physics 2016-09-22 Samuel H. Rudy , Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

Several variations of the Kalman filter algorithm, such as the extended Kalman filter (EKF) and the unscented Kalman filter (UKF), are widely used in science and engineering applications. In this paper, we introduce two algorithms of…

Optimization and Control · Mathematics 2018-10-11 Wei Kang , Liang Xu

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Learning governing equations from data is central to understanding the behavior of physical systems across diverse scientific disciplines, including physics, biology, and engineering. The Sindy algorithm has proven effective in leveraging…

Machine Learning · Computer Science 2025-11-17 Gianluigi Pillonetto , Akram Yazdani , Aleksandr Aravkin

The discovery of partial differential equations (PDEs) is a challenging task that involves both theoretical and empirical methods. Machine learning approaches have been developed and used to solve this problem; however, it is important to…

Machine Learning · Statistics 2023-06-09 Kalpesh More , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

Ensemble Kalman inversion is a parallelizable derivative-free method to solve inverse problems. The method uses an ensemble that follows the Kalman update formula iteratively to solve an optimization problem. The ensemble size is crucial to…

Numerical Analysis · Mathematics 2021-05-25 Yoonsang Lee