English
Related papers

Related papers: Switching and Information Exchange in Compressed E…

200 papers

Distributed high dimensional mean estimation is a common aggregation routine used often in distributed optimization methods. Most of these applications call for a communication-constrained setting where vectors, whose mean is to be…

Machine Learning · Statistics 2026-01-28 Harsh Vardhan , Arya Mazumdar

In this paper, we introduce a new, local formulation of the ensemble Kalman Filter approach for atmospheric data assimilation. Our scheme is based on the hypothesis that, when the Earth's surface is divided up into local regions of moderate…

The Ensemble Kalman Filter (EnKF) is a widely used method for data assimilation in high-dimensional systems, with an ensemble update step equivalent to an empirical version of the Matheron update popular in Gaussian process regression -- a…

Machine Learning · Computer Science 2025-09-19 Dan MacKinlay

Compared with linear time invariant systems, linear periodic system can describe the periodic processes arising from nature and engineering more precisely. However, the time-varying system parameters increase the difficulty of the research…

Signal Processing · Electrical Eng. & Systems 2023-03-16 Jiachen Qian , Zhisheng Duan , Peihu Duan , Zhongkui Li

The Kalman filter (KF) provides optimal recursive state estimates for linear-Gaussian systems and underpins applications in control, signal processing, and others. However, it is vulnerable to outliers in the measurements and process noise.…

Systems and Control · Electrical Eng. & Systems 2025-07-02 Alan Yang , Stephen Boyd

We generalize the popular ensemble Kalman filter to an ensemble transform filter where the prior distribution can take the form of a Gaussian mixture or a Gaussian kernel density estimator. The design of the filter is based on a continuous…

Probability · Mathematics 2015-05-27 Sebastian Reich

System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem.…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Matthew F. Singh , Chong Wang , Michael W. Cole , ShiNung Ching

Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems. However, these methods often face a trade-off between analysis accuracy and computational…

Machine Learning · Computer Science 2026-05-26 Zhilin Li , Zhou Yao , Xianglong Li , Zeng Liu , Zhaokuan Lu , Shanlin Xu , Seungnam Kim , Guangyao Wang

This work presents distributed algorithms for estimation of time-varying random fields over multi-agent/sensor networks. A network of sensors makes sparse and noisy local measurements of the dynamic field. Each sensor aims to obtain…

Information Theory · Computer Science 2017-01-11 Subhro Das , José M. F. Moura

In this manuscript we introduce numerical Gaussian process Kalman filtering (GPKF). Numerical Gaussian processes have recently been developed to simulate spatiotemporal models. The contribution of this paper is to embed numerical Gaussian…

Machine Learning · Statistics 2020-05-12 Armin Küper , Steffen Waldherr

Multi-modal densities appear frequently in time series and practical applications. However, they cannot be represented by common state estimators, such as the Extended Kalman Filter (EKF) and the Unscented Kalman Filter (UKF), which…

Systems and Control · Computer Science 2014-01-03 Sanket Kamthe , Jan Peters , Marc P Deisenroth

In this article we present an algorithm to efficiently evaluate the exchange matrix in periodic systems when Gaussian basis set with pseudopotentials are used. The usual algorithm for evaluating exchange matrix scales cubically with the…

Strongly Correlated Electrons · Physics 2022-11-11 Sandeep Sharma , Alec F. White , Gregory Beylkin

In this paper, we establish the connections of the fundamental limitations in feedback communication, estimation, and feedback control over Gaussian channels, from a unifying perspective for information, estimation, and control. The optimal…

Information Theory · Computer Science 2009-10-05 Jialing Liu , Nicola Elia

We propose a new extension of Kalman filtering for continuous-discrete systems with nonlinear state-space models that we name as the level set Kalman filter (LSKF). The LSKF assumes the probability distribution can be approximated as a…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Ningyuan Wang , Daniel B. Forger

Detailed dynamical systems' models used in the life sciences may include hundreds of state variables and many input parameters, often with physical meaning. Therefore, efficient and unique input parameter identification, from experimental…

Quantitative Methods · Quantitative Biology 2023-06-29 Harry Saxton , Xu Xu , Ian Halliday , Torsten Schenkel

The ability of ensemble Kalman filter (EnKF) algorithms to extract information from observations is analyzed with the aid of the concept of the degrees of freedom for signal (DFS). A simple mathematical argument shows that DFS for EnKF is…

Data Analysis, Statistics and Probability · Physics 2021-03-26 Daisuke Hotta , Yoichiro Ota

The paper presents the gossip interactive Kalman filter (GIKF) for distributed Kalman filtering for networked systems and sensor networks, where inter-sensor communication and observations occur at the same time-scale. The communication…

Information Theory · Computer Science 2015-05-18 Soummya Kar , José M. F. Moura

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose…

Machine Learning · Statistics 2024-01-04 Jonathan Schmidt , Philipp Hennig , Jörg Nick , Filip Tronarp

Compression schemes have been extensively used in Federated Learning (FL) to reduce the communication cost of distributed learning. While most approaches rely on a bounded variance assumption of the noise produced by the compressor, this…

Machine Learning · Computer Science 2023-11-01 Mahmoud Hegazy , Rémi Leluc , Cheuk Ting Li , Aymeric Dieuleveut

This paper presents an innovative Reduced-Order Model (ROM) for merging experimental and simulation data using Data Assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our…

Computational Engineering, Finance, and Science · Computer Science 2025-07-03 Paul Jeanney , Ashton Hetherington , Shady E. Ahmed , David Lanceta , Susana Saiz , José Miguel Perez , Soledad Le Clainche