English
Related papers

Related papers: Analytic MMSE Bounds in Linear Dynamic Systems wit…

200 papers

This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE)…

Information Theory · Computer Science 2007-07-13 Dongning Guo , Shlomo Shamai , Sergio Verdu

State estimation of dynamical systems is crucial for providing new decision-making and system automation information in different applications. However, the assumptions on the standard computational models for sensor measurements can be…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Aamir Hussain Chughtai , Arslan Majal , Muhammad Tahir , Momin Uppal

We present a new strategy for filtering high-dimensional multiscale systems characterized by high-order non-Gaussian statistics using observations from leading-order moments. A closed stochastic-statistical modeling framework suitable for…

Mathematical Physics · Physics 2024-07-09 Di Qi , Jian-Guo Liu

This paper develops a new filtering approach for state estimation in polynomial systems corrupted by arbitrary noise, which commonly arise in robotics. We first consider a batch setup where we perform state estimation using all data…

Robotics · Computer Science 2024-03-11 Sangli Teng , Harry Zhang , David Jin , Ashkan Jasour , Maani Ghaffari , Luca Carlone

Tight bounds on the minimum mean square error for the additive Gaussian noise channel are derived, when the input distribution is constrained to be epsilon-close to a Gaussian reference distribution in terms of the Kullback--Leibler…

Statistics Theory · Mathematics 2018-04-27 Michael Fauss , Alex Dytso , Abdelhak M. Zoubir , H. Vincent Poor

The problem of state tracking with active observation control is considered for a system modeled by a discrete-time, finite-state Markov chain observed through conditionally Gaussian measurement vectors. The measurement model statistics are…

Systems and Control · Computer Science 2015-06-18 Daphney-Stavroula Zois , Marco Levorato , Urbashi Mitra

We address the problem of observation noise misspecification in Bayesian filtering of dynamical systems via recent advances in generalised Bayesian inference. Mis-match in tail decay between the true data generating process and an assumed…

Statistics Theory · Mathematics 2026-05-27 Hans Reimann , Sebastian Reich

An abstraction for multisensor communication termed the Gaussian Multiplex Channel is presented and analyzed. In this model, the sensor outputs can be added together in any combination through a network of switches, and the combinations can…

Signal Processing · Electrical Eng. & Systems 2024-12-20 Daniel R. Fuhrmann , Muhammad Fahad

Most Kalman filter extensions assume Gaussian noise and when the noise is non-Gaussian, usually other types of filters are used. These filters, such as particle filter variants, are computationally more demanding than Kalman type filters.…

Applications · Statistics 2021-05-19 Matti Raitoharju , Henri Nurminen , Demet Cilden-Guler , Simo Särkkä

In this work, we investigate Gaussian Mixture Models ({\it abbrv} GMM) and the related problem of non parametric maximum likelihood estimation ({\it abbrv} NPMLE) from the perspective of statistical mechanics. In particular, we establish…

Statistics Theory · Mathematics 2026-03-25 Subhroshekhar Ghosh , Adityanand Guntuboyina , Satyaki Mukherjee , Hoang-Son Tran

A generalized state space representation of dynamical systems with random modes switching according to a white random process is presented. The new formulation includes a term, in the dynamics equation, that depends on the most recent…

Information Theory · Computer Science 2016-05-03 Daniel Sigalov , Tomer Michaeli , Yaakov Oshman

In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more…

Information Theory · Computer Science 2016-11-17 Neri Merhav

In this paper, we consider a dynamic linear system in state-space form where the observation equation depends linearly on a set of parameters. We address the problem of how to dynamically calculate these parameters in order to minimize the…

Information Theory · Computer Science 2013-04-02 Feng Jiang , Jie Chen , A. Lee Swindlehurst

Traditional Kalman filter (KF) is derived under the well-known minimum mean square error (MMSE) criterion, which is optimal under Gaussian assumption. However, when the signals are non-Gaussian, especially when the system is disturbed by…

Machine Learning · Statistics 2015-09-16 Badong Chen , Xi Liu , Haiquan Zhao , José C. Príncipe

This paper considers state estimation for general nonlinear discrete-time systems subject to measurement noise and possibly unbounded unknown inputs. To approach this problem, we first propose the concept of strong nonlinear detectability.…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yang Guo , Jaime A. Moreno , Stefan Streif

Disturbance observers have been attracting continuing research efforts and are widely used in many applications. Among them, the Kalman filter-based disturbance observer is an attractive one since it estimates both the state and the…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Shilei Li , Dawei Shi , Yunjiang Lou , Wulin Zou , Ling Shi

We develop a general framework for state estimation in systems modeled with noise-polluted continuous time dynamics and discrete time noisy measurements. Our approach is based on maximum likelihood estimation and employs the calculus of…

Optimization and Control · Mathematics 2026-01-16 Griffin M. Kearney , Makan Fardad

Satellite dynamics and tracking remain important challenges in the context of space exploration and communication systems. Accurate state estimation is essential to maintain reliable orbital motion and system performance. This paper…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Moh Kamalul Wafi

Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders stationary classifiers…

Machine Learning · Computer Science 2025-08-25 Shuilian Xie , Mahdi Imani , Edward R. Dougherty , Ulisses M. Braga-Neto

State estimation in the presence of uncertain or data-driven noise distributions remains a critical challenge in control and robotics. Although the Kalman filter is the most popular choice, its performance degrades significantly when…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Minhyuk Jang , Astghik Hakobyan , Insoon Yang