English
Related papers

Related papers: Derivation of Mutual Information and Linear Minimu…

200 papers

The increasing availability of geometric data has motivated the need for information processing over non-Euclidean domains modeled as manifolds. The building block for information processing architectures with desirable theoretical…

Signal Processing · Electrical Eng. & Systems 2022-11-22 Zhiyang Wang , Luana Ruiz , Alejandro Ribeiro

This paper derives a \emph{distributed} Kalman filter to estimate a sparsely connected, large-scale, $n-$dimensional, dynamical system monitored by a network of $N$ sensors. Local Kalman filters are implemented on the ($n_l-$dimensional,…

Information Theory · Computer Science 2013-12-19 Usman A. Khan , Jose M. F. Moura

This paper presents an LMI-based design framework for multirate steady-state Kalman filters in systems with sensors operating at different sampling rates. The multirate system is formulated as a periodic time-varying system, where the…

Systems and Control · Electrical Eng. & Systems 2026-04-30 Hiroshi Okajima

In this paper, the authors report a way to use concepts from statistical learning to gain an advantage in terms of error exponents while communicating over a discrete memoryless channel. The study utilizes the simulation capability of the…

Information Theory · Computer Science 2022-08-09 Aman Chawla , Salvatore Domenic Morgera

The characteristics of the model dynamics are critical in the performance of (ensemble) Kalman filters. In particular, as emphasized in the seminal work of Anna Trevisan and co-authors, the error covariance matrix is asymptotically…

Optimization and Control · Mathematics 2017-04-03 Marc Bocquet , Karthik S. Gurumoorthy , Amit Apte , Alberto Carrassi , Colin Grudzien , Christopher K. R. T. Jones

This paper investigates the linear precoder design that maximizes the average mutual information of multiple-input multiple-output channels with finite-alphabet inputs and statistical channel state information known at the transmitter. This…

Information Theory · Computer Science 2011-09-07 Weiliang Zeng , Chengshan Xiao , Mingxi Wang , Jianhua Lu

Fueled by applications in sensor networks, these years have witnessed a surge of interest in distributed estimation and filtering. A new approach is hereby proposed for the Distributed Kalman Filter (DKF) by integrating a local covariance…

Systems and Control · Computer Science 2017-03-17 Ye Yuan , Ling Shi , Jun Liu , Zhiyong Chen , Hai-Tao Zhang , Jorge Goncalves

Large language models (LLMs) have shown impressive capabilities in adapting to various tasks when provided with task-specific instructions. However, LLMs using standard decoding strategies often struggle with deviations from the inputs.…

Computation and Language · Computer Science 2024-06-05 Jinliang Lu , Chen Wang , Jiajun Zhang

In diffusion based molecular communication, the intersymbol interference (ISI) is an important reason for system performance degradation, which is caused by the random movement, out-of-order arrival and indistinguishability of the…

Information Theory · Computer Science 2019-01-01 Hui Li , Qingchao Li

It has been proposed that classical filtering methods, like the Kalman filter and 3DVAR, can be used to solve linear statistical inverse problems. In the work of Iglesias, Lin, Lu, & Stuart (2017), error estimates were obtained for this…

Numerical Analysis · Mathematics 2022-05-12 Felix G. Jones , Gideon Simpson

We consider the decoding of convolutional codes using an error trellis constructed based on a submatrix of a given check matrix. In the proposed method, the syndrome-subsequence computed using the remaining submatrix is utilized as…

Information Theory · Computer Science 2010-01-09 Masato Tajima , Koji Okino , Takashi Miyagoshi

Quantum convolutional code was introduced recently as an alternative way to protect vital quantum information. To complete the analysis of quantum convolutional code, I report a way to decode certain quantum convolutional codes based on the…

Quantum Physics · Physics 2009-10-31 H. F. Chau

We introduce a quantum Viterbi decoding algorithm for hidden quantum Markov models (HQMMs) motivated by quantum information processing and quantum algorithms. Given a finite sequence of measurement outcomes, the algorithm identifies hidden…

The equivalence of a systematic convolutional encoder as linear state-space control system is first realized and presented through an example. Then, utilizing this structure, a new optimal state-sequence estimator is derived, in the spirit…

Information Theory · Computer Science 2020-12-22 Caleb Bowyer

Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, where how to define and compute conditional probability is…

Machine Learning · Statistics 2024-04-02 Wenhan Cao , Shiqi Liu , Chang Liu , Zeyu He , Stephen S. -T. Yau , Shengbo Eben Li

The Kalman filter (KF) is an optimal linear state estimator for linear systems, and numerous extensions, including the extended Kalman filter (EKF), unscented Kalman filter (UKF), and cubature Kalman filter (CKF), have been developed for…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Shida Jiang , Junzhe Shi , Scott Moura

For many practical applications in wireless communications, we need to recover a structured sparse signal from a linear observation model with dynamic grid parameters in the sensing matrix. Conventional expectation maximization (EM)-based…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Wenkang Xu , An Liu , Bingpeng Zhou , Minjian Zhao

We construct a hybrid quantum-classical Viterbi decoder for the classical error-correcting codes. Viterbi decoding is a trellis-based procedure for maximum likelihood decoding of classical error-correcting codes. In this article, we…

Quantum Physics · Physics 2026-02-13 Mainak Bhattacharyya , Ankur Raina

This paper examines learning the optimal filtering policy, known as the Kalman gain, for a linear system with unknown noise covariance matrices using noisy output data. The learning problem is formulated as a stochastic policy optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Shahriar Talebi , Amirhossein Taghvaei , Mehran Mesbahi

In 1995, Best et al. published a formula for the exact bit error probability for Viterbi decoding of the rate R=1/2, memory m=1 (2-state) convolutional encoder with generator matrix G(D)=(1 1+D) when used to communicate over the binary…

Information Theory · Computer Science 2015-03-19 Irina E. Bocharova , Florian Hug , Rolf Johannesson , Boris D. Kudryashov