English
Related papers

Related papers: Derivation of Mutual Information and Linear Minimu…

200 papers

Sequential decoding, commonly applied to substitution channels, is a sub-optimal alternative to Viterbi decoding with significantly reduced memory costs. In this work, a sequential decoder for convolutional codes over channels that are…

Information Theory · Computer Science 2026-04-02 Anisha Banerjee , Andreas Lenz , Antonia Wachter-Zeh

In this work a novel approach for weakly supervised object detection that incorporates pointwise mutual information is presented. A fully convolutional neural network architecture is applied in which the network learns one filter per object…

Computer Vision and Pattern Recognition · Computer Science 2018-01-29 Rene Grzeszick , Sebastian Sudholt , Gernot A. Fink

The least mean squares (LMS) filter is often derived via the Wiener filter solution. For a system identification scenario, such a derivation makes it hard to incorporate prior information on the system's impulse response. We present an…

Signal Processing · Electrical Eng. & Systems 2017-12-07 Michael Lunglmayr , Oliver Lang , Mario Huemer

A Kalman filter can be used to determine material parameters using uncertain experimental data. However, starting with inappropriate initial values for material parameters might include false local attractors or even divergence. Also,…

Materials Science · Physics 2015-02-13 Abdallah Shokry , Per Ståhle

Square-root Kalman filters propagate state covariances in Cholesky-factor form for numerical stability, and are a natural target for gradient-based parameter learning in state-space models. Their core operation, triangularization of a…

Machine Learning · Statistics 2026-03-17 Adrien Corenflos

Stochastic models in biomolecular contexts can have a state-dependent process noise covariance. The choice of the process noise covariance is an important parameter in the design of a Kalman Filter for state estimation and the theoretical…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Krishan Kumar Gola , Shaunak Sen

We propose a version of least-mean-square (LMS) algorithm for sparse system identification. Our algorithm called online linearized Bregman iteration (OLBI) is derived from minimizing the cumulative prediction error squared along with an…

Information Theory · Computer Science 2012-10-03 Tao Hu , Dmitri B. Chklovskii

This paper discusses an efficient parallel implementation of the ensemble Kalman filter based on the modified Cholesky decomposition. The proposed implementation starts with decomposing the domain into sub-domains. In each sub-domain a…

Numerical Analysis · Computer Science 2016-06-03 Elias D. Nino , Adrian Sandu , Xinwei Deng

Epistemic uncertainty estimation is essential for identifying regions where deep learning system outputs may be unreliable. However, existing approaches require computationally expensive ensemble methods or multiple stochastic forward…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 William Stevens , Mohit Prabhushankar , Ghassan AlRegib

In this paper, we provide a new approach to the analytical estimation of the bit-error rate (BER) for convolutional codes for Viterbi decoding in the binary symmetric channel (BSC). The expressions we obtained for lower and upper BER bounds…

Information Theory · Computer Science 2022-11-22 Anastasia Kurmukova , Fedor Ivanov , Victor Zyablov

With the rapid development of information technology, "information overload" has become the main theme that plagues people's online life. As an effective tool to help users quickly search for useful information, a personalized…

Information Retrieval · Computer Science 2022-06-03 Peiyu Liu , Junping Du , Zhe Xue , Ang Li

This paper considers the average complexity of maximum likelihood (ML) decoding of convolutional codes. ML decoding can be modeled as finding the most probable path taken through a Markov graph. Integrated with the Viterbi algorithm (VA),…

Information Theory · Computer Science 2016-11-17 Jie Luo

This paper is concerned with block Markov superposition transmission (BMST) of tail-biting convolutional code (TBCC). We propose a new decoding algorithm for BMST-TBCC, which integrates a serial list Viterbi algorithm (SLVA) with a soft…

Information Theory · Computer Science 2019-02-27 Xiao Ma , Wenchao Lin , Suihua Cai , Baodian Wei

The fusion between an inertial navigation system and global navigation satellite systems is regularly used in many platforms such as drones, land vehicles, and marine vessels. The fusion is commonly carried out in a model-based extended…

Systems and Control · Electrical Eng. & Systems 2022-09-05 Barak Or , Itzik Klein

We formulate a recursive estimation problem for multiple dynamical systems coupled through a low dimensional stochastic input, and we propose an efficient sub-optimal solution. The suggested approach is an approximation of the Kalman filter…

Optimization and Control · Mathematics 2019-11-26 Leonid Pogorelyuk , Clarence W. Rowley , N. Jeremy Kasdin

In this letter, we propose an iterative joint detection algorithm of Kalman filter (KF) and channel decoder for the sensor-to-controller link of wireless networked control systems, which utilizes the prior information of control system to…

Information Theory · Computer Science 2025-12-19 Jinnan Piao , Dong Li , Yiming Sun , Zhibo Li , Ming Yang , Xueting Yu

State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail…

Machine Learning · Computer Science 2026-05-27 Vasileios Saketos , Ming Xiao

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

In massive multiple-input multiple-output (MIMO) systems, the knowledge of the users' channel covariance matrix is crucial for minimum mean square error (MMSE) channel estimation in the uplink as well as it plays an important role in…

Information Theory · Computer Science 2022-06-07 Tianyu Yang , Mahdi Barzegar Khalilsarai , Saeid Haghighatshoar , Giuseppe Caire

This paper investigates an error covariance matrix splitting technique for multiuser multiple input and multiple output (MIMO) interference downlink channel. Most of the related work has thus far considered the traditional error covariance…

Information Theory · Computer Science 2016-09-06 Md. Abdul Latif Sarker