English
Related papers

Related papers: Optimal Causal Rate-Constrained Sampling for a Cla…

200 papers

The min-sum approximation is widely used in the decoding of polar codes. Although it is a numerical approximation, hardly any penalties are incurred in practice. We give a theoretical justification for this. We consider the common case of a…

Information Theory · Computer Science 2025-03-04 Nir Chisnevski , Ido Tal , Shlomo Shamai

It has been well established that wireless network coding can significantly improve the efficiency of multi-hop wireless networks. However, in a stochastic environment some of the packets might not have coding pairs, which limits the number…

Optimization and Control · Mathematics 2015-03-19 Yu-Pin Hsu , Navid Abedini , Natarajan Gautam , Alex Sprintson , Srinivas Shakkottai

This paper studies the remote estimation of multiple Markov sources over a lossy and rate-constrained channel. Unlike most existing studies that treat all source states equally, we exploit the \emph{semantics of information} and consider…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Jiping Luo , Nikolaos Pappas

The master equation and, more generally, Markov processes are routinely used as models for stochastic processes. They are often justified on the basis of randomization and coarse-graining assumptions. Here instead, we derive n-th order…

Statistical Mechanics · Physics 2012-09-27 Julian Lee , Steve Pressé

Our understanding of information in systems has been based on the foundation of memoryless processes. Extensions to stable Markov and auto-regressive processes are classical. Berger proved a source coding theorem for the marginally unstable…

Information Theory · Computer Science 2007-12-06 Anant Sahai , Sanjoy Mitter

In this paper, we consider a problem of sampling a Wiener process, with samples forwarded to a remote estimator via a channel that consists of a queue with random delay. The estimator reconstructs a real-time estimate of the signal from…

Information Theory · Computer Science 2017-05-26 Yin Sun , Yury Polyanskiy , Elif Uysal-Biyikoglu

For a packet erasure broadcast channel with three receivers, we propose a new coding algorithm that makes use of feedback to dynamically adapt the code. Our algorithm is throughput optimal, and we conjecture that it also achieves an…

Information Theory · Computer Science 2008-09-29 Jay Kumar Sundararajan , Devavrat Shah , Muriel Médard

Stationary ergodic processes with finite alphabets are estimated by finite memory processes from a sample, an n-length realization of the process, where the memory depth of the estimator process is also estimated from the sample using…

Statistics Theory · Mathematics 2013-07-25 Zsolt Talata

In this paper, we study a remote monitoring system where a receiver observes a remote binary Markov source and decides whether to sample and transmit the state through a randomly delayed channel. We adopt uncertainty of information (UoI),…

Information Theory · Computer Science 2024-05-20 Xiaomeng Chen , Aimin Li , Shaohua Wu

We investigate the optimal performance of dense sensor networks by studying the joint source-channel coding problem. The overall goal of the sensor network is to take measurements from an underlying random process, code and transmit those…

Information Theory · Computer Science 2007-07-13 Nan Liu , Sennur Ulukus

We develop a novel source coding strategy for sampling and monitoring of a Wiener process. For the encoding process, we employ a four level ``quantization'' scheme, which employs monotone function thresholds as opposed to fixed constant…

Information Theory · Computer Science 2025-04-03 Sahan Liyanaarachchi , Ismail Cosandal , Sennur Ulukus

A rateless code encodes a finite length information word into an infinitely long codeword such that longer prefixes of the codeword can tolerate a larger fraction of errors. A rateless code achieves capacity for a family of channels if, for…

Information Theory · Computer Science 2014-06-03 Benny Applebaum , Liron David , Guy Even

The problem of joint source-channel coding is considered for a stationary remote (noisy) Gaussian source and a Gaussian channel. The encoder and decoder are assumed to be causal and their combined operations are subject to a delay…

Information Theory · Computer Science 2012-03-29 Erik Johannesson , Anders Rantzer , Bo Bernhardsson , Andrey Ghulchak

In this paper, we develop {finite-time horizon} causal filters using the nonanticipative rate distortion theory. We apply the {developed} theory to {design optimal filters for} time-varying multidimensional Gauss-Markov processes, subject…

Information Theory · Computer Science 2017-02-13 Photios A. Stavrou , Themistoklis Charalambous , Charalambos D. Charalambous , Sergey Loyka

Capacity formulas and random-coding exponents are derived for a generalized family of Gel'fand-Pinsker coding problems. These exponents yield asymptotic upper bounds on the achievable log probability of error. In our model, information is…

Information Theory · Computer Science 2007-07-13 Pierre Moulin , Ying Wang

Existing time series tokenization methods predominantly encode a constant number of samples into individual tokens. This inflexible approach can generate excessive tokens for even simple patterns like extended constant values, resulting in…

Machine Learning · Computer Science 2026-01-29 Leon Götz , Marcel Kollovieh , Stephan Günnemann , Leo Schwinn

Predictive models are often deployed through existing decision policies that stakeholders are reluctant to change unless a risk constraint requires intervention. We study risk-controlled post-processing: given a deterministic baseline…

Machine Learning · Statistics 2026-05-08 Sunay Joshi , Tao Wang , Hamed Hassani , Edgar Dobriban

We design scheduling policies that minimize a risk-sensitive cost criterion for a remote estimation setup. Since risk-sensitive cost objective takes into account not just the mean value of the cost, but also higher order moments of its…

Optimization and Control · Mathematics 2024-03-22 Manali Dutta , Rahul Singh

We introduce an optimal strategy to sample quantum outcomes of local measurement strings for isometric tensor network states. Our method generates samples based on an exact cumulative bounding function, without prior knowledge, in the…

Quantum Physics · Physics 2025-04-23 Marco Ballarin , Pietro Silvi , Simone Montangero , Daniel Jaschke

We consider a multiterminal source coding problem in which a source is estimated at a central processing unit from lossy-compressed remote observations. Each lossy-encoded observation is produced by a remote sensor which obtains a noisy…

Information Theory · Computer Science 2016-05-13 Ruiyang Song , Stefano Rini , Alon Kipnis , Andrea J. Goldsmith