English
Related papers

Related papers: Information-Theoretic Viewpoints on Optimal Causal…

200 papers

Inferring the causal direction and causal effect between two discrete random variables X and Y from a finite sample is often a crucial problem and a challenging task. However, if we have access to observational and interventional data, it…

Machine Learning · Statistics 2020-10-16 Peter Gmeiner

We study the zero-error source coding problem in which an encoder with Side Information (SI) $g(Y)$ transmits source symbols $X$ to a decoder. The decoder has SI $Y$ and wants to recover $f(X,Y)$ where $f,g$ are deterministic. We exhibit a…

Information Theory · Computer Science 2022-12-19 Nicolas Charpenay , Maël le Treust , Aline Roumy

In this chapter, we present our recent invention, i.e., the notion of the value of information$\unicode{x2014}$a semantic metric that is fundamental for networked control systems tasks. We begin our analysis by formulating a causal tradeoff…

Information Theory · Computer Science 2024-03-20 Touraj Soleymani , John S. Baras , Sandra Hirche , Karl H. Johansson

This work considers a novel information design problem and studies how the craft of payoff-relevant environmental signals solely can influence the behaviors of intelligent agents. The agents' strategic interactions are captured by a Markov…

Multiagent Systems · Computer Science 2021-06-15 Tao Zhang , Quanyan Zhu

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

This paper studies the remote estimation of multiple Markov sources over a lossy and rate-constrained channel. Unlike most existing studies that treat all source states equally, we exploit the \emph{semantics of information} and consider…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Jiping Luo , Nikolaos Pappas

This work introduces a framework for analyzing the Age of Incorrect Information (AoII) in a real-time monitoring system with a generic discrete-time Markov source. We study a noisy communication system employing a hybrid automatic repeat…

Information Theory · Computer Science 2026-03-31 Konstantinos Bountrogiannis , Anthony Ephremides , Panagiotis Tsakalides , George Tzagkarakis

The purpose of this paper is two-fold: We extend the well-known relation between optimal stopping and randomized stopping of a given stochastic process to a situation where the available information flow is a filtration with no a priori…

Optimization and Control · Mathematics 2021-04-28 Nacira Agram , Sven Haadem , Bernt Oksendal , Frank Proske

The problem of reconstructing a source sequence with the presence of decoder side-information that is mis-synchronized to the source due to deletions is studied in a distributed source coding framework. Motivated by practical applications,…

Information Theory · Computer Science 2016-11-17 Nan Ma , Kannan Ramchandran , David Tse

In this paper, we investigate a decentralized stochastic control problem with two agents, where a part of the memory of the second agent is also available to the first agent at each instance of time. We derive a structural form for optimal…

Optimization and Control · Mathematics 2022-06-14 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

This paper studies optimal consensus tracking problem of heterogeneous linear multi-agent systems. By introducing tracking error dynamics, the optimal tracking problem is reformulated as finding a Nash-equilibrium solution of a multi-player…

Optimization and Control · Mathematics 2019-05-21 Jilie Zhang , Zhanshan Wang , Hongwei Zhang

We describe an algorithm to solve Bellman optimization that replaces a sum over paths determining the optimal cost-to-go by an analytic method localized in state space. Our approach follows from the established relation between stochastic…

Optimization and Control · Mathematics 2022-12-02 Michael D. Schneider , Caleb Miller , George F. Chapline , Jane Pratt , Dan Merl

We propose a decomposition method for solving a general class of linear-quadratic (LQ) McKean-Vlasov control problems involving conditional expectations and random coefficients, where the system dynamics are driven by two independent Wiener…

Optimization and Control · Mathematics 2026-04-15 Onésime Hounkpe , Dena Firoozi , Shuang Gao

We propose a theoretical framework for formulating language model decoder algorithms with dynamic programming and information theory. With dynamic programming, we lift the design of decoder algorithms from the logit space to the…

Computation and Language · Computer Science 2023-11-17 Chung-Ching Chang , William W. Cohen , Yun-Hsuan Sung

Research has characterized the various forms cognitive control can take, including enhancement of goal-relevant information, suppression of goal-irrelevant information, and overall inhibition of potential responses, and has identified…

Neurons and Cognition · Quantitative Biology 2022-01-04 Harrison Ritz , Xiamin Leng , Amitai Shenhav

Decision making in modern stochastic systems, including e-commerce platforms, financial markets and healthcare systems, has evolved into a multifaceted process that combines information acquisition and adaptive information sources. This…

Optimization and Control · Mathematics 2026-01-07 Renyuan Xu , Thaleia Zariphopoulou , Luhao Zhang

We address the recently suggested problem of causal lossless coding of a randomly arriving source samples. We construct variable-to-fixed coding schemes and show that they outperform the previously considered fixed-to-variable schemes when…

Information Theory · Computer Science 2020-10-27 Uri Abend , Anatoly Khina

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-known planning problem…

Machine Learning · Computer Science 2023-07-24 Marwan Mousa , Damien van de Berg , Niki Kotecha , Ehecatl Antonio del Rio-Chanona , Max Mowbray

The optimal zero delay coding of a finite state Markov source is considered. The existence and structure of optimal codes are studied using a stochastic control formulation. Prior results in the literature established the optimality of…

Information Theory · Computer Science 2017-04-07 Richard G. Wood , Tamás Linder , Serdar Yüksel

We consider zero-delay single-user and multi-user source coding with average distortion constraint and decoder side information. The zero-delay constraint translates into causal (sequential) encoder and decoder pairs as well as the use of…

Information Theory · Computer Science 2013-01-03 Yonatan Kaspi , Neri Merhav