English
Related papers

Related papers: Mathematical Foundations for Information Theory in…

200 papers

Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…

Information Theory · Computer Science 2026-03-09 Henry Pinkard , Laura Waller

This work presents a performance analysis for diffusive molecular communication with mobile transmit and receive nanomachines. To begin with, the optimal test is obtained for symbol detection at the receiver nanomachine. Subsequently,…

Information Theory · Computer Science 2017-10-04 Neeraj Varshney , Aditya K. Jagannatham , Pramod K. Varshney

We derive information-theoretic converses (i.e., lower bounds) for the minimum time required by any algorithm for distributed function computation over a network of point-to-point channels with finite capacity, where each node of the…

Information Theory · Computer Science 2017-01-04 Aolin Xu , Maxim Raginsky

In this work, we consider diffusion-based molecular communication with and without drift between two static nano-machines. We employ type-based information encoding, releasing a single molecule per information bit. At the receiver, we…

Information Theory · Computer Science 2018-07-13 Werner Haselmayr , Neeraj Varshney , A. Taufiq Asyhari , Andreas Springer , Weisi Guo

Molecular communication is set to play an important role in the design of complex biological and chemical systems. An important class of molecular communication systems is based on the timing channel, where information is encoded in the…

Information Theory · Computer Science 2014-10-22 Malcolm Egan , Yansha Deng , Maged Elkashlan , Trung Q. Duong

In an effort to develop the foundations for a non-stochastic theory of information, the notion of $\delta$-mutual information between uncertain variables is introduced as a generalization of Nair's non-stochastic information functional.…

Information Theory · Computer Science 2020-11-26 Anshuka Rangi , Massimo Franceschetti

In this paper, we prove the existence of fundamental relations between information theory and estimation theory for network-coded flows. When the network is represented by a directed graph G=(V, E) and under the assumption of uncorrelated…

Information Theory · Computer Science 2016-11-17 Samah A. M. Ghanem

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Simon R. Schultz , Robin A. A. Ince , Stefano Panzeri

Shannon's channel coding theorem characterizes the maximal rate of information that can be reliably transmitted over a communication channel when optimal encoding and decoding strategies are used. In many scenarios, however, practical…

Information Theory · Computer Science 2023-07-06 Jonathan Scarlett , Albert Guillén i Fàbregas , Anelia Somekh-Baruch , Alfonso Martinez

Quantum information theory studies the fundamental limits that physical laws impose on information processing tasks such as data compression and data transmission on noisy channels. This thesis presents general techniques that allow one to…

Quantum Physics · Physics 2010-04-13 Frédéric Dupuis

Neural channel decoder, as a data-driven channel decoding strategy, has shown very promising improvement on error-correcting capability over the classical methods. However, the success of those deep learning-based decoder comes at the cost…

Information Theory · Computer Science 2026-05-20 Chengwei Zhang , Yifan Du , Siyu Liao

We consider molecular communication, with information conveyed in the time of release of molecules. The main contribution of this paper is the development of a theoretical foundation for such a communication system. Specifically, we develop…

Information Theory · Computer Science 2016-11-17 K. V. Srinivas , Raviraj S. Adve , Andrew W. Eckford

This paper is Part II of a two-paper set which develops a finest-grain per-molecule timing treatment of molecular communication. We first consider a simple one-molecule timing channel with a molecule launch deadline, similar to but…

Emerging Technologies · Computer Science 2020-09-22 Christopher Rose , Ismat Saira Mian

In this paper we address the issue of universal or robust communication over quantum channels. Specifically, we consider memoryless communication scenario with channel uncertainty which is an analog of compound channel in classical…

Quantum Physics · Physics 2009-11-13 I. Bjelakovic , H. Boche , J. Noetzel

Information must take up space, must weigh, and its flux must be limited. Quantum limits on communication and information storage leading to these conclusions are here described. Quantum channel capacity theory is reviewed for both steady…

Quantum Physics · Physics 2015-06-26 Jacob D. Bekenstein , Marcelo Schiffer

Information theory establishes the ultimate limits on performance for noisy communication systems [Shannon48]. An accurate model of a physical communication device must include quantum effects, but typically including these makes the theory…

Quantum Physics · Physics 2013-12-20 Graeme Smith , John A. Smolin

Molecular communication (MC) is a concept in communication engineering, where diffusive molecules are used to transmit information between nano or micro-scale chemical reaction systems. Engineering MC to control the reaction systems in…

Systems and Control · Electrical Eng. & Systems 2024-04-01 Shoichiro Kitada , Taishi Kotsuka , Yutaka Hori

Molecular communication is an expanding body of research. Recent advances in biology have encouraged using genetically engineered bacteria as the main component in the molecular communication. This has stimulated a new line of research that…

Information Theory · Computer Science 2012-09-13 Arash Einolghozati , Mohsen Sardari , Faramarz Fekr

In Diffusive Molecular Communication (DMC), information is transmitted by diffusing molecules. Synaptic signaling is a natural implementation of this paradigm. It is responsible for relaying information from one neuron to another, but also…

Subcellular Processes · Quantitative Biology 2021-10-01 Sebastian Lotter , Arman Ahmadzadeh , Robert Schober

Information theory tells us that if the rate of sending information across a noisy channel were above the capacity of that channel, then the transmission would necessarily be unreliable. For classical information sent over classical or…

Quantum Physics · Physics 2013-02-22 Naresh Sharma , Naqueeb Ahmad Warsi