English
Related papers

Related papers: Shannon meets Myerson: Information Extraction from…

200 papers

In this work, we examine cognitive radio networks, where secondary users may act as relays for messages sent by the primary user, hence offering performance improvement of primary transmissions, while at the same time obtaining more…

Information Theory · Computer Science 2019-08-29 Athanasios Papadopoulos , Nestor D. Chatzidiamantis , Leonidas Georgiadis

The data for many classification problems, such as pattern and speech recognition, follow mixture distributions. To quantify the optimum performance for classification tasks, the Shannon mutual information is a natural information-theoretic…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Yijun Ding , Amit Ashok

We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and effectively uses a predictive model of its…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

Correlated sources are present in communication systems where protocols ensure that there is some predetermined information for sources to transmit. Here, two correlated sources across a channel with eavesdroppers are investigated, and…

Information Theory · Computer Science 2014-11-06 R. Balmahoon , H. Vinck , L. Cheng

Semantic communication, as a promising technology, has emerged to break through the Shannon limit, which is envisioned as the key enabler and fundamental paradigm for future 6G networks and applications, e.g., smart healthcare. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Jiawen Kang , Hongyang Du , Zonghang Li , Zehui Xiong , Shiyao Ma , Dusit Niyato , Yuan Li

As large-scale dense and often randomly deployed wireless sensor networks (WSNs) become widespread, local information exchange between co-located sets of nodes may play a significant role in handling the excessive traffic volume. Moreover,…

Many real-world reinforcement learning tasks require multiple agents to make sequential decisions under the agents' interaction, where well-coordinated actions among the agents are crucial to achieve the target goal better at these tasks.…

Artificial Intelligence · Computer Science 2019-02-06 Daewoo Kim , Sangwoo Moon , David Hostallero , Wan Ju Kang , Taeyoung Lee , Kyunghwan Son , Yung Yi

In recent years, text summarization methods have attracted much attention again thanks to the researches on neural network models. Most of the current text summarization methods based on neural network models are supervised methods which…

Computation and Language · Computer Science 2024-01-25 Dehao Tao , Yingzhu Xiong , Zhongliang Yang , Yongfeng Huang

We consider a communication problem in which an update of the source message needs to be conveyed to one or more distant receivers that are interested in maintaining specific linear functions of the source message. The setting is one in…

Information Theory · Computer Science 2018-08-07 N. Prakash , Muriel Medard

We extend the notion of list decoding to {\em ratio list decoding} which involves a list decoder whose list size is specified as a function of the number of messages $M_n$ and the block length $n$. We present necessary and sufficient…

Information Theory · Computer Science 2018-10-19 Anelia Somekh-Baruch

We revisit the well-studied problem of estimating the Shannon entropy of a probability distribution, now given access to a probability-revealing conditional sampling oracle. In this model, the oracle takes as input the representation of a…

Cryptography and Security · Computer Science 2022-06-03 Priyanka Golia , Brendan Juba , Kuldeep S. Meel

Energy harvesting is a promising solution to prolong the operation of energy-constrained wireless networks. In particular, scavenging energy from ambient radio signals, namely wireless energy harvesting (WEH), has recently drawn significant…

Information Theory · Computer Science 2012-11-01 Liang Liu , Rui Zhang , Kee-Chaing Chua

In this work, lossy distributed compression of pairs of correlated sources is considered. Conventionally, Shannon's random coding arguments -- using randomly generated unstructured codebooks whose blocklength is taken to be asymptotically…

Information Theory · Computer Science 2020-10-21 Farhad Shirani , S. Sandeep Pradhan

We consider the storage-retrieval rate tradeoff in private information retrieval (PIR) systems using a Shannon-theoretic approach. Our focus is mostly on the canonical two-message two-database case, for which a coding scheme based on random…

Information Theory · Computer Science 2023-01-06 Chao Tian , Hua Sun , Jun Chen

We consider a Bayesian persuasion or information design problem where the sender tries to persuade the receiver to take a particular action via a sequence of signals. This we model by considering multi-phase trials with different…

Theoretical Economics · Economics 2021-11-24 Shih-Tang Su , Vijay G. Subramanian , Grant Schoenebeck

We study message identification over a q-ary uniform permutation channel, where the transmitted vector is permuted by a permutation chosen uniformly at random. For discrete memoryless channels(DMCs), the number of identifiable messages…

Information Theory · Computer Science 2024-09-23 Abhishek Sarkar , Bikash Kumar Dey

Two familiar notions of correlation are rediscovered as the extreme operating points for distributed synthesis of a discrete memoryless channel, in which a stochastic channel output is generated based on a compressed description of the…

Information Theory · Computer Science 2016-11-18 Paul Cuff

In this paper we consider a wiretap channel with a secret key buffer. We use the coding scheme of [1] to enhance the secrecy rate to the capacity of the main channel, while storing each securely transmitted message in the secret key buffer.…

Information Theory · Computer Science 2016-07-06 Shahid Mehraj Shah , Vinod Sharma

We consider a persuasion problem between a sender and a receiver whose utility may be nonlinear in her belief; we call such receivers risk-conscious. Such utility models arise when the receiver exhibits systematic biases away from…

Theoretical Economics · Economics 2023-07-17 Jerry Anunrojwong , Krishnamurthy Iyer , David Lingenbrink

We consider unsourced random access with MIMO receiver - a crucial communication scenario for future 5G/6G wireless networks. We perform a projection-based decoder analysis and derive energy efficiency achievability bounds when channel…

Information Theory · Computer Science 2023-03-28 Kirill Andreev , Daria Ustinova , Alexey Frolov