English
Related papers

Related papers: Ambiguous signals and efficient codes

200 papers

Energy efficient information transmission may be relevant to biological sensory signal processing as well as to low power electronic devices. We explore its consequences in two different regimes. In an ``immediate'' regime, we argue that…

Statistical Mechanics · Physics 2007-05-23 Vijay Balasubramanian , Don Kimber , Michael J Berry

Text data is often seen as "take-away" materials with little noise and easy to process information. Main questions are how to get data and transform them into a good document format. But data can be sensitive to noise oftenly called…

Computation and Language · Computer Science 2023-06-22 Nicolas Turenne

We investigate the performance of sparsely-connected networks of integrate-and-fire neurons for ultra-short term information processing. We exploit the fact that the population activity of networks with balanced excitation and inhibition…

Neurons and Cognition · Quantitative Biology 2007-05-23 Julien Mayor , Wulfram Gerstner

The ability of biological and artificial collectives to outperform solitary individuals in a wide variety of tasks depends crucially on the efficient processing of social and environmental information at the level of the collective. Here,…

Biological Physics · Physics 2020-10-13 Parisa Rahmani , Fernando Peruani , Pawel Romanczuk

Finding the most probable explanation for observed variables in a Bayesian network is a notoriously intractable problem, particularly if there are hidden variables in the network. In this paper we examine the complexity of a related…

Computational Complexity · Computer Science 2018-12-12 Johan Kwisthout

Biological signaling is imagined as a combination of activation and transport. The former is triggered by local molecular interactions and the latter is the result of molecular diffusion. However, other fundamental physical principles of…

Biological Physics · Physics 2016-12-07 Bernhard Fichtl , Matthias F. Schneider

For information transmission a binary symmetric channel is used. There is also another noisy binary symmetric channel (feedback channel), and the transmitter observes without delay all the outputs of the forward channel via that feedback…

Information Theory · Computer Science 2010-11-10 M. V. Burnashev , H. Yamamoto

Here, we consider the open issue of how the energy efficiency of neural information transmission process in a general neuronal array constrains the network size, and how well this network size ensures the neural information being…

Neurons and Cognition · Quantitative Biology 2015-07-31 Lianchun Yu , Chi Zhang , Liwei Liu , Yuguo Yu

Chaos is popularly associated with its property of sensitivity to initial conditions. In this paper we will show that there can be a flip side to this property which is quite fascinating and highly useful in many applications. As a result,…

Chaotic Dynamics · Physics 2009-05-05 Prabhakar G. Vaidya

Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and common-sense…

Computation and Language · Computer Science 2022-11-24 Ninareh Mehrabi , Palash Goyal , Apurv Verma , Jwala Dhamala , Varun Kumar , Qian Hu , Kai-Wei Chang , Richard Zemel , Aram Galstyan , Rahul Gupta

We consider the problem of communication over a network containing a hidden and malicious adversary that can control a subset of network resources, and aims to disrupt communications. We focus on omniscient node-based adversaries, i.e., the…

Information Theory · Computer Science 2016-05-09 Peida Tian , Sidharth Jaggi , Mayank Bakshi , Oliver Kosut

Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system,…

Information Theory · Computer Science 2014-04-02 Albert Y. S. Lam , Yanhui Geng , Victor O. K. Li

Individuals, despite having varied life experiences and learning processes, can communicate effectively through languages. This study aims to explore the efficiency of language as a communication medium. We put forth two specific…

Machine Learning · Computer Science 2024-10-21 Hang Chen , Yuchuan Jang , Weijie Zhou , Cristian Meo , Ziwei Chen , Dianbo Liu

Applications of machine learning inform human decision makers in a broad range of tasks. The resulting problem is usually formulated in terms of a single decision maker. We argue that it should rather be described as a two-player learning…

Machine Learning · Computer Science 2022-05-04 Sebastian Bordt , Ulrike von Luxburg

Cellular decision making is based on regulatory circuits that associate signal thresholds to specific physiological actions. This transmission of information is subjected to molecular noise what can decrease its fidelity. Here, we show…

Molecular Networks · Quantitative Biology 2017-02-08 Guillermo Rodrigo , Juan F. Poyatos

We develop a model of social learning from overabundant information: Short-lived agents sequentially choose from a large set of (flexibly correlated) information sources for prediction of an unknown state. Signal realizations are public. We…

Computer Science and Game Theory · Computer Science 2018-06-20 Annie Liang , Xiaosheng Mu

The mammalian brain is a metabolically expensive device, and evolutionary pressures have presumably driven it to make productive use of its resources. For sensory areas, this concept has been expressed more formally as an optimality…

Neurons and Cognition · Quantitative Biology 2016-03-02 Deep Ganguli , Eero P. Simoncelli

This paper considers the dynamics of cheap talk interactions between an oblivious receiver and a sender with different amounts of information. Even though it may seem that having additional information about the state of the game is always…

Computer Science and Game Theory · Computer Science 2025-12-01 Itai Arieli , Ivan Geffner , Moshe Tennenholtz

Communication networks are used today everywhere and on every scale: starting from small Internet of Things (IoT) networks at home, via campus and enterprise networks, and up to tier-one networks of Internet providers. Accordingly, network…

Networking and Internet Architecture · Computer Science 2022-02-16 Itamar Cohen

We investigate and quantify the interplay between topology and ability to send specific signals in complex networks. We find that in a majority of investigated real-world networks the ability to communicate is favored by the network…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. Trusina , M. Rosvall , K. Sneppen