English
Related papers

Related papers: Breakdown of local information processing may unde…

200 papers

We introduce two variants of the information spectrum relative entropy defined by Tomamichel and Hayashi which have the particular advantage of satisfying the data-processing inequality, i.e. monotonicity under quantum operations. This…

Quantum Physics · Physics 2021-11-17 Nilanjana Datta , Felix Leditzky

This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in…

Neurons and Cognition · Quantitative Biology 2024-09-27 Jan Karbowski

It is generally accepted that, when moving in groups, animals process information to coordinate their motion. Recent studies have begun to apply rigorous methods based on Information Theory to quantify such distributed computation.…

Quantitative Methods · Quantitative Biology 2017-05-05 Emanuele Crosato , Li Jiang , Valentin Lecheval , Joseph T. Lizier , X. Rosalind Wang , Pierre Tichit , Guy Theraulaz , Mikhail Prokopenko

Feed-forward deep neural networks have been used extensively in various machine learning applications. Developing a precise understanding of the underling behavior of neural networks is crucial for their efficient deployment. In this paper,…

Information Theory · Computer Science 2016-03-22 Pejman Khadivi , Ravi Tandon , Naren Ramakrishnan

We investigate the propagation of information through one-dimensional quantum chains in fluctuating external fields. We find that information propagation is suppressed, but in a quite different way compared to the situation with static…

Quantum Physics · Physics 2010-03-11 Christian K. Burrell , Jens Eisert , Tobias J. Osborne

Quantum information quantities, such as mutual information and entropies, are essential for characterizing quantum systems and protocols in quantum information science. In this contribution, we identify types of information measures based…

Quantum Physics · Physics 2025-10-21 Christopher Popp , Tobias C. Sutter , Beatrix C. Hiesmayr

This paper presents a comprehensive analysis of the information-energy capacity region for simultaneous lightwave information and power transfer (SLIPT) systems over lognormal fading channels. Unlike conventional studies that primarily…

Information Theory · Computer Science 2026-04-27 Nizar Khalfet , Kapila W. S. Palitharathna , Symeon Chatzinotas , Ioannis Krikidis

Transfer entropy provides a general tool for analyzing the magnitudes and directions---but not the \emph{kinds}---of information transfer in a system. We extend transfer entropy in two complementary ways. First, we distinguish…

Data Analysis, Statistics and Probability · Physics 2011-02-09 Paul L. Williams , Randall D. Beer

Given the constant rise in quantity and quality of data obtained from neural systems on many scales ranging from molecular to systems', information-theoretic analyses became increasingly necessary during the past few decades in the…

Information Theory · Computer Science 2013-10-08 Felix Effenberger

Transfer learning improves the performance of the target task by leveraging the data of a specific source task: the closer the relationship between the source and the target tasks, the greater the performance improvement by transfer…

Neurons and Cognition · Quantitative Biology 2022-08-31 Youzhi Qu , Xinyao Jian , Wenxin Che , Penghui Du , Kai Fu , Quanying Liu

The mechanism that maintains atrial fibrillation (AF) remains elusive. One approach to understanding and controlling the mechanism ("AF driver") is to quantify inter-scale information flow from macroscopic to microscopic behaviors of the…

Pattern Formation and Solitons · Physics 2018-08-01 Hiroshi Ashikaga , Ryan G. James

We derive lower bounds on the Bayes risk in decentralized estimation, where the estimator does not have direct access to the random samples generated conditionally on the random parameter of interest, but only to the data received from…

Information Theory · Computer Science 2016-07-05 Aolin Xu , Maxim Raginsky

In this paper we present an analysis of information transfer based on Landauer's principle (i.e. erasure of information is associated with an increase in entropy), as well as considerations of analyticity and causality. We demonstrate that…

Optics · Physics 2015-06-26 Michael C. Parker , Stuart D. Walker

Pairwise interactions between individuals are taken as fundamental drivers of collective behavior responsible for group cohesion and decision-making. While an individual directly influences only a few neighbors, over time indirect…

Adaptation and Self-Organizing Systems · Physics 2022-04-12 Sulimon Sattari , Udoy S. Basak , Ryan G. James , James P. Crutchfield , Tamiki Komatsuzaki

Perceptual losses have emerged as powerful tools for training networks to enhance Low-Dose Computed Tomography (LDCT) images, offering an alternative to traditional pixel-wise losses such as Mean Squared Error, which often lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Gabriel A. Viana , Luis F. Alves Pereira , Tsang Ing Ren , George D. C. Cavalcanti , Jan Sijbers

Recent experiments have indicated that many biological systems self-organise near their critical point, which hints at a common design principle. While it has been suggested that information transmission is optimized near the critical…

Statistical Mechanics · Physics 2021-02-03 Matthijs Meijers , Sosuke Ito , Pieter Rein ten Wolde

A central task in analyzing complex dynamics is to determine the loci of information storage and the communication topology of information flows within a system. Over the last decade and a half, diagnostics for the latter have come to be…

Statistical Mechanics · Physics 2016-06-20 Ryan G. James , Nix Barnett , James P. Crutchfield

Using the formalism of information theory, we analyze the mechanism of information transduction in a simple one-step signaling cascade S$\rightarrow$X representing the gene regulatory network. Approximating the signaling channel to be…

Molecular Networks · Quantitative Biology 2018-11-14 Mintu Nandi , Ayan Biswas , Suman K Banik , Pinaki Chaudhury

Anesthetic agents are neurotropic drugs capable of inducing significant alterations in the thalamocortical system, promoting a profound decrease in awareness and level of consciousness. There is experimental evidence that general anesthesia…

Neurons and Cognition · Quantitative Biology 2023-09-06 Eduardo C. Padovani

From the eardrum to the auditory cortex, where acoustic stimuli are decoded, there are several stages of auditory processing and transmission where information may potentially get lost. In this paper, we aim at quantifying the information…

Information Theory · Computer Science 2018-05-03 Mohsen Zareian Jahromi , Adel Zahedi , Jesper Jensen , Jan Østergaard