English
Related papers

Related papers: Misanthropic Entropy and Renormalization as a Comm…

200 papers

When can noiseless quantum information be sent across noisy quantum devices? And at what maximum rate? These questions lie at the heart of quantum technology, but remain unanswered because of non-additivity -- a fundamental synergy which…

Quantum Physics · Physics 2021-10-04 Vikesh Siddhu

21-cm Intensity Mapping (IM) is a promising approach to detecting information about the large-scale structure beyond the local universe. One of the biggest challenges for an IM observation is the foreground removal procedure. In this paper,…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Lin-Cheng Li , Jia-Yu Lin , Yuan-Gen Wang , Lister Staveley-Smith

In this paper we consider an un-cooperative spectrum sharing scenario, wherein a radar system is to be overlaid to a pre-existing wireless communication system. Given the order of magnitude of the transmitted powers in play, we focus on the…

Systems and Control · Electrical Eng. & Systems 2023-04-06 Yinchuan Li , Le Zheng , Marco Lops , Xiaodong Wang

We introduce a novel generalization of entropy and conditional entropy from which most definitions from the literature can be derived as particular cases. Within this general framework, we investigate the problem of designing…

Information Theory · Computer Science 2018-11-27 MHR Khouzani , Pasquale Malacaria

This paper introduces embodied communication, a new wireless communication modality in which information is imprinted onto environmental states and recovered by the receiver through sensing. No dedicated communication transmitter is…

Information Theory · Computer Science 2026-05-12 Yulin Shao

We consider a finite-state memoryless channel with i.i.d. channel state and the input Markov process supported on a mixing finite-type constraint. We discuss the asymptotic behavior of entropy rate of the output hidden Markov chain and…

Information Theory · Computer Science 2010-07-28 Guangyue Han , Brian Marcus

Speech signals encode emotional, linguistic, and pathological information within a shared acoustic channel; however, disentanglement is typically assessed indirectly through downstream task performance. We introduce an information-theoretic…

Sound · Computer Science 2026-02-25 Bipasha Kashyap , Björn W. Schuller , Pubudu N. Pathirana

We study a unified information-theoretic framework for integrated sensing and communications (ISAC), applicable to both monostatic and bistatic sensing scenarios. Special attention is given to the case where the sensing receiver (Rx) is…

Information Theory · Computer Science 2025-02-13 Jun Chen , Lei Yu , Yonglong Li , Wuxian Shi , Yiqun Ge , Wen Tong

We present real--space renormalization group (RG) calculations of the critical properties of the random--field Ising model on a cubic lattice in three dimensions. We calculate the RG flows in a two--parameter truncation of the Hamiltonian…

Condensed Matter · Physics 2009-10-22 M. E. J. Newman , B. W. Roberts , G. T. Barkema , J. P. Sethna

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…

Information Theory · Computer Science 2013-05-30 Malte Harder , Christoph Salge , Daniel Polani

We study communication between an inertial observer and one of two causally-disconnected counter accelerating observers. We will restrict the quantum channel considering inertial-to-accelerated bipartite classical and quantum communication…

Quantum Physics · Physics 2012-12-27 Eduardo Martin-Martinez , Dominic Hosler , Miguel Montero

Multilayer (or deep) networks are powerful probabilistic models based on multiple stages of a linear transform followed by a non-linear (possibly random) function. In general, the linear transforms are defined by matrices and the non-linear…

Information Theory · Computer Science 2017-10-13 Galen Reeves

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

We show that optimal protocols for noisy channel coding of public or private information over either classical or quantum channels can be directly constructed from two more primitive information-theoretic tools: privacy amplification and…

Quantum Physics · Physics 2012-03-27 Joseph M. Renes , Renato Renner

We study the phase diagram of statistical systems of closed and open interfaces built on a cubic lattice. Interacting closed interfaces can be written as Ising models, while open surfaces as Z(2) gauge systems. When the open surfaces reduce…

Condensed Matter · Physics 2009-10-28 Emilio N. M. Cirillo , Giuseppe Gonnella

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

We present a non-perturbative, first-principles derivation of renormalization relations for waveguide-QED models, explicitly accounting for the infrared (IR) and ultraviolet (UV) cutoffs that are necessarily introduced in numerical…

Quantum Physics · Physics 2026-05-18 Romain Piron , Akihito Soeda

Analyzing large-scale time-series network data, such as social media and email communications, poses a significant challenge in understanding social dynamics, detecting anomalies, and predicting trends. In particular, the scalability of…

Social and Information Networks · Computer Science 2024-06-27 Cencheng Shen , Jonathan Larson , Ha Trinh , Xihan Qin , Youngser Park , Carey E. Priebe

In existing communication systems, the channel state information of each UE (user equipment) should be repeatedly estimated when it moves to a new position or another UE takes its place. The underlying ambient information, including the…

Signal Processing · Electrical Eng. & Systems 2019-03-26 Chunxu Jiao , Zhaoyang Zhang , Caijun Zhong , Xiaoming Chen , Zhiyong Feng

We study a multiple-input multiple-output (MIMO) multiple access channel (MAC) from several multi-antenna transmitters to a multi-antenna receiver. The fading channels between the transmitters and the receiver are modeled by random…

Information Theory · Computer Science 2011-05-04 Jakob Hoydis , Romain Couillet , Merouane Debbah