English
Related papers

Related papers: Note on Mutual Information between Two Intervals o…

200 papers

We consider some formulations of the entropy bounds at the semiclassical level. The entropy S(V) localized in a region V is divergent in quantum field theory (QFT). Instead of it we focus on the mutual information I(V,W)=S(V)+S(W)-S(V\cup…

General Relativity and Quantum Cosmology · Physics 2008-11-26 H. Casini

In this paper, we investigate the holographic descriptions of two kinds of black rings, the neutral doubly rotating black ring and the dipole charged black ring. For generic nonextremal black rings, the information of holographic CFT duals,…

High Energy Physics - Theory · Physics 2013-04-10 Bin Chen , Jia-ju Zhang

The conditional mutual information I(X;Y|Z) measures the average information that X and Y contain about each other given Z. This is an important primitive in many learning problems including conditional independence testing, graphical model…

Information Theory · Computer Science 2017-10-16 Arman Rahimzamani , Sreeram Kannan

Shannon-Hartley theorem can accurately calculate the channel capacity when the signal observation time is infinite. However, the calculation of finite-time mutual information, which remains unknown, is essential for guiding the design of…

Information Theory · Computer Science 2022-10-05 Jieao Zhu , Zijian Zhang , Zhongzhichao Wan , Linglong Dai

We study entanglement entropy inequalities in boundary conformal field theory (BCFT) by holographic correspondence. By carefully classifying all the configurations for different phases, we prove the strong subadditiviy and the monogamy of…

High Energy Physics - Theory · Physics 2021-03-17 Chia-Jui Chou , Bo-Han Lin , Bin Wang , Yi Yang

A polynomial approximation is proposed for the mutual acoustic impedance between uncollapsed capacitive micromachined ultrasonic transducer (CMUT) cells with different radii in an infinite rigid baffle. The resulting approximation is…

Classical Physics · Physics 2015-12-18 Alper Ozgurluk , H. Kagan Oguz , Abdullah Atalar , Hayrettin Koymen

Mutual information (MI) is a promising candidate measure for the assessment and optimization of localization systems, as it captures nonlinear dependencies between random variables. However, the high cost of computing MI, especially for…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Sven Hinderer , Manuel Buchfink , Bin Yang

We consider the problem of estimating mutual information between dependent data, an important problem in many science and engineering applications. We propose a data-driven, non-parametric estimator of mutual information in this paper. The…

Information Theory · Computer Science 2017-03-08 Rakesh Malladi , Don H Johnson , Behnaam Aazhang

We elaborate on the method introduced in arXiv:2403.02165 for holographic duals of Boundary Conformal Field Theories (BCFTs) with multiple boundaries. Using these advances we calculate the entanglement entropy as a function of time for…

High Energy Physics - Theory · Physics 2026-02-25 Joseph Lap , Berndt Mueller , Andreas Schaefer , Clemens Seidl

Mutual information is fundamentally important for measuring statistical dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate for…

Information Theory · Computer Science 2014-07-29 Clive G. Bowsher , Margaritis Voliotis

Estimating mutual information accurately is pivotal across diverse applications, from machine learning to communications and biology, enabling us to gain insights into the inner mechanisms of complex systems. Yet, dealing with…

Machine Learning · Computer Science 2024-11-12 Nunzio A. Letizia , Nicola Novello , Andrea M. Tonello

We study generalized free fields (GFF) from the point of view of information measures. We first review conformal GFF, their holographic representation, and the ambiguities in the assignation of algebras to regions that arise in these…

High Energy Physics - Theory · Physics 2023-02-22 Valentin Benedetti , Horacio Casini , Pedro J. Martinez

We investigate cooperative radar and communications signaling. While each system typically considers the other system a source of interference, by considering the radar and communications operations to be a single joint system, the…

Information Theory · Computer Science 2016-11-15 Daniel W. Bliss

The mutual and tripartite information between pairs and triples of disjoint regions in a quantum field theory are sensitive probes of the spread of correlations in an equilibrating system. We compute these quantities in strongly coupled…

High Energy Physics - Theory · Physics 2011-12-05 V. Balasubramanian , A. Bernamonti , N. Copland , B. Craps , F. Galli

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good…

Quantitative Methods · Quantitative Biology 2019-08-14 Caroline M. Holmes , Ilya Nemenman

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

Motivation: Clustering is a frequently used concept in variety of bioinformatical applications. We present a new method for hierarchical clustering of data called mutual information clustering (MIC) algorithm. It uses mutual information…

Quantitative Methods · Quantitative Biology 2007-05-23 Alexander Kraskov , Harald Stögbauer , Ralph G. Andrzejak , Peter Grassberger

Determining the strength of non-linear statistical dependencies between two variables is a crucial matter in many research fields. The established measure for quantifying such relations is the mutual information. However, estimating mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 Damián G. Hernández , Inés Samengo

The entanglement entropy of intervals in $1+1$ interface CFTs is modified in two ways compared to a CFT without interface: there is a finite boundary entropy contribution, and, for an interval with an endpoint at the interface, the…

High Energy Physics - Theory · Physics 2026-05-01 Evangelos Afxonidis , Ignacio Carreño Bolla , Carlos Hoyos , Andreas Karch