English
Related papers

Related papers: Towards quantifying information flows: relative en…

200 papers

Theoretical understanding of how deep neural network (DNN) extracts features from input images is still unclear, but it is widely believed that the extraction is performed hierarchically through a process of coarse-graining. It reminds us…

High Energy Physics - Theory · Physics 2018-05-16 Satoshi Iso , Shotaro Shiba , Sumito Yokoo

We compare the roles of fidelity and entanglement in characterizing renormalization group flows and quantum phase transitions. It turns out that the scaling parameter extracted from fidelity for different ground states succeeds to capture…

Statistical Mechanics · Physics 2007-05-23 Huan-Qiang Zhou

Renormalization group (RG) methods, which model the way in which the effective behavior of a system depends on the scale at which it is observed, are key to modern condensed-matter theory and particle physics. We compare the ideas behind…

Quantum Physics · Physics 2013-03-14 Cédric Bény

We establish the irreversibility of renormalization group flows on a pointlike defect inserted in a $d$-dimensional Lorentzian conformal field theory. We identify the impurity entropy $g$ with the quantum relative entropy in two equivalent…

High Energy Physics - Theory · Physics 2023-03-29 Horacio Casini , Ignacio Salazar Landea , Gonzalo Torroba

The Renormalization Group (RG) is a set of methods that have been instrumental in tackling problems involving an infinite number of degrees of freedom. What all these methods have in common -- which is what explains their success -- is that…

Statistical Mechanics · Physics 2020-04-30 Pedro Pessoa , Ariel Caticha

Deep learning is a broad set of techniques that uses multiple layers of representation to automatically learn relevant features directly from structured data. Recently, such techniques have yielded record-breaking results on a diverse set…

Machine Learning · Statistics 2014-10-16 Pankaj Mehta , David J. Schwab

We analyze the renormalization-group (RG) flows of two effective Lagrangians, one for measurement induced transitions of monitored quantum systems and one for entanglement transitions in random tensor networks. These Lagrangians, previously…

Statistical Mechanics · Physics 2024-09-20 Adam Nahum , Kay Joerg Wiese

The Kullback-Leibler divergence or relative entropy is an information-theoretic measure between statistical models that play an important role in measuring a distance between random variables. In the study of complex systems, random fields…

Information Theory · Computer Science 2022-03-25 Alexandre L. M. Levada

In the dynamics of open quantum systems, the backflow of information to the reduced system under study has been suggested as the actual physical mechanism inducing memory and thus leading to non-Markovian quantum dynamics. To this aim, the…

Quantum Physics · Physics 2021-07-21 Nina Megier , Andrea Smirne , Bassano Vacchini

The connectivity index, defined as the number of decoupled components of a separable quantum system, can change under deformations of the Hamiltonian or during the dynamical change of the system under renormalization group flow. Such…

High Energy Physics - Theory · Physics 2015-06-23 Francesco Aprile , Vasilis Niarchos

We consider entropy and relative entropy in Field theory and establish relevant monotonicity properties with respect to the couplings. The relative entropy in a field theory with a hierarchy of renormalization group fixed points ranks the…

High Energy Physics - Theory · Physics 2008-11-26 Jose Gaite , Denjoe O'Connor

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

The boundary entropy log(g) of a critical one-dimensional quantum system (or two-dimensional conformal field theory) is known to decrease under renormalization group (RG) flow of the boundary theory. We study instead the behavior of the…

High Energy Physics - Theory · Physics 2008-11-26 Daniel Green , Michael Mulligan , David Starr

We consider the relative entropy between vacuum states of two different theories: a conformal field theory (CFT), and the CFT perturbed by a relevant operator. By restricting both states to the null Cauchy surface in the causal domain of a…

High Energy Physics - Theory · Physics 2017-04-05 Horacio Casini , Eduardo Teste , Gonzalo Torroba

The concept of distinguishability lies at the heart of quantum information theory. We introduce \textit{left-right relative entropy} as a quantitative measure of distinguishability within the space of boundary states in two-dimensional…

High Energy Physics - Theory · Physics 2026-05-26 Mostafa Ghasemi

Separating relevant and irrelevant information is key to any modeling process or scientific inquiry. Theoretical physics offers a powerful tool for achieving this in the form of the renormalization group (RG). Here we demonstrate a…

Machine Learning · Computer Science 2025-05-14 Jessica N. Howard , Ro Jefferson , Anindita Maiti , Zohar Ringel

Quantum entanglement entropy has a geometric character. This is illustrated by the interpretation of Rindler space or black hole entropy as entanglement entropy. In general, one can define a "geometric entropy", associated with an event…

Quantum Physics · Physics 2007-05-23 Jose Gaite

Deep neural networks (DNNs) exhibit an exceptional capacity for generalization in practical applications. This work aims to capture the effect and benefits of depth for supervised learning via information-theoretic generalization bounds. We…

Machine Learning · Computer Science 2025-05-09 Haiyun He , Ziv Goldfeld

The renormalization group (RG) is a class of theoretical techniques used to explain the collective physics of interacting, many-body systems. It has been suggested that the RG formalism may be useful in finding and interpreting emergent…

Statistical Mechanics · Physics 2022-03-23 Adam G. Kline , Stephanie E. Palmer

Renormalization is often described as the removal or "integrating out" of high energy degrees of freedom. In the context of quantum matter, one might suspect that quantum entanglement provides a sharp way to characterize such a loss of…

Statistical Mechanics · Physics 2015-06-16 Brian Swingle