Related papers: Misanthropic Entropy and Renormalization as a Comm…
Renormalization is an essential technique in field-theoretic descriptions of natural phenomena, where the absence of a UV-complete description yields an abundance of divergent quantities. While the renormalization prescription has been…
We present a possible approach to the study of the renormalization group (RG) flow based entirely on the information theory. The average information loss under a single step of Wilsonian RG transformation is evaluated as a conditional…
There is a vast body of recent literature on the reliability of communication through noisy channels, the recovery of community structures in the stochastic block model, the limiting behavior of the free entropy in spin glasses and the…
We introduce a "renormalized entanglement entropy" which is intrinsically UV finite and is most sensitive to the degrees of freedom at the scale of the size R of the entangled region. We illustrated the power of this construction by showing…
We investigate the analogy between the renormalization group (RG) and deep neural networks, wherein subsequent layers of neurons are analogous to successive steps along the RG. In particular, we quantify the flow of information by…
We consider the formalism of information decomposition of target effects from multi-source interactions, i.e. the problem of defining redundant and synergistic components of the information that a set of source variables provides about a…
The observed IR and the spectator UV particles of a regulated, cutoff quantum field theory are entangled by their interactions; hence, the IR sector can be described by the help of the density matrix only. The tree-level renormalized…
We propose a general formulation of the renormalisation group as a family of quantum channels which connect the microscopic physical world to the observable world at some scale. By endowing the set of quantum states with an operationally…
We explore the connection between deep learning and information theory through the paradigm of diffusion models. A diffusion model converts noise into structured data by reinstating, imperfectly, information that is erased when data was…
The functional renormalization group flow of a scalar field theory with quartic couplings and a sharp spatial momentum cutoff is presented in four-dimensional Minkowski space-time for the bare action by retaining the entanglement of the IR…
We consider optical communications with intensity modulation and direct detection affected by laser relative intensity noise (RIN). Starting from a continuous-time waveform model, we derive an equivalent discrete-time channel model. As a…
The density matrix renormalization group (DMRG) has been extended to study quantum phase transitions on random graphs of fixed connectivity. As a relevant example, we have analysed the random Ising model in a transverse field. If the…
Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…
The renormalization group (RG) approach is largely responsible for the considerable success that has been achieved in developing a quantitative theory of phase transitions. Physical properties emerge from spectral properties of the…
Quantum entanglement entropy has a geometric character. This is illustrated by the interpretation of Rindler space or black hole entropy as entanglement entropy. In general, one can define a "geometric entropy", associated with an event…
The renormalization group (RG) is an essential technique in statistical physics and quantum field theory, which considers scale-invariant properties of physical theories and how these theories' parameters change with scaling. Deep learning…
We have adjusted the Density Matrix Renormalization method to handle two dimensional systems of limited width. The key ingredient for this extension is the incorporation of symmetries in the method. The advantage of our approach is that we…
We consider the approach describing glass formation in liquids as a progressive trapping in an exponentially large number of metastable states. To go beyond the mean-field setting, we provide a real-space renormalization group (RG) analysis…
In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…
We investigate the fundamental limits of reliable communication over multi-view channels, in which the channel output is comprised of a large number of independent noisy views of a transmitted symbol. We consider first the setting of…