English
Related papers

Related papers: Gaussian Information Bottleneck and the Non-Pertur…

200 papers

Discretization of continuous stochastic processes is needed to numerically simulate them or to infer models from experimental time series. However, depending on the nature of the process, the same discretization scheme, if not accurate…

Machine Learning · Statistics 2022-05-04 Federica Ferretti , Victor Chardès , Thierry Mora , Aleksandra M Walczak , Irene Giardina

The information bottleneck problem (IB) of jointly stationary Gaussian sources is considered. A water-filling solution for the IB rate is given in terms of its SNR spectrum and whose rate is attained via frequency domain test-channel…

Information Theory · Computer Science 2022-08-23 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

We consider a modified version of the well-known 2d vdP oscillator with a new non-Hermitian interaction. The usual perturbative approach fails to provide the classical dynamics of the system as the classical solutions become divergent in…

Quantum Physics · Physics 2023-10-31 Biswajit Bhowmick , Rohit Mahendra Shinde , Bhabani Prasad Mandal

The renormalization group (RG) approach is largely responsible for the considerable success which has been achieved in developing a quantitative theory of phase transitions. This work treats the rigorous definition of the RG map for…

Mathematical Physics · Physics 2015-05-14 Mei Yin

The Information Bottleneck (IB) principle has emerged as a promising approach for enhancing the generalization, robustness, and interpretability of deep neural networks, demonstrating efficacy across image segmentation, document clustering,…

Information Theory · Computer Science 2025-04-18 Hanzhe Yang , Youlong Wu , Dingzhu Wen , Yong Zhou , Yuanming Shi

We present real--space renormalization group (RG) calculations of the critical properties of the random--field Ising model on a cubic lattice in three dimensions. We calculate the RG flows in a two--parameter truncation of the Hamiltonian…

Condensed Matter · Physics 2009-10-22 M. E. J. Newman , B. W. Roberts , G. T. Barkema , J. P. Sethna

We investigate the analogy between the renormalization group (RG) and deep neural networks, wherein subsequent layers of neurons are analogous to successive steps along the RG. In particular, we quantify the flow of information by…

High Energy Physics - Theory · Physics 2021-12-22 Johanna Erdmenger , Kevin T. Grosvenor , Ro Jefferson

Radiative symmetry breaking (RSB) is a theoretically appealing framework for the generation of mass scales through quantum effects. It can be successfully implemented in models with extended scalar and gauge sectors. We provide a systematic…

High Energy Physics - Phenomenology · Physics 2018-08-23 Leonardo Chataignier , Tomislav Prokopec , Michael G. Schmidt , Bogumila Swiezewska

The Renormalization Group (RG) methods are still far from being completely understood in quenched disordered systems. In order to gain insight into the nature of the phase transition of these systems, it is common to investigate simple…

Disordered Systems and Neural Networks · Physics 2014-04-02 Aurélien Decelle , Giorgio Parisi , Jacopo Rocchi

Renormalization group has enjoyed successes in other areas of statistical physics. However, its application to turbulence faces several technical difficulties, which have had to be circumvented by uncontrolled approximations. Indeed, in…

Fluid Dynamics · Physics 2007-05-23 David McComb , Jaek-Jin Yang , Alistair Young , Luc Machiels

Diffusion-based generative models represent a forefront direction in generative AI research today. Recent studies in physics have suggested that the renormalization group (RG) can be conceptualized as a diffusion process. This insight…

Disordered Systems and Neural Networks · Physics 2024-03-04 Artan Sheshmani , Yi-Zhuang You , Baturalp Buyukates , Amir Ziashahabi , Salman Avestimehr

We formulate a renormalization group (RG) for the interaction parameters of the general two-body problem and show how a limit cycle emerges in the RG flow if the interaction approaches an inverse square law. This limit cycle generates a…

Statistical Mechanics · Physics 2007-05-23 Erich J. Mueller , Tin-Lun Ho

I review recent work and some new results, performed in collaboration with G. Sierra, on the Real-Space Renormalization group method applied to quantum spin lattice systems mainly in spatial dimensions one and two, and to spin ladders which…

Statistical Mechanics · Physics 2009-10-28 Miguel A. Martin-Delgado

These notes provide a concise introduction to important applications of the renormalization group (RG) in statistical physics. After reviewing the scaling approach and Ginzburg-Landau theory for critical phenomena, Wilson's momentum shell…

Statistical Mechanics · Physics 2015-03-19 Uwe C. Tauber

The density-matrix renormalization-group (DMRG) algorithm is extended to treat time-dependent problems. The method provides a systematic and robust tool to explore out-of-equilibrium phenomena in quantum many-body systems. We illustrate the…

Mesoscale and Nanoscale Physics · Physics 2009-11-07 M. A. Cazalilla , J. B. Marston

The Renormalisation Group (RG) is a systematic procedure used to regularise divergences appearing as artefacts when constructing solutions to a large class of differential problems, whether perturbatively or not. This paper is devoted to…

Mathematical Physics · Physics 2024-02-22 Raphaël Belliard

Information Bottleneck (IB) is a generalization of rate-distortion theory that naturally incorporates compression and relevance trade-offs for learning. Though the original IB has been extensively studied, there has not been much…

Machine Learning · Computer Science 2019-10-08 Thanh T. Nguyen , Jaesik Choi

Implementing the Wilsonian renormalization group (RG) transformation in a nonperturbative way, we construct an effective holographic dual description with an emergent extradimension identified with an RG scale. Taking the large$-N$ limit,…

High Energy Physics - Theory · Physics 2023-03-09 Ki-Seok Kim , Mitsuhiro Nishida , Yoonseok Choun

We introduce an efficient algorithm for reducing bond dimensions in an arbitrary tensor network without changing its geometry. The method is based on a novel, quantitative understanding of local correlations in a network. Together with a…

Strongly Correlated Electrons · Physics 2018-08-23 Markus Hauru , Clement Delcamp , Sebastian Mizera

We systematically study a numerical procedure that reveals the asymptotically self-similar dynamics of solutions of partial differential equations (PDEs). This procedure, based on the renormalization group (RG) theory for PDEs, appeared…

Numerical Analysis · Mathematics 2018-07-12 Gastão A. Braga , Federico C. Furtado , Vincenzo Isaia , Long Lee