Related papers: Criticality & Deep Learning II: Momentum Renormali…
Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their…
According to the available publications, the field theoretical renormalization group (RG) approach in the two-dimensional case gives the critical exponents that differ from the known exact values. This fact was attempted to explain by the…
Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…
In this thesis we investigate the Renormalization Group (RG) approach in finite-dimensional glassy systems, whose critical features are still not well-established, or simply unknown. We focus on spin and structural-glass models built on…
We perform a data-driven dimensionality reduction of the scale-dependent 4-point vertex function characterizing the functional Renormalization Group (fRG) flow for the widely studied two-dimensional $t - t'$ Hubbard model on the square…
Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…
It is explained how field-theoretic methods and the dynamic renormalisation group (RG) can be applied to study the universal scaling properties of systems that either undergo a continuous phase transition or display generic scale…
In this paper a mode of using the Dynamic Renormalization Group (DRG) method is suggested in order to cope with inconsistent results obtained when applying it to a continuous family of one-dimensional nonlocal models. The key observation is…
We propose a new concept upon the renormalization group (RG) procedure for an interacting many-electron correlated system in the framework of natural orbitals, and formulate an algorithm for this RG approach. To demonstrate its…
Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…
We propose a renormalization group (RG) approach to compare and collapse eigenvalue densities of random matrix models of complex systems across different system sizes. The approach is to fix a natural spectral scale by letting the model…
We show that it is possible to use dimensional regularization (DR) beyond the usual $\varepsilon$-expansion in the context of renormalization group (RG) calculations in Critical Phenomena. Based on this fact, we propose a new functional RG…
The phenomenological renormalization group (PRG) has been applied to the study of scaleinvariant phenomena in neuronal data, providing evidence for critical phenomena in the brain. However, it remains unclear how reliably these observed…
These notes provide a concise introduction to important applications of the renormalization group (RG) in statistical physics. After reviewing the scaling approach and Ginzburg-Landau theory for critical phenomena, Wilson's momentum shell…
Regularization plays a vital role in the context of deep learning by preventing deep neural networks from the danger of overfitting. This paper proposes a novel deep learning regularization method named as DL-Reg, which carefully reduces…
The key idea behind the renormalization group (RG) transformation is that properties of physical systems with very different microscopic makeups can be characterized by a few universal parameters. However, finding the optimal RG…
Matrix models of 2D quantum gravity are either exactly solvable for matter of central charge $ c\leq 1, $ or not understood. It would be useful to devise an approximate scheme which would be reasonable for the known cases and could be…
The renormalization group has proven to be a very powerful tool in physics for treating systems with many length scales. Here we show how it can be adapted to provide a new class of algorithms for discrete optimization. The heart of our…
Physical systems differring in their microscopic details often display strikingly similar behaviour when probed at macroscopic scales. Those universal properties, largely determining their physical characteristics, are revealed by the…
We employ the machinery of smooth scaling and coarse-graining of observables, developed recently by us in the context of so-called fluctuation operators (inspired by prior work of Verbeure et al) to make a rigorous renormalisation group…