Related papers: A Deep Dive into the Connections Between the Renor…
The renormalization group is the cornerstone of the modern theory of universality and phase transitions, a powerful tool to scrutinize symmetries and organizational scales in dynamical systems. However, its network counterpart is…
We present a generalized framework, renormalized density matrix downfolding (RDMD), to derive systematically improvable, highly accurate, and nonperturbative effective models from ab initio calculations. This framework moves beyond the…
The random-field Ising model shows extreme critical slowdown that has been described by activated dynamic scaling: the characteristic time for the relaxation to equilibrium diverges exponentially with the correlation length, $\ln \tau\sim…
The renormalization group (RG) method is one of the singular perturbation methods which is used in search for asymptotic behavior of solutions of differential equations. In this article, time-independent vector fields and time (almost)…
Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…
As a dedicated quantum device, Ising machines could solve large-scale binary optimization problems in milliseconds. There is emerging interest in utilizing Ising machines to train feedforward neural networks due to the prosperity of…
We present a numerical implementation of the renormalization group (RG) for partial differential equations, constructing similarity solutions and travelling waves. We show that for a large class of well-localized initial conditions,…
We analyze renormalization group (RG) flows in two-dimensional quantum field theories in the presence of redundant directions. We use the operator picture in which redundant operators are total derivatives. Our analysis has three levels of…
Extending the parameter space of the three-dimensional (d=3) Ising model, we search for a regime of eliminated corrections to finite-size scaling. For that purpose, we consider a real-space renormalization group (RSRG) with respect to a…
Renormalization group method is one of the most powerful tool to obtain approximate solutions to differential equations. We apply the renormalization group method to Hamiltonian systems whose integrable parts linearly depend on action…
In this paper, we propose a novel optimization algorithm for training machine learning models called Input Normalized Stochastic Gradient Descent (INSGD), inspired by the Normalized Least Mean Squares (NLMS) algorithm used in adaptive…
Building on the Renormalization Group (RG) method the beam-beam interaction in circular colliders is studied. A regularized symplectic RG beam-beam map, that describes successfully the long-time asymptotic behavior of the original system…
The renormalization group has proven to be a very powerful tool in physics for treating systems with many length scales. Here we show how it can be adapted to provide a new class of algorithms for discrete optimization. The heart of our…
We formally introduce a class of models inspired by renormalization group (RG) theory, built on additive hierarchical expansions analogous to those appearing in functional ANOVA and mixed-effects models. Like ReLU convolutional neural…
Machine learning methods are powerful in distinguishing different phases of matter in an automated way and provide a new perspective on the study of physical phenomena. We train a Restricted Boltzmann Machine (RBM) on data constructed with…
Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…
We suggest a new, renormalization group (RG) based, nonperturbative method for treating the intermittency problem of fully developed turbulence which also includes the effects of a finite boundary of the turbulent flow. The key idea is not…
The numerical renormalization group (NRG) is rephrased as a variational method with the cost function given by the sum of all the energies of the effective low-energy Hamiltonian. This allows to systematically improve the spectrum obtained…
Recent work has shown that standard training via empirical risk minimization (ERM) can produce models that achieve high accuracy on average but low accuracy on underrepresented groups due to the prevalence of spurious features. A…
Recently, the connections between gradient flow and renormalization group have been explored analytically and numerically. Gradient flow (when modified by a field rescaling) can be characterized as a continuous blocking transformation. In…