English
Related papers

Related papers: Renormalization in the neural network-quantum fiel…

200 papers

On the lattice, a renormalization group (RG) flow for two-dimensional partition functions expressed as a tensor network can be obtained using the tensor network renormalization (TNR) algorithm [G. Evenbly, G. Vidal, Phys. Rev. Lett. 115…

High Energy Physics - Theory · Physics 2018-09-17 Qi Hu , Adrian Franco-Rubio , Guifre Vidal

In this paper I argue that infinities in the classical computation theory such as the unsolvability of the Halting Problem can be addressed in the same way as Feynman divergences in Quantum Field Theory, and that meaningful versions of…

Quantum Algebra · Mathematics 2009-08-25 Yuri I. Manin

We propose a theoretical understanding of neural networks in terms of Wilsonian effective field theory. The correspondence relies on the fact that many asymptotic neural networks are drawn from Gaussian processes, the analog of…

Machine Learning · Computer Science 2021-03-16 James Halverson , Anindita Maiti , Keegan Stoner

We present a post-training quantization algorithm with error estimates relying on ideas originating from frame theory. Specifically, we use first-order Sigma-Delta ($\Sigma\Delta$) quantization for finite unit-norm tight frames to quantize…

Machine Learning · Computer Science 2024-04-15 Wojciech Czaja , Sanghoon Na

Quantized neural networks have drawn a lot of attention as they reduce the space and computational complexity during the inference. Moreover, there has been folklore that quantization acts as an implicit regularizer and thus can improve the…

Machine Learning · Computer Science 2022-06-14 Kaiqi Zhang , Ming Yin , Yu-Xiang Wang

The geometric renormalization technique for complex networks has successfully revealed the multiscale self-similarity of real network topologies and can be applied to generate replicas at different length scales. In this letter, we extend…

Physics and Society · Physics 2023-07-04 Muhua Zheng , Guillermo García-Pérez , Marián Boguñá , M. Ángeles Serrano

The first renormalisable quantum field theories on non-commutative space have been found recently. We review this rapidly growing subject.

High Energy Physics - Theory · Physics 2007-05-23 Vincent Rivasseau , Fabien Vignes-Tourneret

Nonrenormalizable quantum field theories require counterterms; and based on the hard-core interpretation of such interactions, it is initially argued, contrary to the standard view, that counterterms suggested by renormalized perturbation…

High Energy Physics - Theory · Physics 2008-11-26 John R. Klauder

We explicitly construct the quantum field theory corresponding to a general class of deep neural networks encompassing both recurrent and feedforward architectures. We first consider the mean-field theory (MFT) obtained as the leading…

High Energy Physics - Theory · Physics 2022-01-27 Kevin T. Grosvenor , Ro Jefferson

Both the path integral measure in field theory and ensembles of neural networks describe distributions over functions. When the central limit theorem can be applied in the infinite-width (infinite-$N$) limit, the ensemble of networks…

High Energy Physics - Theory · Physics 2023-12-15 Mehmet Demirtas , James Halverson , Anindita Maiti , Matthew D. Schwartz , Keegan Stoner

We discuss motivation and goals of renormalization analyses of group field theory models of simplicial 4d quantum gravity, and review briefly the status of this research area. We present some new computations of perturbative GFT (spin foam)…

High Energy Physics - Theory · Physics 2021-05-07 Marco Finocchiaro , Daniele Oriti

Standard entropy calculations in quantum field theory, when applied to a subsystem of definite volume, exhibit area-dependent UV divergences that make a thermodynamic interpretation troublesome. In this paper we define a renormalized…

High Energy Physics - Theory · Physics 2009-01-28 Sergio Cacciatori , Fabio Costa , Federico Piazza

While neural networks have been remarkably successful in a wide array of applications, implementing them in resource-constrained hardware remains an area of intense research. By replacing the weights of a neural network with quantized…

Machine Learning · Computer Science 2023-01-18 Jinjie Zhang , Yixuan Zhou , Rayan Saab

The observed IR and the spectator UV particles of a regulated, cutoff quantum field theory are entangled by their interactions; hence, the IR sector can be described by the help of the density matrix only. The tree-level renormalized…

High Energy Physics - Theory · Physics 2016-02-17 S. Nagy , J. Polonyi , I. Steib

This work is concerned with phrasing the concepts of fault-tolerant quantum computation within the framework of disordered systems, Bernoulli site percolation in particular. We show how the so-called "threshold theorems" on the possibility…

Quantum Physics · Physics 2007-05-23 Maxim Raginsky

We provide a non-technical overview of recent extensions of renormalization methods and techniques to Group Field Theories (GFTs), a class of combinatorially non-local quantum field theories which generalize matrix models to dimension $d…

General Relativity and Quantum Cosmology · Physics 2016-07-19 Sylvain Carrozza

The study of deep neural networks (DNNs) in the infinite-width limit, via the so-called neural tangent kernel (NTK) approach, has provided new insights into the dynamics of learning, generalization, and the impact of initialization. One key…

Machine Learning · Computer Science 2021-06-16 Sina Alemohammad , Zichao Wang , Randall Balestriero , Richard Baraniuk

Compression is a key step to deploy large neural networks on resource-constrained platforms. As a popular compression technique, quantization constrains the number of distinct weight values and thus reducing the number of bits required to…

Machine Learning · Computer Science 2019-01-15 Yukun Ding , Jinglan Liu , Jinjun Xiong , Yiyu Shi

Neural-network quantum states (NQS) are powerful neural-network ans\"atzes that have emerged as promising tools for studying quantum many-body physics through the lens of the variational principle. These architectures are known to be…

Disordered Systems and Neural Networks · Physics 2025-07-28 Jake McNaughton , Mohamed Hibat-Allah

We demonstrate the renormalisability of quantum field theories in four dimensions with elementary self-interacting Dirac fermions and to leading order in the limit of many fermion flavours $N_{\rm f}$. Starting from the underlying…

High Energy Physics - Theory · Physics 2026-03-25 Charlie Cresswell-Hogg , Daniel F. Litim