Related papers: Variational boundary based tensor network renormal…
We propose a novel fine-grained quantization (FGQ) method to ternarize pre-trained full precision models, while also constraining activations to 8 and 4-bits. Using this method, we demonstrate a minimal loss in classification accuracy on…
The full-density-matrix numerical renormalization group (NRG) has evolved as a systematic and transparent setting for the cal- culation of thermodynamical quantities at arbitrary temperatures within the NRG framework. It directly evaluates…
In this paper, we study multi-dimensional image recovery. Recently, transform-based tensor nuclear norm minimization methods are considered to capture low-rank tensor structures to recover third-order tensors in multi-dimensional image…
The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn…
We review the basic ideas of the Tensor Renormalization Group method and show how they can be applied for lattice field theory models involving relativistic fermions and Grassmann variables in arbitrary dimensions. We discuss recent…
Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…
Deep neural networks have demonstrated state-of-the-art performance in a variety of real-world applications. In order to obtain performance gains, these networks have grown larger and deeper, containing millions or even billions of…
Tensor networks (TNs) have become one of the most essential building blocks for various fields of theoretical physics such as condensed matter theory, statistical mechanics, quantum information, and quantum gravity. This review provides a…
Deep neural networks typically impose significant computational loads and memory consumption. Moreover, the large parameters pose constraints on deploying the model on edge devices such as embedded systems. Tensor decomposition offers a…
Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…
A Gibbs operator $e^{-\beta H}$ for a 2D lattice system with a Hamiltonian $H$ can be represented by a 3D tensor network, the third dimension being the imaginary time (inverse temperature) $\beta$. Coarse-graining the network along $\beta$…
In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…
We study a renormalization group (RG) map for tensor networks that include two-dimensional lattice spin systems such as the Ising model. Numerical studies of such RG maps have been quite successful at reproducing the known critical…
We make Kadanoff's block idea into a reliable three-dimensional (3D) real space renormalization group (RG) method. Kadanoff's idea, expressed in spin representation, offers a qualitative intuition for clarifying scaling behavior in…
We show that numerical quasi-one-dimensional renormalization group allows accurate study of weakly coupled chains with modest computational effort. We perform a systematic comparison with exact diagonalization results in two and three-leg…
In recent studies, several asymptotic upper bounds on generalization errors on deep neural networks (DNNs) are theoretically derived. These bounds are functions of several norms of weights of the DNNs, such as the Frobenius and spectral…
Deep learning is a broad set of techniques that uses multiple layers of representation to automatically learn relevant features directly from structured data. Recently, such techniques have yielded record-breaking results on a diverse set…
We show that artificial neural networks (ANNs) can, to high accuracy, determine the topological invariant of a disordered system given its two-dimensional real-space Hamiltonian. Furthermore, we describe a "renormalization-group" (RG)…
Cet article se veut un survol des r\'eseaux de tenseurs et s'adresse aux d\'ebutants en la mati\`ere. Nous y mettons l'accent sur les outils n\'ecessaires \`a l'impl\'ementation concr\`ete d'algorithmes. Quatre op\'erations de base…
Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…