English
Related papers

Related papers: Supervised Learning with Quantum-Inspired Tensor N…

200 papers

Tensor networks are factorisations of high rank tensors into networks of lower rank tensors and have primarily been used to analyse quantum many-body problems. Tensor networks have seen a recent surge of interest in relation to supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Raghavendra Selvan , Silas Ørting , Erik B Dam

We solve high-dimensional steady-state Fokker-Planck equations on the whole space by applying tensor neural networks. The tensor networks are a linear combination of tensor products of one-dimensional feedforward networks or a linear…

Numerical Analysis · Mathematics 2024-11-04 Taorui Wang , Zheyuan Hu , Kenji Kawaguchi , Zhongqiang Zhang , George Em Karniadakis

We propose a tensor neural network ($t$-NN) framework that offers an exciting new paradigm for designing neural networks with multidimensional (tensor) data. Our network architecture is based on the $t$-product (Kilmer and Martin, 2011), an…

Machine Learning · Computer Science 2018-11-19 Elizabeth Newman , Lior Horesh , Haim Avron , Misha Kilmer

Training a classifier under non-convex constraints has gotten increasing attention in the machine learning community thanks to its wide range of applications such as algorithmic fairness and class-imbalanced classification. However, several…

Machine Learning · Statistics 2022-10-31 You-Lin Chen , Zhaoran Wang , Mladen Kolar

Convolutional neural networks (CNNs) have gained widespread usage across various fields such as weather forecasting, computer vision, autonomous driving, and medical image analysis due to its exceptional ability to extract spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Alifu Xiafukaiti , Devanshu Garg , Aruto Hosaka , Koichi Yanagisawa , Yuichiro Minato , Tsuyoshi Yoshida

We present an efficient tensor-network-based approach for simulating large-scale quantum circuits, demonstrated using Quantum Support Vector Machines (QSVMs). Our method effectively reduces exponential runtime growth to near-quadratic…

Current Deep Learning approaches have been very successful using convolutional neural networks (CNN) trained on large graphical processing units (GPU)-based computers. Three limitations of this approach are: 1) they are based on a simple…

Neural and Evolutionary Computing · Computer Science 2017-07-17 Thomas E. Potok , Catherine Schuman , Steven R. Young , Robert M. Patton , Federico Spedalieri , Jeremy Liu , Ke-Thia Yao , Garrett Rose , Gangotree Chakma

Artificial neural networks have achieved great success in many fields ranging from image recognition to video understanding. However, its high requirements for computing and memory resources have limited further development on processing…

Quantum Physics · Physics 2021-08-05 Yanxuan Lü , Qing Gao , Jinhu Lü , Maciej Ogorzałek , Jin Zheng

We examine the use of string diagrams and the mathematics of category theory in the description of quantum states by tensor networks. This approach lead to a unification of several ideas, as well as several results and methods that have not…

Quantum Physics · Physics 2015-03-17 Jacob D. Biamonte , Stephen R. Clark , Dieter Jaksch

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

Machine Learning · Computer Science 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

The constantly increasing dimensionality of artificial quantum systems demands for highly efficient methods for their characterization and benchmarking. Conventional quantum tomography fails for larger systems due to the exponential growth…

Quantum Physics · Physics 2023-09-04 Sergei S. Kuzmin , Varvara I. Mikhailova , Ivan V. Dyakonov , Stanislav S. Straupe

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

Sparse neural networks are important for achieving better generalization and enhancing computation efficiency. This paper proposes a novel learning approach to obtain sparse fully connected layers in neural networks (NNs) automatically. We…

Machine Learning · Computer Science 2021-04-28 Mengqiao Han , Xiabi Liu , Zhaoyang Hai , Zhengwen Li

Deep neural networks (DNNs) have delivered a remarkable performance in many tasks of computer vision. However, over-parameterized representations of popular architectures dramatically increase their computational complexity and storage…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Chang Nie , Huan Wang , Lu Zhao

The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human…

Quantum Physics · Physics 2022-04-05 Ben Jaderberg , Lewis W. Anderson , Weidi Xie , Samuel Albanie , Martin Kiffner , Dieter Jaksch

We introduce a change of perspective on tensor network states that is defined by the computational graph of the contraction of an amplitude. The resulting class of states, which we refer to as tensor network functions, inherit the…

Quantum Physics · Physics 2025-01-06 Wen-Yuan Liu , Si-Jing Du , Ruojing Peng , Johnnie Gray , Garnet Kin-Lic Chan

This is a set of lectures on tensor networks with a strong emphasis on the core algorithms involving Matrix Product States (MPS) and Matrix Product Operators (MPO). Compared to other presentations, particular care has been given to…

Quantum Physics · Physics 2026-01-07 Xavier Waintal , Chen-How Huang , Christoph W. Groth

Neural networks are a promising tool for characterizing intermediate-scale quantum devices from limited amounts of measurement data. A challenging problem in this area is to learn the action of an unknown quantum process on an ensemble of…

Quantum Physics · Physics 2023-12-06 Yan Zhu , Ya-Dong Wu , Qiushi Liu , Yuexuan Wang , Giulio Chiribella

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing…

Neural and Evolutionary Computing · Computer Science 2016-09-23 Itay Hubara , Matthieu Courbariaux , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Neural Tensor Networks (NTNs), which are structured to encode the degree of relationship among pairs of entities, are used in Logic Tensor Networks (LTNs) to facilitate Statistical Relational Learning (SRL) in first-order logic. In this…

Machine Learning · Computer Science 2020-10-07 Jinyung Hong , Theodore P. Pavlic