English
Related papers

Related papers: Supervised Learning with Quantum-Inspired Tensor N…

200 papers

Originating in quantum physics, tensor networks (TNs) have been widely adopted as exponential machines and parameter decomposers for recognition tasks. Typical TN models, such as Matrix Product States (MPS), have not yet achieved successful…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Chang Nie , Junfang Chen , Yajie Chen

We present a variety of new architectural features and training procedures that we apply to the generative adversarial networks (GANs) framework. We focus on two applications of GANs: semi-supervised learning, and the generation of images…

Machine Learning · Computer Science 2016-06-14 Tim Salimans , Ian Goodfellow , Wojciech Zaremba , Vicki Cheung , Alec Radford , Xi Chen

Tensor network states and methods have erupted in recent years. Originally developed in the context of condensed matter physics and based on renormalization group ideas, tensor networks lived a revival thanks to quantum information theory…

Strongly Correlated Electrons · Physics 2019-09-12 Roman Orus

We implement a quantum generalization of a neural network on trapped-ion and IBM superconducting quantum computers to classify MNIST images, a common benchmark in computer vision. The network feedforward involves qubit rotations whose…

We investigate the potential of tensor network based machine learning methods to scale to large image and text data sets. For that, we study how the mutual information between a subregion and its complement scales with the subsystem size…

Quantum Physics · Physics 2025-03-11 Sirui Lu , Márton Kanász-Nagy , Ivan Kukuljan , J. Ignacio Cirac

Curriculum learning is a bio-inspired training technique that is widely adopted to machine learning for improved optimization and better training of neural networks regarding the convergence rate or obtained accuracy. The main concept in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Fatemeh Azimi , Jean-Francois Jacques Nicolas Nies , Sebastian Palacio , Federico Raue , Jörn Hees , Andreas Dengel

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

In training neural networks, it is common practice to use partial gradients computed over batches, mostly very small subsets of the training set. This approach is motivated by the argument that such a partial gradient is close to the true…

Machine Learning · Computer Science 2024-11-25 Jan Spörer , Bernhard Bermeitinger , Tomas Hrycej , Niklas Limacher , Siegfried Handschuh

Modern approaches to generative modeling of continuous data using tensor networks incorporate compression layers to capture the most meaningful features of high-dimensional inputs. These methods, however, rely on traditional Matrix Product…

Machine Learning · Computer Science 2024-12-11 Danylo Kolesnyk , Yelyzaveta Vodovozova

We develop information geometric techniques to understand the representations learned by deep networks when they are trained on different tasks using supervised, meta-, semi-supervised and contrastive learning. We shed light on the…

Machine Learning · Computer Science 2023-07-25 Rahul Ramesh , Jialin Mao , Itay Griniasty , Rubing Yang , Han Kheng Teoh , Mark Transtrum , James P. Sethna , Pratik Chaudhari

In this paper, we investigate the application of quantum and quantum-inspired machine learning algorithms to stock return predictions. Specifically, we evaluate the performance of quantum neural network, an algorithm suited for noisy…

Machine Learning · Computer Science 2024-02-28 Nozomu Kobayashi , Yoshiyuki Suimon , Koichi Miyamoto , Kosuke Mitarai

The efficient simulation of complex quantum systems remains a central challenge due to the exponential growth of Hilbert space with system size. Tensor network methods have long been established as powerful approximation schemes, and their…

Computational Physics · Physics 2026-03-16 Min Chen , Minzhao Liu , Changhun Oh , Liang Jiang , Yuri Alexeev , Junyu Liu

In many cases, Neural networks can be mapped into tensor networks with an exponentially large bond dimension. Here, we compare different sub-classes of neural network states, with their mapped tensor network counterpart for studying the…

Quantum Physics · Physics 2021-02-09 Mario Collura , Luca Dell'Anna , Timo Felser , Simone Montangero

Tensor networks represent the state-of-the-art in computational methods across many disciplines, including the classical simulation of quantum many-body systems and quantum circuits. Several applications of current interest give rise to…

Quantum Physics · Physics 2021-03-17 Johnnie Gray , Stefanos Kourtis

We introduce a machine learning model, the q-CNN model, sharing key features with convolutional neural networks and admitting a tensor network description. As examples, we apply q-CNN to the MNIST and Fashion MNIST classification tasks. We…

Machine Learning · Computer Science 2021-03-23 Vassilis Anagiannis , Miranda C. N. Cheng

Tensor network (TN), a young mathematical tool of high vitality and great potential, has been undergoing extremely rapid developments in the last two decades, gaining tremendous success in condensed matter physics, atomic physics, quantum…

Computational Physics · Physics 2020-01-31 Shi-Ju Ran , Emanuele Tirrito , Cheng Peng , Xi Chen , Luca Tagliacozzo , Gang Su , Maciej Lewenstein

One key step in performing quantum machine learning (QML) on noisy intermediate-scale quantum (NISQ) devices is the dimension reduction of the input data prior to their encoding. Traditional principle component analysis (PCA) and neural…

Quantum Physics · Physics 2020-12-01 Samuel Yen-Chi Chen , Chih-Min Huang , Chia-Wei Hsing , Ying-Jer Kao

Quantum and quantum-inspired machine learning has emerged as a promising and challenging research field due to the increased popularity of quantum computing, especially with near-term devices. Theoretical contributions point toward…

Quantum Physics · Physics 2023-12-08 C. Moussa , H. Wang , M. Araya-Polo , T. Bäck , V. Dunjko

This paper investigates the learning of 3rd-order tensors representing the semantics of transitive verbs. The meaning representations are part of a type-driven tensor-based semantic framework, from the newly emerging field of compositional…

Computation and Language · Computer Science 2014-02-19 Tamara Polajnar , Luana Fagarasan , Stephen Clark

The embedding layers transforming input words into real vectors are the key components of deep neural networks used in natural language processing. However, when the vocabulary is large, the corresponding weight matrices can be enormous,…

Computation and Language · Computer Science 2020-02-20 Oleksii Hrinchuk , Valentin Khrulkov , Leyla Mirvakhabova , Elena Orlova , Ivan Oseledets