中文
相关论文

相关论文: A Multi-Scale Tensor Network Architecture for Clas…

200 篇论文

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well…

机器学习 · 计算机科学 2020-07-01 Ze-Feng Gao , Song Cheng , Rong-Qiang He , Z. Y. Xie , Hui-Hai Zhao , Zhong-Yi Lu , Tao Xiang

We propose a novel technique for faster deep neural network training which systematically applies sample-based approximation to the constituent tensor operations, i.e., matrix multiplications and convolutions. We introduce new sampling…

机器学习 · 计算机科学 2021-10-27 Menachem Adelman , Kfir Y. Levy , Ido Hakimi , Mark Silberstein

Tensor Networks are non-trivial representations of high-dimensional tensors, originally designed to describe quantum many-body systems. We show that Tensor Networks are ideal vehicles to connect quantum mechanical concepts to machine…

高能物理 - 唯象学 · 物理学 2021-09-09 Jack Y. Araz , Michael Spannowsky

The embedding layers transforming input words into real vectors are the key components of deep neural networks used in natural language processing. However, when the vocabulary is large, the corresponding weight matrices can be enormous,…

计算与语言 · 计算机科学 2020-02-20 Oleksii Hrinchuk , Valentin Khrulkov , Leyla Mirvakhabova , Elena Orlova , Ivan Oseledets

In recent years, interest in expressing the success of neural networks to the quantum computing has increased significantly. Tensor network theory has become increasingly popular and widely used to simulate strongly entangled correlated…

量子物理 · 物理学 2019-05-07 Amandeep Singh Bhatia , Mandeep Kaur Saggi , Ajay Kumar , Sushma Jain

A tensor network is a type of decomposition used to express and approximate large arrays of data. A given data-set, quantum state or higher dimensional multi-linear map is factored and approximated by a composition of smaller multi-linear…

量子物理 · 物理学 2022-07-08 Richik Sengupta , Soumik Adhikary , Ivan Oseledets , Jacob Biamonte

In this article two new algorithms are presented that convert a given data tensor train into either a Tucker decomposition with orthogonal matrix factors or a multi-scale entanglement renormalization ansatz (MERA). The Tucker core tensor is…

数值分析 · 数学 2019-12-23 Kim Batselier , Andrzej Cichocki , Ngai Wong

Recently proposed techniques for semi-supervised learning such as Temporal Ensembling and Mean Teacher have achieved state-of-the-art results in many important classification benchmarks. In this work, we expand the Mean Teacher approach to…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Christian S. Perone , Julien Cohen-Adad

With the increasing adoption of machine learning tools like neural networks across several domains, interesting connections and comparisons to concepts from other domains are coming to light. In this work, we focus on the class of Tensor…

机器学习 · 计算机科学 2020-04-22 Raghavendra Selvan , Erik B Dam

SAR image classification naturally has to deal with huge noise and a high dynamic range particularly requiring robust classification models. Additionally, the deployment of these models on edge devices, such as drones and military aircraft,…

Once developed for quantum theory, tensor networks have been established as a successful machine learning paradigm. Now, they have been ported back to the quantum realm in the emerging field of quantum machine learning to assess problems…

量子物理 · 物理学 2023-08-09 Hans-Martin Rieser , Frank Köster , Arne Peter Raulf

The interest in machine learning with tensor networks has been growing rapidly in recent years. We show that tensor-based methods developed for learning the governing equations of dynamical systems from data can, in the same way, be used…

机器学习 · 计算机科学 2019-12-02 Stefan Klus , Patrick Gelß

We demonstrate the use of matrix product state (MPS) models for discriminating quantum data on quantum computers using holographic algorithms, focusing on classifying a translationally invariant quantum state based on $L$ qubits of quantum…

量子物理 · 物理学 2022-07-13 Michael L. Wall , Paraj Titum , Gregory Quiroz , Michael Foss-Feig , Kaden R. A. Hazzard

We propose a new neural network framework, termed Neural Network Machine Regression (NNMR), which integrates trainable input gating and adaptive depth regularization to jointly perform feature selection and function estimation in an…

统计方法学 · 统计学 2026-02-03 Jiuchen Zhang , Ling Zhou , Peter Song

Convolutional neural networks typically consist of many convolutional layers followed by one or more fully connected layers. While convolutional layers map between high-order activation tensors, the fully connected layers operate on…

We introduce a tensor-based model of shared representation for meta-learning from a diverse set of tasks. Prior works on learning linear representations for meta-learning assume that there is a common shared representation across different…

机器学习 · 计算机科学 2022-01-20 Samuel Deng , Yilin Guo , Daniel Hsu , Debmalya Mandal

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

机器学习 · 计算机科学 2019-05-28 Cole Hawkins , Zheng Zhang

We consider dense, associative neural-networks trained by a teacher (i.e., with supervision) and we investigate their computational capabilities analytically, via statistical-mechanics of spin glasses, and numerically, via Monte Carlo…

Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum…

统计力学 · 物理学 2018-07-20 Zhao-Yu Han , Jun Wang , Heng Fan , Lei Wang , Pan Zhang

Tensor networks, originally designed to address computational problems in quantum many-body physics, have recently been applied to machine learning tasks. However, compared to quantum physics, where the reasons for the success of tensor…

量子物理 · 物理学 2020-07-14 John Martyn , Guifre Vidal , Chase Roberts , Stefan Leichenauer