English
Related papers

Related papers: Multi-layered tensor networks for image classifica…

200 papers

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

In this paper, we propose a compact network called CUNet (compact unsupervised network) to counter the image classification challenge. Different from the traditional convolutional neural networks learning filters by the time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2016-07-07 Le Dong , Ling He , Gaipeng Kong , Qianni Zhang , Xiaochun Cao , Ebroul Izquierdo

Convolutional Neural Networks (CNNs) have advanced significantly in visual representation learning and recognition. However, they face notable challenges in performance and computational efficiency when dealing with real-world, multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Optical and hybrid convolutional neural networks (CNNs) recently have become of increasing interest to achieve low-latency, low-power image classification and computer vision tasks. However, implementing optical nonlinearity is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Anna Wirth-Singh , Jinlin Xiang , Minho Choi , Johannes E. Fröch , Luocheng Huang , Shane Colburn , Eli Shlizerman , Arka Majumdar

Matrix Product States (MPS) are a particular type of one dimensional tensor network states, that have been applied to the study of numerous quantum many body problems. One of their key features is the possibility to describe and encode…

Quantum Physics · Physics 2017-11-02 Ilya Kull , Andras Molnar , Erez Zohar , J. Ignacio Cirac

Machine-learning interatomic potentials (MLIPs) have made a significant contribution to the recent progress in the fields of computational materials and chemistry due to the MLIPs' ability of accurately approximating energy landscapes of…

Computational Physics · Physics 2024-09-20 Max Hodapp , Alexander Shapeev

We present ResMLP, an architecture built entirely upon multi-layer perceptrons for image classification. It is a simple residual network that alternates (i) a linear layer in which image patches interact, independently and identically…

We demonstrate the use of tensor networks for image classification with the TensorNetwork open source library. We explain in detail the encoding of image data into a matrix product state form, and describe how to contract the network in a…

Machine Learning · Computer Science 2019-06-17 Stavros Efthymiou , Jack Hidary , Stefan Leichenauer

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well…

Machine Learning · Computer Science 2020-07-01 Ze-Feng Gao , Song Cheng , Rong-Qiang He , Z. Y. Xie , Hui-Hai Zhao , Zhong-Yi Lu , Tao Xiang

This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and…

Machine Learning · Statistics 2017-08-02 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Pan-sharpening aims to increase the spatial resolution of the low-resolution multispectral (LrMS) image with the guidance of the corresponding panchromatic (PAN) image. Although deep learning (DL)-based pan-sharpening methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mingsong Li , Yikun Liu , Tao Xiao , Yuwen Huang , Gongping Yang

Pooling operations, which can be calculated at low cost and serve as a linear or nonlinear transfer function for data reduction, are found in almost every modern neural network. Countless modern approaches have already tackled replacing the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Wolfgang Fuhl , Enkelejda Kasneci

Neural networks have achieved state of the art results in many areas, supposedly due to parameter sharing, locality, and depth. Tensor networks (TNs) are linear algebraic representations of quantum many-body states based on their…

Machine Learning · Computer Science 2020-11-17 Philip Blagoveschensky , Anh Huy Phan

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Tensor networks are a powerful modeling framework developed for computational many-body physics, which have only recently been applied within machine learning. In this work we utilize a uniform matrix product state (u-MPS) model for…

Machine Learning · Computer Science 2021-04-26 Jacob Miller , Guillaume Rabusseau , John Terilla

Tensor networks, originally designed to address computational problems in quantum many-body physics, have recently been applied to machine learning tasks. However, compared to quantum physics, where the reasons for the success of tensor…

Quantum Physics · Physics 2020-07-14 John Martyn , Guifre Vidal , Chase Roberts , Stefan Leichenauer

Modern approaches to generative modeling of continuous data using tensor networks incorporate compression layers to capture the most meaningful features of high-dimensional inputs. These methods, however, rely on traditional Matrix Product…

Machine Learning · Computer Science 2024-12-11 Danylo Kolesnyk , Yelyzaveta Vodovozova

Tensor networks, a model that originated from quantum physics, has been gradually generalized as efficient models in machine learning in recent years. However, in order to achieve exact contraction, only tree-like tensor networks such as…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Song Cheng , Lei Wang , Pan Zhang

Tensor Networks (TNs) are a computational paradigm used for representing quantum many-body systems. Recent works have shown how TNs can also be applied to perform Machine Learning (ML) tasks, yielding comparable results to standard…

High Energy Physics - Experiment · Physics 2024-09-26 Lorenzo Borella , Alberto Coppi , Jacopo Pazzini , Andrea Stanco , Marco Trenti , Andrea Triossi , Marco Zanetti