English
Related papers

Related papers: Deep Tree Tensor Networks for Image Recognition

200 papers

The numerical simulation of two-dimensional quantum many-body systems away from equilibrium constitutes a major challenge for all known computational methods. We investigate the utility of Tree Tensor Network (TTN) states to solve the…

Quantum Physics · Physics 2025-05-13 Wladislaw Krinitsin , Niklas Tausendpfund , Markus Heyl , Matteo Rizzi , Markus Schmitt

Merge trees are a valuable tool in the scientific visualization of scalar fields; however, current methods for merge tree comparisons are computationally expensive, primarily due to the exhaustive matching between tree nodes. To address…

Machine Learning · Computer Science 2024-10-07 Yu Qin , Brittany Terese Fasy , Carola Wenk , Brian Summa

Discrete tensor train decomposition is widely employed to mitigate the curse of dimensionality in solving high-dimensional PDEs through traditional methods. However, the direct application of the tensor train method typically requires…

Numerical Analysis · Mathematics 2025-10-16 Yani Feng , Michael K. Ng , Kejun Tang , Zhiwen Zhang

We introduce deep tensor networks, which are exponentially wide neural networks based on the tensor network representation of the weight matrices. We evaluate the proposed method on the image classification (MNIST, FashionMNIST) and…

Machine Learning · Computer Science 2022-09-20 Bojan Žunkovič

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber

This work proposes an interpretable multi-view deep neural network architecture, namely optimal discriminant multi-view tensor convolutional network (ODMTCNet), by integrating statistical machine learning (SML) principles with the deep…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Lei Gao , Zheng Guo , Ling Guan

For the task of subdecimeter aerial imagery segmentation, fine-grained semantic segmentation results are usually difficult to obtain because of complex remote sensing content and optical conditions. Recently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Kai Yue , Lei Yang , Ruirui Li , Wei Hu , Fan Zhang , Wei Li

The exact contraction of a generic two-dimensional (2D) tensor network state (TNS) is known to be exponentially hard, making simulation of 2D systems difficult. The recently introduced class of isometric TNS (isoTNS) represents a subset of…

Strongly Correlated Electrons · Physics 2023-06-13 Yantao Wu , Sajant Anand , Sheng-Hsuan Lin , Frank Pollmann , Michael P. Zaletel

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

Machine Learning · Computer Science 2022-05-26 Wei Zhang , Yu Bao

It is well known that tensor network regression models operate on an exponentially large feature space, but questions remain as to how effectively they are able to utilize this space. Using a polynomial featurization, we propose the…

Machine Learning · Computer Science 2023-01-27 Ian Convy , K. Birgitta Whaley

Deep Neural Networks (DNNs) can be represented as graphs whose links and vertices iteratively process data and solve tasks sub-optimally. Complex Network Theory (CNT), merging statistical physics with graph theory, provides a method for…

Machine Learning · Computer Science 2024-04-19 Emanuele La Malfa , Gabriele La Malfa , Giuseppe Nicosia , Vito Latora

Recurrent neural networks (RNNs) are powerful tools for sequential modeling, but typically require significant overparameterization and regularization to achieve optimal performance. This leads to difficulties in the deployment of large…

Machine Learning · Computer Science 2021-11-11 Charles C. Onu , Jacob E. Miller , Doina Precup

We introduce in this paper the principle of Deep Temporal Networks that allow to add time to convolutional networks by allowing deep integration principles not only using spatial information but also increasingly large temporal window. The…

Neural and Evolutionary Computing · Computer Science 2018-11-20 Marco Macanovic , Fabian Chersi , Felix Rutard , Sio-Hoi Ieng , Ryad Benosman

In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor…

Machine Learning · Computer Science 2021-03-31 M. Nazareth da Costa , R. Attux , A. Cichocki , J. M. T. Romano

Variational Quantum Algorithms (VQAs) are being highlighted as key quantum algorithms for demonstrating quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) devices, which are limited to executing shallow quantum circuits because of…

Quantum Physics · Physics 2025-02-03 Shota Sugawara , Kazuki Inomata , Tsuyoshi Okubo , Synge Todo

Partial differential equations (PDEs) are indispensable for modeling many physical phenomena and also commonly used for solving image processing tasks. In the latter area, PDE-based approaches interpret image data as discretizations of…

Machine Learning · Computer Science 2018-12-12 Lars Ruthotto , Eldad Haber

This paper examines the use of tensor networks, which can efficiently represent high-dimensional quantum states, in language modeling. It is a distillation and continuation of the work done in (van der Poel, 2023). To do so, we will…

Machine Learning · Computer Science 2024-03-21 Constantijn van der Poel , Dan Zhao

Tensor network (TN) representation is a powerful technique for computer vision and machine learning. TN structure search (TN-SS) aims to search for a customized structure to achieve a compact representation, which is a challenging NP-hard…

Machine Learning · Computer Science 2024-04-15 Yu-Bang Zheng , Xi-Le Zhao , Junhua Zeng , Chao Li , Qibin Zhao , Heng-Chao Li , Ting-Zhu Huang

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown

We investigate quantum-inspired tensor networks (QTNs) for approximating flow maps of hydrodynamic partial differential equations (PDEs). Motivated by the effective low-rank structure that emerges after tensorization of discretized…

Numerical Analysis · Mathematics 2026-02-19 Nahid Binandeh Dehaghani , Ban Q. Tran , Rafal Wisniewski , Susan Mengel , A. Pedro Aguiar