English
Related papers

Related papers: TensorNet: Cartesian Tensor Representations for Ef…

200 papers

We propose a tensor network encoding the set of all eigenstates of a fully many-body localized system in one dimension. Our construction, conceptually based on the ansatz introduced in Phys. Rev. B 94, 041116(R) (2016), is built from two…

Disordered Systems and Neural Networks · Physics 2017-05-17 Thorsten B. Wahl , Arijeet Pal , Steven H. Simon

Tensor network (TN), a young mathematical tool of high vitality and great potential, has been undergoing extremely rapid developments in the last two decades, gaining tremendous success in condensed matter physics, atomic physics, quantum…

Computational Physics · Physics 2020-01-31 Shi-Ju Ran , Emanuele Tirrito , Cheng Peng , Xi Chen , Luca Tagliacozzo , Gang Su , Maciej Lewenstein

The central question in representation learning is what constitutes a good or meaningful representation. In this work we argue that if we consider data with inherent cluster structures, where clusters can be characterized through different…

Machine Learning · Computer Science 2022-12-05 Pascal Mattia Esser , Satyaki Mukherjee , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

In this paper we review basic and emerging models and associated algorithms for large-scale tensor networks, especially Tensor Train (TT) decompositions using novel mathematical and graphical representations. We discus the concept of…

Numerical Analysis · Computer Science 2014-08-25 Andrzej Cichocki

Tensor network formalisms have emerged as powerful tools for simulating quantum state evolution. While widely applied in the study of optical quantum circuits, such as Boson Sampling, existing tensor network approaches fail to address the…

Quantum Physics · Physics 2026-05-18 Dario Cilluffo , Matthias Kost , Nicola Lorenzoni , Martin B. Plenio

The prediction of periodical time-series remains challenging due to various types of data distortions and misalignments. Here, we propose a novel model called Temporal embedding-enhanced convolutional neural Network (TeNet) to learn…

Machine Learning · Computer Science 2022-02-09 Jiajun Liu , Kun Zhao , Brano Kusy , Ji-rong Wen , Raja Jurdak

Accelerating tensor applications on spatial architectures provides high performance and energy-efficiency, but requires accurate performance models for evaluating various dataflow alternatives. Such modeling relies on the notation of tensor…

Hardware Architecture · Computer Science 2021-05-06 Liqiang Lu , Naiqing Guan , Yuyue Wang , Liancheng Jia , Zizhang Luo , Jieming Yin , Jason Cong , Yun Liang

Embedding models have become essential tools in both natural language processing and computer vision, enabling efficient semantic search, recommendation, clustering, and more. However, the high memory and computational demands of…

Computation and Language · Computer Science 2024-11-26 Jiayi Chen , Chen Wu , Shaoqun Zhang , Nan Li , Liangjie Zhang , Qi Zhang

We introduce complex-valued tensor network models for sequence processing motivated by correspondence to probabilistic graphical models, interpretability and resource compression. Inductive bias is introduced to our models via network…

Quantum Physics · Physics 2023-08-16 Carys Harvey , Richie Yeung , Konstantinos Meichanetzidis

In this work, we present tensor-based linear and nonlinear models for hyperspectral data classification and analysis. By exploiting principles of tensor algebra, we introduce new classification architectures, the weight parameters of which…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Konstantinos Makantasis , Anastasios Doulamis , Nikolaos Doulamis , Antonis Nikitakis

While tensor networks have their traditional application in simulating quantum systems, in the recent decade they have gathered interest as machine learning models. We combine the experience from both fields and derive how quantum…

Quantum Physics · Physics 2026-05-05 Gustav J L Jäger , Krzysztof Bieniasz , Martin B Plenio , Hans-Martin Rieser

Tensor Networks have emerged as a prominent alternative to neural networks for addressing Machine Learning challenges in foundational sciences, paving the way for their applications to real-life problems. This paper introduces tn4ml, a…

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well…

Machine Learning · Computer Science 2020-07-01 Ze-Feng Gao , Song Cheng , Rong-Qiang He , Z. Y. Xie , Hui-Hai Zhao , Zhong-Yi Lu , Tao Xiang

This paper introduces a new model to learn graph neural networks equivariant to rotations, translations, reflections and permutations called E(n)-Equivariant Graph Neural Networks (EGNNs). In contrast with existing methods, our work does…

Machine Learning · Computer Science 2022-02-17 Victor Garcia Satorras , Emiel Hoogeboom , Max Welling

This chapter discusses the importance of incorporating three-dimensional symmetries in the context of statistical learning models geared towards the interpolation of the tensorial properties of atomic-scale structures. We focus on Gaussian…

Chemical Physics · Physics 2019-04-04 Andrea Grisafi , David M. Wilkins , Michael J. Willatt , Michele Ceriotti

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge