English
Related papers

Related papers: SVDinsTN: A Tensor Network Paradigm for Efficient …

200 papers

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

Machine Learning · Computer Science 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

We propose a new fast streaming algorithm for the tensor completion problem of imputing missing entries of a low-tubal-rank tensor using the tensor singular value decomposition (t-SVD) algebraic framework. We show the t-SVD is a…

Signal Processing · Electrical Eng. & Systems 2022-04-18 Kyle Gilman , Davoud Ataee Tarzanagh , Laura Balzano

Tensor network (TN), a young mathematical tool of high vitality and great potential, has been undergoing extremely rapid developments in the last two decades, gaining tremendous success in condensed matter physics, atomic physics, quantum…

Computational Physics · Physics 2020-01-31 Shi-Ju Ran , Emanuele Tirrito , Cheng Peng , Xi Chen , Luca Tagliacozzo , Gang Su , Maciej Lewenstein

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

Methodology · Statistics 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

Recurrent Neural Network (RNN) are a popular choice for modeling temporal and sequential tasks and achieve many state-of-the-art performance on various complex problems. However, most of the state-of-the-art RNNs have millions of parameters…

Machine Learning · Computer Science 2017-10-31 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

2. In Section 3, we used some vague statements to affirm the training process of the neural network, which cannot support others to reproduce the results of the paper. In addition, this section does not show the difference between this…

Optimization and Control · Mathematics 2020-07-01 Liang Xue , Jie Liu , Guilin Wen , Hongxin Wang

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Currently, low-rank tensor completion has gained cumulative attention in recovering incomplete visual data whose partial elements are missing. By taking a color image or video as a three-dimensional (3D) tensor, previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Shengke Xue , Wenyuan Qiu , Fan Liu , Xinyu Jin

The exact contraction of a generic two-dimensional (2D) tensor network state (TNS) is known to be exponentially hard, making simulation of 2D systems difficult. The recently introduced class of isometric TNS (isoTNS) represents a subset of…

Strongly Correlated Electrons · Physics 2023-06-13 Yantao Wu , Sajant Anand , Sheng-Hsuan Lin , Frank Pollmann , Michael P. Zaletel

Tensor networks provide an efficient approximation of operations involving high dimensional tensors and have been extensively used in modelling quantum many-body systems. More recently, supervised learning has been attempted with tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Raghavendra Selvan , Erik B Dam , Jens Petersen

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format. Although hybrid convolutional neural network (CNN)-transformer architecture is widely used in existing approaches, linear projection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Current CNN-based infrared small target detection(IRSTD) methods generally overlook the heterogeneity between shallow and deep features, leading to inefficient collaboration between shallow fine grained structural information and deep…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Taoran Yue , Xiaojin Lu , Jiaxi Cai , Yuanping Chen , Shibing Chu

Recent studies shows that the majority of existing deep steganalysis models have a large amount of redundancy, which leads to a huge waste of storage and computing resources. The existing model compression method cannot flexibly compress…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Shunquan Tan , Qiushi Li , Laiyuan Li , Bin Li , Jiwu Huang

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

Recent findings indicate that over-parametrization, while crucial for successfully training deep neural networks, also introduces large amounts of redundancy. Tensor methods have the potential to efficiently parametrize over-complete…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Jean Kossaifi , Adrian Bulat , Georgios Tzimiropoulos , Maja Pantic

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional data approximations. In order to represent data with interpretability in data science, researchers develop data-centric skeletonized low…

Numerical Analysis · Mathematics 2026-02-10 Daniel Hayes , Jing-Mei Qiu , Tianyi Shi

The state-of-the-art deep neural networks (DNNs) have been widely applied for various real-world applications, and achieved significant performance for cognitive problems. However, the increment of DNNs' width and depth in architecture…

Machine Learning · Computer Science 2021-11-15 Xiao Peng Li , Qi Liu , Hing Cheung So