English
Related papers

Related papers: A New Tensor Network: Tubal Tensor Train and Its A…

200 papers

The oriented singular value decomposition (O-SVD) proposed by Zeng and Ng provides a hybrid approach to the t-product based third-order tensor singular value decomposition with the transform matrix being a factor matrix of the higher order…

Numerical Analysis · Mathematics 2023-02-28 Minghui Ding , Yimin Wei , Pengpeng Xie

Higher-order data with high dimensionality arise in a diverse set of application areas such as computer vision, video analytics and medical imaging. Tensors provide a natural tool for representing these types of data. Although there has…

Signal Processing · Electrical Eng. & Systems 2020-08-04 Seyyid Emre Sofuoglu , Selin Aviyente

Deep neural networks (DNNs) have enabled impressive breakthroughs in various artificial intelligence (AI) applications recently due to its capability of learning high-level features from big data. However, the current demand of DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Bijiao Wu , Dingheng Wang , Guangshe Zhao , Lei Deng , Guoqi Li

A novel tensor decomposition framework, termed Tensor Star (TS) decomposition, is proposed which represents a new type of tensor network decomposition based on tensor contractions. This is achieved by connecting the core tensors in a ring…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Wuyang Zhou , Yu-Bang Zheng , Qibin Zhao , Danilo Mandic

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional function approximations arising from computational and data sciences. Various sequential and parallel TT decomposition algorithms have…

Numerical Analysis · Mathematics 2025-09-05 Tianyi Shi , Daniel Hayes , Jing-Mei Qiu

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

In this paper, we define a semi-tensor product for third-order tensors. Based on this definition, we present a new type of tensor decomposition strategy and give the specific algorithm. This decomposition strategy actually generalizes the…

Numerical Analysis · Mathematics 2023-01-18 Zhuo-Ran Chen , Seak-Weng Vong , Ze-Jia Xie

Recently, a tensor-on-tensor (ToT) regression model has been proposed to generalize tensor recovery, encompassing scenarios like scalar-on-tensor regression and tensor-on-vector regression. However, the exponential growth in tensor…

Machine Learning · Computer Science 2025-05-02 Zhen Qin , Zhihui Zhu

Spiking Neural Networks (SNNs) have gained significant attention as a potentially energy-efficient alternative for standard neural networks with their sparse binary activation. However, SNNs suffer from memory and computation overhead due…

Neural and Evolutionary Computing · Computer Science 2026-03-09 Donghyun Lee , Ruokai Yin , Youngeun Kim , Abhishek Moitra , Yuhang Li , Priyadarshini Panda

We propose a new algorithm for the computation of a singular value decomposition (SVD) low-rank approximation of a matrix in the Matrix Product Operator (MPO) format, also called the Tensor Train Matrix format. Our tensor network randomized…

Numerical Analysis · Mathematics 2017-07-26 Kim Batselier , Wenjian Yu , Luca Daniel , Ngai Wong

Three dimensional convolutional neural networks (3DCNNs) have been applied in many tasks, e.g., video and 3D point cloud recognition. However, due to the higher dimension of convolutional kernels, the space complexity of 3DCNNs is generally…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Dingheng Wang , Guangshe Zhao , Guoqi Li , Lei Deng , Yang Wu

In this paper, we propose a new adaptive cross algorithm for computing a low tubal rank approximation of third-order tensors, with less memory and lower computational complexity than the truncated tensor SVD (t-SVD). This makes it…

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

Unlike 2D raster images, there is no single dominant representation for 3D visual data processing. Different formats like point clouds, meshes, or implicit functions each have their strengths and weaknesses. Still, grid representations such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Mikhail Usvyatsov , Rafael Ballester-Rippoll , Lina Bashaeva , Konrad Schindler , Gonzalo Ferrer , Ivan Oseledets

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional data approximations. In order to represent data with interpretability in data science, researchers develop data-centric skeletonized low…

Numerical Analysis · Mathematics 2026-02-10 Daniel Hayes , Jing-Mei Qiu , Tianyi Shi

Advanced tensor decomposition, such as Tensor train (TT) and Tensor ring (TR), has been widely studied for deep neural network (DNN) model compression, especially for recurrent neural networks (RNNs). However, compressing convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Miao Yin , Yang Sui , Siyu Liao , Bo Yuan

Tensor robust principal component analysis (TRPCA) is a fundamental model in machine learning and computer vision. Recently, tensor train (TT) decomposition has been verified effective to capture the global low-rank correlation for tensor…

Machine Learning · Computer Science 2022-03-14 Yuning Qiu , Guoxu Zhou , Zhenhao Huang , Qibin Zhao , Shengli Xie

Various tensor decomposition methods have been proposed for data compression. In real world applications of the tensor decomposition, selecting the tensor shape for the given data poses a challenge and the shape of the tensor may affect the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Ryan Solgi , Zichang He , William Jiahua Liang , Zheng Zhang

Recently, there has been a lot of research into tensor singular value decomposition (t-SVD) by using discrete Fourier transform (DFT) matrix. The main aims of this paper are to propose and study tensor singular value decomposition based on…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Wen-Hao Xu , Xi-Le Zhao , Michael Ng