English
Related papers

Related papers: StoTAM: Stochastic Alternating Minimization for Tu…

200 papers

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

We consider factoring low-rank tensors in the presence of outlying slabs. This problem is important in practice, because data collected in many real-world applications, such as speech, fluorescence, and some social network data, fit this…

Machine Learning · Statistics 2023-07-19 Xiao Fu , Kejun Huang , Wing-Kin Ma , Nicholas D. Sidiropoulos , Rasmus Bro

Feynman diagrams are an essential tool for simulating strongly correlated electron systems. However, stochastic quantum Monte Carlo sampling suffers from the sign problem, particularly when solving a multiorbital quantum impurity model.…

Strongly Correlated Electrons · Physics 2025-07-28 Hirone Ishida , Natsuki Okada , Shintaro Hoshino , Hiroshi Shinaoka

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during training and inference phases. Given its easy implementation and flexibility, one promising…

Machine Learning · Computer Science 2025-08-22 Emanuele Zangrando , Steffen Schotthöfer , Gianluca Ceruti , Jonas Kusch , Francesco Tudisco

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

Modern technological advances have enabled an unprecedented amount of structured data with complex temporal dependence, urging the need for new methods to efficiently model and forecast high-dimensional tensor-valued time series. This paper…

Methodology · Statistics 2023-09-28 Di Wang , Yao Zheng , Guodong Li

In this paper we accomplish the development of the fast rank-adaptive solver for tensor-structured symmetric positive definite linear systems in higher dimensions. In [arXiv:1301.6068] this problem is approached by alternating minimization…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

The block tensor of trifocal tensors provides crucial geometric information on the three-view geometry of a scene. The underlying synchronization problem seeks to recover camera poses (locations and orientations up to a global…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Daniel Miao , Gilad Lerman , Joe Kileel

What learning algorithms can be run directly on compressively-sensed data? In this work, we consider the question of accurately and efficiently computing low-rank matrix or tensor factorizations given data compressed via random projections.…

Machine Learning · Computer Science 2019-05-28 Vatsal Sharan , Kai Sheng Tai , Peter Bailis , Gregory Valiant

Low-rank tensor decomposition generalizes low-rank matrix approximation and is a powerful technique for discovering low-dimensional structure in high-dimensional data. In this paper, we study Tucker decompositions and use tools from…

Data Structures and Algorithms · Computer Science 2021-07-23 Matthew Fahrbach , Mehrdad Ghadiri , Thomas Fu

Tensors of order three or higher have found applications in diverse fields, including image and signal processing, data mining, biomedical engineering and link analysis, to name a few. In many applications that involve for example time…

Data Structures and Algorithms · Computer Science 2018-09-05 Davoud Ataee Tarzanagh , George Michailidis

Low-rank tensor compression has been proposed as a promising approach to reduce the memory and compute requirements of neural networks for their deployment on edge devices. Tensor compression reduces the number of parameters required to…

Machine Learning · Computer Science 2021-11-03 Cole Hawkins , Haichuan Yang , Meng Li , Liangzhen Lai , Vikas Chandra

Tensor recovery has recently arisen in a lot of application fields, such as transportation, medical imaging and remote sensing. Under the assumption that signals possess sparse and/or low-rank structures, many tensor recovery methods have…

Optimization and Control · Mathematics 2021-02-16 Xuemei Chen , Jing Qin

Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient…

Machine Learning · Computer Science 2023-08-23 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Johan A. K. Suykens

Tensor regression has attracted significant attention in statistical research. This study tackles the challenge of handling covariates with smooth varying structures. We introduce a novel framework, termed functional tensor regression,…

Methodology · Statistics 2025-06-12 Tongyu Li , Fang Yao , Anru R. Zhang

In this paper, we take a step towards developing efficient hard thresholding methods for low-rank tensor recovery from memory-efficient linear measurements with tensorial structure. Theoretical guarantees for many standard iterative…

Numerical Analysis · Mathematics 2025-02-06 Shambhavi Suryanarayanan , Elizaveta Rebrova

Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and high-dimensional nature. Directly handling raw tensors is impractical due to the significant memory and computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Zixuan Li , Mingxing Duan , Huizhang Luo , Wangdong Yang , Kenli Li , Keqin Li

High-dimensional, higher-order tensor data are gaining prominence in a variety of fields, including but not limited to computer vision and network analysis. Tensor factor models, induced from noisy versions of tensor decompositions or…

Methodology · Statistics 2024-12-16 Xu Zhang , Guodong Li , Catherine C. Liu , Jianhua Guo

Low-rank approximation of tensors has been widely used in high-dimensional data analysis. It usually involves singular value decomposition (SVD) of large-scale matrices with high computational complexity. Sketching is an effective data…

Numerical Analysis · Mathematics 2023-01-30 Wandi Dong , Gaohang Yu , Liqun Qi , Xiaohao Cai

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac