English
Related papers

Related papers: Tracking Tensor Ring Decompositions of Streaming T…

200 papers

Nearest-neighbor search in large vector databases is crucial for various machine learning applications. This paper introduces a novel method using tensor-train (TT) low-rank tensor decomposition to efficiently represent point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Georgii Novikov , Alexander Gneushev , Alexey Kadeishvili , Ivan Oseledets

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have…

Machine Learning · Computer Science 2016-02-16 Cheng Tai , Tong Xiao , Yi Zhang , Xiaogang Wang , Weinan E

In this paper, we develop a method which we call OnlineGCP for computing the Generalized Canonical Polyadic (GCP) tensor decomposition of streaming data. GCP differs from traditional canonical polyadic (CP) tensor decompositions as it…

Numerical Analysis · Mathematics 2021-10-28 Eric Phipps , Nick Johnson , Tamara G. Kolda

Tensor trains are a versatile tool to compress and work with high-dimensional data and functions. In this work we introduce the Streaming Tensor Train Approximation (STTA), a new class of algorithms for approximating a given tensor…

Numerical Analysis · Mathematics 2022-08-05 Daniel Kressner , Bart Vandereycken , Rik Voorhaar

In this paper we study the set of tensors that admit a special type of decomposition called an orthogonal tensor train decomposition. Finding equations defining varieties of low-rank tensors is generally a hard problem, however, the set of…

Algebraic Geometry · Mathematics 2021-11-01 Pardis Semnani , Elina Robeva

In this paper, we propose Neural Spectrum Decomposition, a generic decomposition framework for dataset distillation. Unlike previous methods, we consider the entire dataset as a high-dimensional observation that is low-rank across all…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shaolei Yang , Shen Cheng , Mingbo Hong , Haoqiang Fan , Xing Wei , Shuaicheng Liu

In this paper, we aim at the problem of tensor data completion. Tensor-train decomposition is adopted because of its powerful representation ability and linear scalability to tensor order. We propose an algorithm named Sparse Tensor-train…

Numerical Analysis · Computer Science 2018-03-23 Longhao Yuan , Qibin Zhao , Jianting Cao

We study the low-rank phase retrieval problem, where the objective is to recover a sequence of signals (typically images) given the magnitude of linear measurements of those signals. Existing solutions involve recovering a matrix…

Image and Video Processing · Electrical Eng. & Systems 2022-02-18 Soo Min Kwon , Xin Li , Anand D. Sarwate

Low rank tensor ring model is powerful for image completion which recovers missing entries in data acquisition and transformation. The recently proposed tensor ring (TR) based completion algorithms generally solve the low rank optimization…

Machine Learning · Statistics 2021-04-07 Zhen Long , Ce Zhu , Jiani Liu , Yipeng Liu

Dynamic mode decomposition (DMD) has become a powerful data-driven method for analyzing the spatiotemporal dynamics of complex, high-dimensional systems. However, conventional DMD methods are limited to matrix-based formulations, which…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Ziqin He , Mengqi Hu , Yifei Lou , Can Chen

Large-scale Dynamic Networks (LDNs) are becoming increasingly important in the Internet age, yet the dynamic nature of these networks captures the evolution of the network structure and how edge weights change over time, posing unique…

Machine Learning · Computer Science 2023-04-19 Qu Wang

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of…

Numerical Analysis · Mathematics 2021-06-30 Athanasios A. Rontogiannis , Eleftherios Kofidis , Paris V. Giampouras

Tensor decomposition methods have proven effective in various applications, including compression and acceleration of neural networks. At the same time, the problem of determining optimal decomposition ranks, which present the crucial…

Machine Learning · Computer Science 2023-04-05 Maxim Kodryan , Dmitry Kropotov , Dmitry Vetrov

We introduce an online tensor decomposition based approach for two latent variable modeling problems namely, (1) community detection, in which we learn the latent communities that the social actors in social networks belong to, and (2)…

Machine Learning · Computer Science 2015-10-06 Furong Huang , U. N. Niranjan , Mohammad Umar Hakeem , Animashree Anandkumar

The accurate approximation of high-dimensional functions is an essential task in uncertainty quantification and many other fields. We propose a new function approximation scheme based on a spectral extension of the tensor-train (TT)…

Numerical Analysis · Mathematics 2016-09-20 Daniele Bigoni , Allan P. Engsig-Karup , Youssef M. Marzouk

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation…

Machine Learning · Statistics 2016-05-04 Will Wei Sun , Junwei Lu , Han Liu , Guang Cheng

Tensors of order three or higher have found applications in diverse fields, including image and signal processing, data mining, biomedical engineering and link analysis, to name a few. In many applications that involve for example time…

Data Structures and Algorithms · Computer Science 2018-09-05 Davoud Ataee Tarzanagh , George Michailidis

For the high dimensional data representation, nonnegative tensor ring (NTR) decomposition equipped with manifold learning has become a promising model to exploit the multi-dimensional structure and extract the feature from tensor data.…

Machine Learning · Computer Science 2021-09-07 Xinhai Zhao , Yuyuan Yu , Guoxu Zhou , Qibin Zhao , Weijun Sun

Real-time prediction plays a vital role in various control systems, such as traffic congestion control and wireless channel resource allocation. In these scenarios, the predictor usually needs to track the evolution of the latent…

Optimization and Control · Mathematics 2024-08-14 Zhenting Luan , Defeng Sun , Haoning Wang , Liping Zhang