English
Related papers

Related papers: Structured Low-Rank Tensor Learning

200 papers

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

Tensor networks provide compact and scalable representations of high-dimensional data, enabling efficient computation in fields such as quantum physics, numerical partial differential equations (PDEs), and machine learning. This paper…

Numerical Analysis · Mathematics 2025-08-28 Julia Wei , Alec Dektor , Chungen Shen , Zaiwen Wen , Chao Yang

We consider factoring low-rank tensors in the presence of outlying slabs. This problem is important in practice, because data collected in many real-world applications, such as speech, fluorescence, and some social network data, fit this…

Machine Learning · Statistics 2023-07-19 Xiao Fu , Kejun Huang , Wing-Kin Ma , Nicholas D. Sidiropoulos , Rasmus Bro

Low-rank optimization problems with sparse simplex constraints involve variables that must satisfy nonnegativity, sparsity, and sum-to-1 conditions, making their optimization particularly challenging due to the interplay between low-rank…

Optimization and Control · Mathematics 2026-03-24 Flavia Esposito , Andersen Ang

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

Machine Learning · Computer Science 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

Low-rank tensor recovery problems have been widely studied in many applications of signal processing and machine learning. Tucker decomposition is known as one of the most popular decompositions in the tensor framework. In recent years,…

Numerical Analysis · Mathematics 2020-07-17 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We consider the low-rank tensor train completion problem when additional side information is available in the form of subspaces that contain the mode-$k$ fiber spans. We propose an algorithm based on Riemannian optimization to solve the…

Numerical Analysis · Mathematics 2020-06-24 Stanislav Budzinskiy , Nikolai Zamarashkin

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

This paper investigates the low-rank tensor completion problem, which is about recovering a tensor from partially observed entries. We consider this problem in the tensor train format and extend the preconditioned metric from the matrix…

Optimization and Control · Mathematics 2023-04-19 Jian-Feng Cai , Wen Huang , Haifeng Wang , Ke Wei

Low-rank tensor sensing is a fundamental problem with broad applications in signal processing and machine learning. Among various tensor models, low-Tucker-rank tensors are particularly attractive for capturing multi-mode subspace…

Machine Learning · Computer Science 2026-01-21 Shuang Li

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

The goal of tensor completion is to fill in missing entries of a partially known tensor (possibly including some noise) under a low-rank constraint. This may be formulated as a least-squares problem. The set of tensors of a given…

Numerical Analysis · Mathematics 2018-12-03 Gennadij Heidel , Volker Schulz

In pursuit of reinforcement learning systems that could train in physical environments, we investigate multi-task approaches as a means to alleviate the need for massive data acquisition. In a tabular scenario where the Q-functions are…

Machine Learning · Computer Science 2025-01-22 Sergio Rozada , Santiago Paternain , Juan Andres Bazerque , Antonio G. Marques

Low rank matrix and tensor completion problems are to recover the incomplete two and higher order data by using their low rank structures. The essential problem in the matrix and tensor completion problems is how to improve the efficiency.…

Optimization and Control · Mathematics 2024-08-23 Quan Yu , Xinzhen Zhang

The goal of tensor completion is to recover a tensor from a subset of its entries, often by exploiting its low-rank property. Among several useful definitions of tensor rank, the low-tubal-rank was shown to give a valuable characterization…

Machine Learning · Computer Science 2022-10-18 Yicong He , George K. Atia

This paper addresses the problem of learning an undirected graph from data gathered at each nodes. Within the graph signal processing framework, the topology of such graph can be linked to the support of the conditional correlation matrix…

Machine Learning · Computer Science 2025-06-13 Thu Ha Phi , Alexandre Hippert-Ferrer , Florent Bouchard , Arnaud Breloy

By a tensor we mean an element of a tensor product of vector spaces over a field. Up to a choice of bases in factors of tensor products, every tensor may be coordinatized, that is, represented as an array consisting of numbers. This note is…

Functional Analysis · Mathematics 2019-01-11 R. N. Gumerov , A. S. Sharafutdinov