English
Related papers

Related papers: A dual framework for low-rank tensor completion

200 papers

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

This paper presents strong worst-case iteration and operation complexity guarantees for Riemannian adaptive regularized Newton methods, a unified framework encompassing both Riemannian adaptive regularization (RAR) methods and Riemannian…

Optimization and Control · Mathematics 2025-05-14 Chenyu Zhang , Rujun Jiang

We consider a Canonical Polyadic (CP) decomposition approach to low-rank tensor completion (LRTC) by incorporating external pairwise similarity relations through graph Laplacian regularization on the CP factor matrices. The usage of graph…

Numerical Analysis · Mathematics 2023-11-14 Yu Guan , Shuyu Dong , Bin Gao , P. -A. Absil , François Glineur

This paper presents a numerical framework for the low-rank approximation of the solution to three-dimensional parabolic problems. The key contribution of this work is the tensorization process based on a tensor-train reformulation of the…

Numerical Analysis · Mathematics 2025-09-15 Gianmarco Manzini , Tommaso Sorgente

Multi-Task Learning (MTL) can enhance a classifier's generalization performance by learning multiple related tasks simultaneously. Conventional MTL works under the offline or batch setting, and suffers from expensive training cost and poor…

Machine Learning · Computer Science 2017-06-28 Peng Yang , Peilin Zhao , Xin Gao

We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Nauman Shahid , Francesco Grassi , Pierre Vandergheynst

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

Low-rank tensors are an established framework for high-dimensional least-squares problems. We propose to extend this framework by including the concept of block-sparsity. In the context of polynomial regression each sparsity pattern…

Numerical Analysis · Mathematics 2021-04-30 Michael Götte , Reinhold Schneider , Philipp Trunschke

Learning of matrix-valued data has recently surged in a range of scientific and business applications. Trace regression is a widely used method to model effects of matrix predictors and has shown great success in matrix learning. However,…

Machine Learning · Statistics 2021-05-06 Chanwoo Lee , Lexin Li , Hao Helen Zhang , Miaoyan Wang

Low rank model arises from a wide range of applications, including machine learning, signal processing, computer algebra, computer vision, and imaging science. Low rank matrix recovery is about reconstructing a low rank matrix from…

Numerical Analysis · Mathematics 2018-09-12 Jian-Feng Cai , Ke Wei

Robust matrix completion (RMC) is a widely used machine learning tool that simultaneously tackles two critical issues in low-rank data analysis: missing data entries and extreme outliers. This paper proposes a novel scalable and learnable…

Machine Learning · Computer Science 2026-05-22 HanQin Cai , Chandra Kundu , Jialin Liu , Wotao Yin

In this paper, we propose a coupled tensor norm regularization that could enable the model output feature and the data input to lie in a low-dimensional manifold, which helps us to reduce overfitting. We show this regularization term is…

Optimization and Control · Mathematics 2023-02-24 Ying Gao , Yunfei Qu , Chunfeng Cui , Deren Han

In the next generation wireless networks, lowlatency communication is critical to support emerging diversified applications, e.g., Tactile Internet and Virtual Reality. In this paper, a novel blind demixing approach is developed to reduce…

Information Theory · Computer Science 2018-12-07 Jialin Dong , Kai Yang , Yuanming Shi

Statistical inference for tensors has emerged as a critical challenge in analyzing high-dimensional data in modern data science. This paper introduces a unified framework for inferring general and low-Tucker-rank linear functionals of…

Statistics Theory · Mathematics 2025-01-28 Ke Xu , Elynn Chen , Yuefeng Han

Radio maps are important enablers for many applications in wireless networks, ranging from network planning and optimization to fingerprint based localization. Sampling the complete map is prohibitively expensive in practice, so methods for…

Signal Processing · Electrical Eng. & Systems 2020-01-27 Daniel Schäufele , Renato L. G. Cavalcante , Slawomir Stanczak

Recovering a low-rank tensor from incomplete information is a recurring problem in signal processing and machine learning. The most popular convex relaxation of this problem minimizes the sum of the nuclear norms of the unfoldings of the…

Machine Learning · Statistics 2013-08-16 Cun Mu , Bo Huang , John Wright , Donald Goldfarb

The task of reconstructing a low rank matrix from incomplete linear measurements arises in areas such as machine learning, quantum state tomography and in the phase retrieval problem. In this note, we study the particular setup that the…

Information Theory · Computer Science 2016-12-12 Holger Rauhut , Ulrich Terstiege

Low-rank tensors appear to be prosperous in many applications. However, the sets of bounded-rank tensors are non-smooth and non-convex algebraic varieties, rendering the low-rank optimization problems to be challenging. To this end, we…

Optimization and Control · Mathematics 2024-11-22 Bin Gao , Renfeng Peng , Ya-xiang Yuan

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler