English
Related papers

Related papers: Enhanced nonconvex low-rank approximation of tenso…

200 papers

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler

We comment on two randomized algorithms for constructing low-rank matrix decompositions. Both algorithms employ the Subsampled Randomized Hadamard Transform [14]. The first algorithm appeared recently in [9]; here, we provide a novel…

Data Structures and Algorithms · Computer Science 2012-04-04 Christos Boutsidis

The tensor train (TT) rank has received increasing attention in tensor completion due to its ability to capture the global correlation of high-order tensors ($\textrm{order} >3$). For third order visual data, direct TT rank minimization has…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Meng Ding , Ting-Zhu Huang , Xi-Le Zhao , Michael K. Ng , Tian-Hui Ma

Tensor completion is an extension of matrix completion aimed at recovering a multiway data tensor by leveraging a given subset of its entries (observations) and the pattern of observation. The low-rank assumption is key in establishing a…

Numerical Analysis · Mathematics 2026-03-12 Shakir Showkat Sofi , Lieven De Lathauwer

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

Recently, a tensor factorization based method for a low tubal rank tensor completion problem of a third order tensor was proposed, which performed better than some existing methods. Tubal rank is only defined on one mode of third order…

Optimization and Control · Mathematics 2024-08-20 Quan Yu , Xinzhen Zhang , Zheng-Hai Huang

The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn…

Machine Learning · Computer Science 2022-03-22 Jian-Feng Cai , Jingyang Li , Dong Xia

Low-rank tensor recovery has attracted much attention among various tensor recovery approaches. A tensor rank has several definitions, unlike the matrix rank--e.g. the CP rank and the Tucker rank. Many low-rank tensor recovery methods are…

Signal Processing · Electrical Eng. & Systems 2020-09-09 Kaito Hosono , Shunsuke Ono , Takamichi Miyata

This paper focus on recovering multi-dimensional data called tensor from randomly corrupted incomplete observation. Inspired by reweighted $l_1$ norm minimization for sparsity enhancement, this paper proposes a reweighted singular value…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Baburaj M. , Sudhish N. George

In this paper we propose efficient randomized fixed-precision techniques for low tubal rank approximation of tensors. The proposed methods are faster and more efficient than the existing fixed-precision algorithms for approximating the…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Cesar F. Caiafa , Andre L. F. de Almeidad

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng

Context information plays an indispensable role in the success of semantic segmentation. Recently, non-local self-attention based methods are proved to be effective for context information collection. Since the desired context consists of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Wanli Chen , Xinge Zhu , Ruoqi Sun , Junjun He , Ruiyu Li , Xiaoyong Shen , Bei Yu

By a tensor we mean an element of a tensor product of vector spaces over a field. Up to a choice of bases in factors of tensor products, every tensor may be coordinatized, that is, represented as an array consisting of numbers. This note is…

Functional Analysis · Mathematics 2019-01-11 R. N. Gumerov , A. S. Sharafutdinov

Reinforcement learning (RL) aims to estimate the action to take given a (time-varying) state, with the goal of maximizing a cumulative reward function. Predominantly, there are two families of algorithms to solve RL problems: value-based…

Machine Learning · Computer Science 2025-01-10 Sergio Rozada , Hoi-To Wai , Antonio G. Marques

Low-rank matrix is desired in many machine learning and computer vision problems. Most of the recent studies use the nuclear norm as a convex surrogate of the rank operator. However, all singular values are simply added together by the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-07 Zhao Kang , Chong Peng , Jie Cheng , Qiang Chen

This paper develops a scalable new algorithm, called NysADMM, to minimize a smooth convex loss function with a convex regularizer. NysADMM accelerates the inexact Alternating Direction Method of Multipliers (ADMM) by constructing a…

Optimization and Control · Mathematics 2022-07-05 Shipu Zhao , Zachary Frangella , Madeleine Udell

The Nystr\"om method is a popular choice for finding a low-rank approximation to a symmetric positive semi-definite matrix. The method can fail when applied to symmetric indefinite matrices, for which the error can be unboundedly large. In…

Numerical Analysis · Mathematics 2023-10-10 Taejun Park , Yuji Nakatsukasa

We consider relative error low rank approximation of $tensors$ with respect to the Frobenius norm: given an order-$q$ tensor $A \in \mathbb{R}^{\prod_{i=1}^q n_i}$, output a rank-$k$ tensor $B$ for which $\|A-B\|_F^2 \leq (1+\epsilon)$OPT,…

Data Structures and Algorithms · Computer Science 2018-04-02 Zhao Song , David P. Woodruff , Peilin Zhong

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new…

Numerical Analysis · Mathematics 2023-08-16 Alec Dektor , Daniele Venturi