中文
相关论文

相关论文: Riemannian thresholding methods for row-sparse and…

200 篇论文

This paper presents a memory efficient, first-order method for low multi-linear rank approximation of high-order, high-dimensional tensors. In our method, we exploit the second-order information of the cost function and the constraints to…

最优化与控制 · 数学 2024-03-22 Mohammad Hamed , Reshad Hosseini

This paper focuses on recovering a low-rank tensor from its incomplete measurements. We propose a novel algorithm termed the Single Mode Quasi Riemannian Gradient Descent (SM-QRGD). By exploiting the benefits of both fixed-rank matrix…

最优化与控制 · 数学 2024-01-30 Yuanwei Zhang , Ya-Nan Zhu , Xiaoqun Zhang

This paper introduces recovery thresholding hyperinterpolations, a novel class of methods for sparse signal reconstruction in the presence of noise. We develop a framework that integrates thresholding operators--including hard thresholding,…

数值分析 · 数学 2025-07-25 Congpei An , Jiashu Ran

In this paper, we propose a Riemannian steepest descent method for solving a blind deconvolution problem. We prove that the proposed algorithm with an appropriate initialization will recover the exact solution with high probability when the…

信息论 · 计算机科学 2018-04-17 Wen Huang , Paul Hand

The problem of recovering a low $n$-rank tensor is an extension of sparse recovery problem from the low dimensional space (matrix space) to the high dimensional space (tensor space) and has many applications in computer vision and graphics…

最优化与控制 · 数学 2014-04-09 Min Zhang , Lei Yang , Zheng-Hai Huang

Nonconvex sparse learning plays an essential role in many areas, such as signal processing and deep network compression. Iterative hard thresholding (IHT) methods are the state-of-the-art for nonconvex sparse learning due to their…

机器学习 · 计算机科学 2021-01-05 Qianqian Tong , Guannan Liang , Tan Zhu , Jinbo Bi

Finding the sparset solution of an underdetermined system of linear equations $y=Ax$ has attracted considerable attention in recent years. Among a large number of algorithms, iterative thresholding algorithms are recognized as one of the…

信息论 · 计算机科学 2013-10-16 Jinshan Zeng , Shaobo Lin , Zongben Xu

We propose a unified framework to solve general low-rank plus sparse matrix recovery problems based on matrix factorization, which covers a broad family of objective functions satisfying the restricted strong convexity and smoothness…

机器学习 · 统计学 2018-02-21 Xiao Zhang , Lingxiao Wang , Quanquan Gu

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical…

数值分析 · 数学 2019-08-23 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

The choice of the sensing matrix is crucial in compressed sensing. Random Gaussian sensing matrices satisfy the restricted isometry property, which is crucial for solving the sparse recovery problem using convex optimization techniques.…

信号处理 · 电气工程与系统科学 2023-12-29 Kartheek Kumar Reddy Nareddy , Abijith Jagannath Kamath , Chandra Sekhar Seelamantula

Sparse signal recoveries from multiple measurement vectors (MMV) with joint sparsity property have many applications in signal, image, and video processing. The problem becomes much more involved when snapshots of the signal matrix are…

信息论 · 计算机科学 2021-01-25 Ningning Han , Shidong Li , Jian Lu

In scientific computing and machine learning applications, matrices and more general multidimensional arrays (tensors) can often be approximated with the help of low-rank decompositions. Since matrices and tensors of fixed rank form smooth…

最优化与控制 · 数学 2021-10-26 Alexander Novikov , Maxim Rakhuba , Ivan Oseledets

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

机器学习 · 统计学 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Gradient-based learning imposes (deep) neural networks to be differentiable at all steps. This includes model-based architectures constructed by unrolling iterations of an iterative algorithm onto layers of a neural network, known as…

机器学习 · 计算机科学 2025-05-22 Sina Mohammad-Taheri , Matthew J. Colbrook , Simone Brugiapaglia

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

信息论 · 计算机科学 2023-06-13 Johannes Maly

Several recent randomized linear algebra algorithms rely upon fast dimension reduction methods. A popular choice is the Subsampled Randomized Hadamard Transform (SRHT). In this article, we address the efficacy, in the Frobenius and spectral…

数据结构与算法 · 计算机科学 2015-03-20 Christos Boutsidis , Alex Gittens

It is now well understood that $\ell_1$ minimization algorithm is able to recover sparse signals from incomplete measurements [2], [1], [3] and sharp recoverable sparsity thresholds have also been obtained for the $\ell_1$ minimization…

概率论 · 数学 2009-04-07 Weiyu Xu , M. Amin Khajehnejad , Salman Avestimehr , Babak Hassibi

The Kaczmarz method (KZ) and its variants, which are types of stochastic gradient descent (SGD) methods, have been extensively studied due to their simplicity and efficiency in solving linear equation systems. The iterative thresholding…

机器学习 · 统计学 2023-04-21 Halyun Jeong , Deanna Needell

We provide another framework of iterative algorithms based on thresholding, feedback and null space tuning for sparse signal recovery arising in sparse representations and compressed sensing. Several thresholding algorithms with various…

信息论 · 计算机科学 2012-11-13 Shidong Li , Yulong Liu , Tiebin Mi

This paper presents strong worst-case iteration and operation complexity guarantees for Riemannian adaptive regularized Newton methods, a unified framework encompassing both Riemannian adaptive regularization (RAR) methods and Riemannian…

最优化与控制 · 数学 2025-05-14 Chenyu Zhang , Rujun Jiang