English
Related papers

Related papers: Sparse tensor recovery via N-mode FISTA with suppo…

200 papers

We propose general non-accelerated and accelerated tensor methods under inexact information on the derivatives of the objective, analyze their convergence rate. Further, we provide conditions for the inexactness in each derivative that is…

Optimization and Control · Mathematics 2022-12-22 Artem Agafonov , Dmitry Kamzolov , Pavel Dvurechensky , Alexander Gasnikov , Martin Takáč

Solving large tensor linear systems poses significant challenges due to the high volume of data stored, and it only becomes more challenging when some of the data is missing. Recently, Ma et al. showed that this problem can be tackled using…

Numerical Analysis · Mathematics 2026-05-28 Anna Ma , Deanna Needell , Alexander Xue

This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function…

Optimization and Control · Mathematics 2023-12-22 Mengqi Hu , Yifei Lou , Bao Wang , Ming Yan , Xiu Yang , Qiang Ye

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

Let us consider a case where all of the elements in some continuous slices are missing in tensor data. In this case, the nuclear-norm and total variation regularization methods usually fail to recover the missing elements. The key problem…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Tatsuya Yokota , Burak Erem , Seyhmus Guler , Simon K. Warfield , Hidekata Hontani

Iterative algorithms based on thresholding, feedback and null space tuning (NST+HT+FB) for sparse signal recovery are exceedingly effective and fast, particularly for large scale problems. The core algorithm is shown to converge in finitely…

Numerical Analysis · Mathematics 2017-11-08 Ningning Han , Shidong Li , Zhanjie Song , Hong Wang

Joint sparsity has attracted considerable attention in recent years in many fields including sparse signal recovery in compressed sensing (CS), statistics, and machine learning. Traditional convex models suffer from the suboptimal…

Numerical Analysis · Computer Science 2017-06-27 Yaru Fan , Yilun Wang , Tingzhu Huang

Many problems in science and engineering involve, as part of their solution process, the consideration of a separable function which is the sum of two convex functions, one of them possibly non-smooth. Recently a few works have discussed…

Optimization and Control · Mathematics 2017-03-06 Daniel Reem , Alvaro De Pierro

In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now those corresponding non-convex algorithms lack convergence guarantees from the initial…

Information Theory · Computer Science 2014-04-29 Laming Chen , Yuantao Gu

Fabrication process variations are a major source of yield degradation in the nano-scale design of integrated circuits (IC), microelectromechanical systems (MEMS) and photonic circuits. Stochastic spectral methods are a promising technique…

Computational Engineering, Finance, and Science · Computer Science 2016-11-08 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

The completion of tensors, or high-order arrays, attracts significant attention in recent research. Current literature on tensor completion primarily focuses on recovery from a set of uniformly randomly measured entries, and the required…

Methodology · Statistics 2018-11-28 Anru Zhang

In this paper, we investigate tensor recovery problems within the tensor singular value decomposition (t-SVD) framework. We propose the partial sum of the tubal nuclear norm (PSTNN) of a tensor. The PSTNN is a surrogate of the tensor tubal…

Numerical Analysis · Computer Science 2020-01-24 Tai-Xiang Jiang , Ting-Zhu Huang , Xi-Le Zhao , Liang-Jian Deng

Sparse neural networks are becoming increasingly important as the field seeks to improve the performance of existing models by scaling them up, while simultaneously trying to reduce power consumption and computational footprint.…

Machine Learning · Computer Science 2021-06-08 Siddhant M. Jayakumar , Razvan Pascanu , Jack W. Rae , Simon Osindero , Erich Elsen

The rapid developing area of compressed sensing suggests that a sparse vector lying in an arbitrary high dimensional space can be accurately recovered from only a small set of non-adaptive linear measurements. Under appropriate conditions…

Cellular Automata and Lattice Gases · Physics 2009-11-13 Moshe Mishali , Yonina C. Eldar

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

This paper provides a new tractable lower bound for the sparse recovery threshold of sensing matrices. This lower bound is used as a proxy to quantify the quality of sensing matrices in two different applications. First, it serves as…

Optimization and Control · Mathematics 2020-12-15 Mathieu Barré , Alexandre d'Aspremont

We consider tomographic reconstruction using priors in the form of a dictionary learned from training images. The reconstruction has two stages: first we construct a tensor dictionary prior from our training data, and then we pose the…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Sara Soltani , Misha E. Kilmer , Per Christian Hansen

A compressed sensing method consists of a rectangular measurement matrix, $M \in \mathbbm{R}^{m \times N}$ with $m \ll N$, together with an associated recovery algorithm, $\mathcal{A}: \mathbbm{R}^m \rightarrow \mathbbm{R}^N$. Compressed…

Information Theory · Computer Science 2013-02-26 M. A. Iwen

Tensor time series, which is a time series consisting of tensorial observations, has become ubiquitous. It typically exhibits high dimensionality. One approach for dimension reduction is to use a factor model structure, in a form similar to…

Methodology · Statistics 2024-07-19 Yuefeng Han , Rong Chen , Dan Yang , Cun-Hui Zhang