English
Related papers

Related papers: Sparse tensor recovery via N-mode FISTA with suppo…

200 papers

A pulsar dynamic spectrum is an inline digital hologram of the interstellar medium; it encodes information on the propagation paths by which signals have travelled from source to telescope. To decode the hologram it is necessary to…

Instrumentation and Methods for Astrophysics · Physics 2022-12-07 Stefan Osłowski , Mark A. Walker

In this paper, we consider the problem of recovering an unknown sparse matrix X from the matrix sketch Y = AX B^T. The dimension of Y is less than that of X, and A and B are known matrices. This problem can be solved using standard…

Numerical Analysis · Computer Science 2013-11-12 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

Low-rank tensor recovery problems have been widely studied in many applications of signal processing and machine learning. Tucker decomposition is known as one of the most popular decompositions in the tensor framework. In recent years,…

Numerical Analysis · Mathematics 2020-07-17 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and high-dimensional nature. Directly handling raw tensors is impractical due to the significant memory and computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Zixuan Li , Mingxing Duan , Huizhang Luo , Wangdong Yang , Kenli Li , Keqin Li

We introduce two nonlinear sufficient dimension reduction methods for regressions with tensor-valued predictors. Our goal is two-fold: the first is to preserve the tensor structure when performing dimension reduction, particularly the…

Statistics Theory · Mathematics 2025-12-24 Dianjun Lin , Bing Li , Lingzhou Xue

The boom of non-uniform sampling and compressed sensing techniques dramatically alleviates the lengthy data acquisition problem of magnetic resonance imaging. Sparse reconstruction, thanks to its fast computation and promising performance,…

Image and Video Processing · Electrical Eng. & Systems 2020-08-05 Xinlin Zhang , Hengfa Lu , Di Guo , Lijun Bao , Feng Huang , Qin Xu , Xiaobo Qu

Higher-order tensors can represent scores in a rating system, frames in a video, and images of the same subject. In practice, the measurements are often highly quantized due to the sampling strategies or the quality of devices. Existing…

Machine Learning · Computer Science 2020-10-28 Ren Wang , Meng Wang , Jinjun Xiong

Recovery of sparse vectors and low-rank matrices from a small number of linear measurements is well-known to be possible under various model assumptions on the measurements. The key requirement on the measurement matrices is typically the…

Numerical Analysis · Mathematics 2021-09-23 Mark A. Iwen , Deanna Needell , Michael Perlmutter , Elizaveta Rebrova

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case $O(1/k^2)$ optimal convergence rate in terms of objective…

Optimization and Control · Mathematics 2021-01-21 Jingwei Liang , Tao Luo , Carola-Bibiane Schönlieb

In this paper we consider asymptotically exact support recovery in the context of high dimensional and sparse Canonical Correlation Analysis (CCA). Our main results describe four regimes of interest based on information theoretic and…

Statistics Theory · Mathematics 2022-10-12 Nilanjana Laha , Rajarshi Mukherjee

Sparse coding is typically solved by iterative optimization techniques, such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Unfolding and learning weights of ISTA using neural networks is a practical way to accelerate estimation.…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Thomas Moreau , Mathurin Massias , Alexandre Gramfort

In this paper, we address the problem of distributed sparse recovery of signals acquired via compressed measurements in a sensor network. We propose a new class of distributed algorithms to solve Lasso regression problems, when the…

Information Theory · Computer Science 2013-10-15 Chiara Ravazzi , Sophie M. Fosson , Enrico Magli

This paper studies sequential methods for recovery of sparse signals in high dimensions. When compared to fixed sample size procedures, in the sparse setting, sequential methods can result in a large reduction in the number of samples…

Information Theory · Computer Science 2014-10-07 Matthew L. Malloy , Robert Nowak

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

In this note, we propose a FISTA-type first order algorithm, VAR-FISTA, to solve a composite optimization problem. A distinctive feature of VAR-FISTA is its ability to exploit the convexity of the function in the problem, resulting in an…

Optimization and Control · Mathematics 2020-08-25 Chee-Khian Sim

In this short note we propose a simple two-stage sparse phase retrieval strategy that uses a near-optimal number of measurements, and is both computationally efficient and robust to measurement noise. In addition, the proposed strategy is…

Numerical Analysis · Mathematics 2015-04-27 Mark Iwen , Aditya Viswanathan , Yang Wang

The problem of recovering a low $n$-rank tensor is an extension of sparse recovery problem from the low dimensional space (matrix space) to the high dimensional space (tensor space) and has many applications in computer vision and graphics…

Optimization and Control · Mathematics 2014-04-09 Min Zhang , Lei Yang , Zheng-Hai Huang

This paper introduces a novel framework for physics-aware sparse signal recovery in measurement systems governed by partial differential equations (PDEs). Unlike conventional compressed sensing approaches that treat measurement systems as…

Information Theory · Computer Science 2025-10-09 Tadashi Wadayama , Koji Igarashi , Takumi Takahashi

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Tensor completion is an extension of matrix completion aimed at recovering a multiway data tensor by leveraging a given subset of its entries (observations) and the pattern of observation. The low-rank assumption is key in establishing a…

Numerical Analysis · Mathematics 2026-03-12 Shakir Showkat Sofi , Lieven De Lathauwer