English
Related papers

Related papers: Learned Interpretable Residual Extragradient ISTA …

200 papers

Behavioral patterns captured in embeddings learned from interaction data are pivotal across various stages of production recommender systems. However, in the initial retrieval stage, practitioners face an inherent tradeoff between embedding…

Information Retrieval · Computer Science 2026-02-11 Vojtěch Vančura , Martin Spišák , Rodrigo Alves , Ladislav Peška

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the…

Machine Learning · Computer Science 2023-09-04 Yu Wang , Lei Cao , Yizhou Yan , Samuel Madden

Complex-field signal recovery problems from noisy linear/nonlinear measurements appear in many areas of signal processing and wireless communications. In this paper, we propose a trainable iterative signal recovery algorithm named…

Information Theory · Computer Science 2019-10-18 Satoshi Takabe , Tadashi Wadayama , Yonina C. Eldar

In this paper, we consider the recovery of the high-dimensional block-sparse signal from a compressed set of measurements, where the non-zero coefficients of the recovered signal occur in a small number of blocks. Adopting the idea of deep…

Signal Processing · Electrical Eng. & Systems 2021-11-19 Rong Fu , Vincent Monardo , Tianyao Huang , Yimin Liu

Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination,…

Numerical Analysis · Mathematics 2025-06-24 Chai Wah Wu , Mark S. Squillante , Vasileios Kalantzis , Lior Horesh

We present a comprehensive framework for structured sparse coding and modeling extending the recent ideas of using learnable fast regressors to approximate exact sparse codes. For this purpose, we develop a novel block-coordinate proximal…

Machine Learning · Computer Science 2012-06-22 Alex Bronstein , Pablo Sprechmann , Guillermo Sapiro

We propose a provably convergent method, called Efficient Learned Descent Algorithm (ELDA), for low-dose CT (LDCT) reconstruction. ELDA is a highly interpretable neural network architecture with learned parameters and meanwhile retains…

Image and Video Processing · Electrical Eng. & Systems 2021-04-28 Qingchao Zhang , Mehrdad Alvandipour , Wenjun Xia , Yi Zhang , Xiaojing Ye , Yunmei Chen

Motivated by the learned iterative soft thresholding algorithm (LISTA), we introduce a general class of neural networks suitable for sparse reconstruction from few linear measurements. By allowing a wide range of degrees of weight-sharing…

Machine Learning · Computer Science 2022-01-19 Ekkehard Schnoor , Arash Behboodi , Holger Rauhut

The iterations of many sparse estimation algorithms are comprised of a fixed linear filter cascaded with a thresholding nonlinearity, which collectively resemble a typical neural network layer. Consequently, a lengthy sequence of algorithm…

Machine Learning · Computer Science 2016-05-11 Bo Xin , Yizhou Wang , Wen Gao , David Wipf

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman

We consider linear sparse recovery problems where additional structure regarding the support of the solution is known. The form of the structure considered is non-overlapping sets of indices that each contain part of the support. An…

Numerical Analysis · Mathematics 2021-10-05 Joseph S. Donato , Howard W. Levinson

Structured pruning of filters or neurons has received increased focus for compressing convolutional neural networks. Most existing methods rely on multi-stage optimizations in a layer-wise manner for iteratively pruning and retraining which…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Chenqian Yan , Baochang Zhang , Liujuan Cao , Qixiang Ye , Feiyue Huang , David Doermann

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

We propose a learnable variational model that learns the features and leverages complementary information from both image and measurement domains for image reconstruction. In particular, we introduce a learned alternating minimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chi Ding , Qingchao Zhang , Ge Wang , Xiaojing Ye , Yunmei Chen

We develop new stochastic gradient methods for efficiently solving sparse linear regression in a partial attribute observation setting, where learners are only allowed to observe a fixed number of actively chosen attributes per example at…

Optimization and Control · Mathematics 2018-12-04 Tomoya Murata , Taiji Suzuki

We present ELSA, a practical solution for creating deep networks that can easily be deployed at different levels of sparsity. The core idea is to embed one or more sparse networks within a single dense network as a proper subset of the…

Machine Learning · Computer Science 2023-12-19 Paniz Halvachi , Alexandra Peste , Dan Alistarh , Christoph H. Lampert

Sparse coding strategies have been lauded for their parsimonious representations of data that leverage low dimensional structure. However, inference of these codes typically relies on an optimization procedure with poor computational…

Machine Learning · Computer Science 2022-09-02 Kion Fallah , Christopher J. Rozell

Finding sparse solutions of underdetermined systems of linear equations is a fundamental problem in signal processing and statistics which has become a subject of interest in recent years. In general, these systems have infinitely many…

Machine Learning · Statistics 2010-09-21 Arash Ali Amini , Massoud Babaie-Zadeh , Christian Jutten

We propose a novel convolutional neural network (CNN), called $\Psi$DONet, designed for learning pseudodifferential operators ($\Psi$DOs) in the context of linear inverse problems. Our starting point is the Iterative Soft Thresholding…

Optimization and Control · Mathematics 2020-06-03 Tatiana A. Bubba , Mathilde Galinier , Matti Lassas , Marco Prato , Luca Ratti , Samuli Siltanen