English
Related papers

Related papers: Supervised learning of analysis-sparsity priors wi…

200 papers

We propose a new algorithm for recovery of sparse signals from their compressively sensed samples. The proposed algorithm benefits from the strategy of gradual movement to estimate the positions of non-zero samples of sparse signal. We…

Information Theory · Computer Science 2012-04-04 Seyed Hossein Hosseini , Mahrokh G. Shayesteh

Autoencoding, which aims to reconstruct the input images through a bottleneck latent representation, is one of the classic feature representation learning strategies. It has been shown effective as an auxiliary task for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yuhao Lin , Haiming Xu , Lingqiao Liu , Jinan Zou , Javen Qinfeng Shi

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

Existing methods for sparse channel estimation typically provide an estimate computed as the solution maximizing an objective function defined as the sum of the log-likelihood function and a penalization term proportional to the l1-norm of…

Machine Learning · Statistics 2012-04-04 Niels Lovmand Pedersen , Carles Navarro Manchón , Dmitriy Shutin , Bernard Henri Fleury

(This paper was written in November 2011 and never published. It is posted on arXiv.org in its original form in June 2016). Many recent object recognition systems have proposed using a two phase training procedure to learn sparse…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Kevin Jarrett , Koray Kvukcuoglu , Karol Gregor , Yann LeCun

This letter proposes a dictionary learning algorithm for blind one bit compressed sensing. In the blind one bit compressed sensing framework, the original signal to be reconstructed from one bit linear random measurements is sparse in an…

Machine Learning · Statistics 2016-01-20 Hadi Zayyani , Mehdi Korki , Farrokh Marvasti

With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost…

Machine Learning · Computer Science 2024-06-11 Weixi Song , Zuchao Li , Lefei Zhang , Hai Zhao , Bo Du

In this paper we study the compressive sensing effects on 2D signals exhibiting sparsity in 2D DFT domain. A simple algorithm for reconstruction of randomly under-sampled data is proposed. It is based on the analytically determined…

Information Theory · Computer Science 2015-11-17 Srdjan Stankovic , Irena Orovic

Sparse Representation (SR) of signals or data has a well founded theory with rigorous mathematical error bounds and proofs. SR of a signal is given by superposition of very few columns of a matrix called Dictionary, implicitly reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 G. Madhuri , Atul Negi

This paper examines a combined supervised-unsupervised framework involving dictionary-based blind learning and deep supervised learning for MR image reconstruction from under-sampled k-space data. A major focus of the work is to investigate…

Image and Video Processing · Electrical Eng. & Systems 2021-04-13 Anish Lahiri , Guanhua Wang , Saiprasad Ravishankar , Jeffrey A. Fessler

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

Sparse inversion and classification problems are ubiquitous in modern data science and imaging. They are often formulated as non-smooth minimisation problems. In sparse inversion, we minimise, e.g., the sum of a data fidelity term and an…

Numerical Analysis · Mathematics 2022-11-23 Jonas Latz

Graph signals offer a very generic and natural representation for data that lives on networks or irregular structures. The actual data structure is however often unknown a priori but can sometimes be estimated from the knowledge of the…

Machine Learning · Computer Science 2017-07-19 Hermina Petric Maretic , Dorina Thanou , Pascal Frossard

Deep neural networks have proven extremely efficient at solving a wide rangeof inverse problems, but most often the uncertainty on the solution they provideis hard to quantify. In this work, we propose a generic Bayesian framework…

Machine Learning · Statistics 2020-11-18 Zaccharie Ramzi , Benjamin Remy , Francois Lanusse , Jean-Luc Starck , Philippe Ciuciu

Image restoration has seen great progress in the last years thanks to the advances in deep neural networks. Most of these existing techniques are trained using full supervision with suitable image pairs to tackle a specific degradation.…

Image and Video Processing · Electrical Eng. & Systems 2020-09-11 Leonhard Helminger , Michael Bernasconi , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

Diffusion models (DMs) have demonstrated remarkable ability to generate diverse and high-quality images by efficiently modeling complex data distributions. They have also been explored as powerful generative priors for signal recovery,…

Machine Learning · Computer Science 2025-05-28 Anqi Tang , Youming Chen , Shuchen Xue , Zhaoqiang Liu

Classifiers are biased when trained on biased datasets. As a remedy, we propose Learning to Split (ls), an algorithm for automatic bias detection. Given a dataset with input-label pairs, ls learns to split this dataset so that predictors…

Machine Learning · Computer Science 2022-07-22 Yujia Bao , Regina Barzilay

Sparse representations with learned dictionaries have been successful in several image analysis applications. In this paper, we propose and analyze the framework of ensemble sparse models, and demonstrate their utility in image restoration…

Computer Vision and Pattern Recognition · Computer Science 2013-02-28 Karthikeyan Natesan Ramamurthy , Jayaraman J. Thiagarajan , Prasanna Sattigeri , Andreas Spanias

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

Advances in sensing technology have made it possible to collect large volumes of high-dimensional time-series data. In fields like genetics and neuroscience, key questions concern whether directed relationships between variables can be…

Methodology · Statistics 2026-05-08 Sarah E. Heaps , Ian H. Jermyn , Yujiang Wang , Darren J. Wilkinson