English
Related papers

Related papers: Supervised learning of analysis-sparsity priors wi…

200 papers

This thesis consists of original contributions in the area of digital signal processing. The reconstruction of signals sparse (highly concentrated) in various transform domains is the primary problem analyzed in the thesis. The considered…

Signal Processing · Electrical Eng. & Systems 2019-09-19 Milos Brajovic

We present a novel approach to leverage prior knowledge encapsulated in pre-trained text-to-image diffusion models for blind super-resolution (SR). Specifically, by employing our time-aware encoder, we can achieve promising restoration…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jianyi Wang , Zongsheng Yue , Shangchen Zhou , Kelvin C. K. Chan , Chen Change Loy

In this paper an extension of the sparse decomposition problem is considered and an algorithm for solving it is presented. In this extension, it is known that one of the shifted versions of a signal s (not necessarily the original signal…

Multimedia · Computer Science 2008-09-23 Hamed Firouzi , Massoud Babaie-Zadeh , Aria Ghasemian , Christian Jutten

Phase retrieval aims at reconstructing unknown signals from magnitude measurements of linear mixtures. In this paper, we consider the phase retrieval with dictionary learning problem, which includes an additional prior information that the…

Signal Processing · Electrical Eng. & Systems 2023-01-24 Tianyi Liu , Andreas M. Tillmann , Yang Yang , Yonina C. Eldar , Marius Pesavento

The phase retrieval from multi-frequency intensity (power) observations is considered. The object to be reconstructed is complex-valued. A novel algorithm is presented that accomplishes both the object phase (absolute phase) retrieval and…

Signal Processing · Electrical Eng. & Systems 2018-02-07 Vladimir Katkovnik , Karen Egiazarian

In this paper, we show a way to exploit sparsity in the problem data in a primal-dual potential reduction method for solving a class of semidefinite programs. When the problem data is sparse, the dual variable is also sparse, but the primal…

Numerical Analysis · Mathematics 2025-10-20 Gun Srijuntongsiri , Stephen A. Vavasis

The Forward-Forward (FF) learning algorithm provides a bottom-up alternative to backpropagation (BP) for training neural networks, relying on a layer-wise "goodness" function with well-designed negative samples for contrastive learning.…

Machine Learning · Computer Science 2025-11-11 Zhichao Zhu , Yang Qi , Hengyuan Ma , Wenlian Lu , Jianfeng Feng

Targeting solutions over `flat' regions of the loss landscape, sharpness-aware minimization (SAM) has emerged as a powerful tool to improve generalizability of deep neural network based learning. While several SAM variants have been…

Machine Learning · Computer Science 2025-01-14 Yilang Zhang , Bingcong Li , Georgios B. Giannakis

A dictionary is a database of standard vectors, so that other vectors / signals are expressed as linear combinations of dictionary vectors, and the task of learning a dictionary for a given data is to find a good dictionary so that the…

Machine Learning · Computer Science 2020-07-09 Mohammed Rayyan Sheriff , Debasish Chatterjee

In this work we address the problem of blindly reconstructing compressively sensed signals by exploiting the co-sparse analysis model. In the analysis model it is assumed that a signal multiplied by an analysis operator results in a sparse…

Information Theory · Computer Science 2013-03-27 Julian Wörmann , Simon Hawe , Martin Kleinsteuber

Despite strong empirical performance for image classification, deep neural networks are often regarded as ``black boxes'' and they are difficult to interpret. On the other hand, sparse convolutional models, which assume that a signal can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xili Dai , Mingyang Li , Pengyuan Zhai , Shengbang Tong , Xingjian Gao , Shao-Lun Huang , Zhihui Zhu , Chong You , Yi Ma

Auto-Encoders are unsupervised models that aim to learn patterns from observed data by minimizing a reconstruction cost. The useful representations learned are often found to be sparse and distributed. On the other hand, compressed sensing…

Machine Learning · Statistics 2017-07-14 Devansh Arpit , Yingbo Zhou , Hung Q. Ngo , Nils Napp , Venu Govindaraju

Many transformations in deep learning architectures are sparsely connected. When such transformations cannot be designed by hand, they can be learned, even through plain backpropagation, for instance in attention mechanisms. However, during…

Machine Learning · Statistics 2018-10-23 Peter Bloem

Recovery of arbitrarily positioned samples that are missing in sparse signals recently attracted significant research interest. Sparse signals with heavily corrupted arbitrary positioned samples could be analyzed in the same way as…

Information Theory · Computer Science 2013-09-24 Ljubisa Stankovic , Milos Dakovic , Stefan Vujovic

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

A robust algorithm is proposed to reconstruct the spatial support and the Lam\'e parameters of multiple inclusions in a homogeneous background elastic material using a few measurements of the displacement field over a finite collection of…

Numerical Analysis · Mathematics 2017-02-27 Jaejun Yoo , Younghoon Jung , Mikyoung Lim , Jong Chul Ye , Abdul Wahab

Deep neural networks have significantly alleviated the burden of feature engineering, but comparable efforts are now required to determine effective architectures for these networks. Furthermore, as network sizes have become excessively…

Machine Learning · Computer Science 2023-10-25 Yognjin Lee

In this paper, an algorithm is proposed for Image Restoration. Such algorithm is different from the traditional approaches in this area, by utilizing priors that are learned from similar images. Original images and their degraded versions…

Computer Vision and Pattern Recognition · Computer Science 2010-03-25 Md. Imran Hossain , Syed Golam Rajib

Given a convolutional dictionary underlying a set of observed signals, can a carefully designed auto-encoder recover the dictionary in the presence of noise? We introduce an auto-encoder architecture, termed constrained recurrent sparse…

Machine Learning · Computer Science 2018-07-13 Bahareh Tolooshams , Sourav Dey , Demba Ba

In blind image deconvolution, priors are often leveraged to constrain the solution space, so as to alleviate the under-determinacy. Priors which are trained separately from the task of deconvolution tend to be instable, or ineffective. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhijian Luo , Siyu Chen , Yuntao Qian