English
Related papers

Related papers: Comparison between Supervised and Unsupervised Lea…

200 papers

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

The problem of phase retrieval (PR) involves recovering an unknown image from limited amplitude measurement data and is a challenge nonlinear inverse problem in computational imaging and image processing. However, many of the PR methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Aoxu Liu , Xiaohong Fan , Yin Yang , Jianping Zhang

Traditional feature-based image stitching technologies rely heavily on feature detection quality, often failing to stitch images with few features or low resolution. The learning-based image stitching solutions are rarely studied due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Lang Nie , Chunyu Lin , Kang Liao , Shuaicheng Liu , Yao Zhao

In this paper we consider algorithm unfolding for the Multiple Measurement Vector (MMV) problem in the case where only few training samples are available. Algorithm unfolding has been shown to empirically speed-up in a data-driven way the…

Information Theory · Computer Science 2024-10-22 Jan Christian Hauffen , Peter Jung , Nicole Mücke

Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of…

Optimization and Control · Mathematics 2022-09-29 Saeed Damadi , Jinglai Shen

The idea of compressed sensing is to exploit representations in suitable (overcomplete) dictionaries that allow to recover signals far beyond the Nyquist rate provided that they admit a sparse representation in the respective dictionary.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-22 Michael Moeller , Otmar Loffeld , Juergen Gall , Felix Krahmer

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

Resource allocation and transceivers in wireless networks are usually designed by solving optimization problems subject to specific constraints, which can be formulated as variable or functional optimization. If the objective and constraint…

Machine Learning · Computer Science 2020-01-06 Dong Liu , Chengjian Sun , Chenyang Yang , Lajos Hanzo

Solving linear inverse problems plays a crucial role in numerous applications. Algorithm unfolding based, model-aware data-driven approaches have gained significant attention for effectively addressing these problems. Learned iterative…

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters,…

Optimization and Control · Mathematics 2020-01-23 Carla Bertocchi , Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Marco Prato

Magnetic Resonance Imaging (MRI) is widely used in clinical practice, but suffered from prolonged acquisition time. Although deep learning methods have been proposed to accelerate acquisition and demonstrate promising performance, they rely…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Hao Zhang , Qi Wang , Jian Sun , Zhijie Wen , Jun Shi , Shihui Ying

Optimization-based solvers play a central role in a wide range of signal processing and communication tasks. However, their applicability in latency-sensitive systems is limited by the sequential nature of iterative methods and the high…

Signal Processing · Electrical Eng. & Systems 2026-03-12 Dvir Avrahami , Amit Milstein , Caroline Chaux , Tirza Routtenberg , Nir Shlezinger

Optimization methods play a central role in signal processing, serving as the mathematical foundation for inference, estimation, and control. While classical iterative optimization algorithms provide interpretability and theoretical…

Machine Learning · Computer Science 2026-04-01 Nir Shlezinger , Santiago Segarra , Yi Zhang , Dvir Avrahami , Zohar Davidov , Tirza Routtenberg , Yonina C. Eldar

Deep unfolding methods---for example, the learned iterative shrinkage thresholding algorithm (LISTA)---design deep neural networks as learned variations of optimization methods. These networks have been shown to achieve faster convergence…

Machine Learning · Computer Science 2020-03-19 Huynh Van Luong , Boris Joukovsky , Nikos Deligiannis

Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of the feature extractor (i.e., last hidden layer) and a linear classifier (i.e., output layer) that are trained jointly with stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2022-11-28 Xin Li , Xiangrui Li , Deng Pan , Yao Qiang , Dongxiao Zhu

This paper proposes a federated learning technique for deep algorithm unfolding with applications to sparse signal recovery and compressed sensing. We refer to this architecture as Fed-CS. Specifically, we unfold and learn the iterative…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Komal Krishna Mogilipalepu , Sumanth Kumar Modukuri , Amarlingam Madapu , Sundeep Prabhakar Chepuri

Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, the existing…

Machine Learning · Computer Science 2017-06-22 Bo Liu , Xiao-Tong Yuan , Lezi Wang , Qingshan Liu , Dimitris N. Metaxas

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

This paper presents a novel hybrid approach that integrates linear programming (LP) within the loss function of an unsupervised machine learning model. By leveraging the strengths of both optimization techniques and machine learning, this…

Machine Learning · Computer Science 2025-04-21 Andrew Kiruluta , Andreas Lemos

In this paper, we address the problem of distributed sparse recovery of signals acquired via compressed measurements in a sensor network. We propose a new class of distributed algorithms to solve Lasso regression problems, when the…

Information Theory · Computer Science 2013-10-15 Chiara Ravazzi , Sophie M. Fosson , Enrico Magli