English
Related papers

Related papers: Robust Stochastically-Descending Unrolled Networks

200 papers

Deep unfolded neural networks are designed by unrolling the iterations of optimization algorithms. They can be shown to achieve faster convergence and higher accuracy than their optimization counterparts. This paper proposes a new…

Machine Learning · Computer Science 2020-10-05 Huynh Van Luong , Boris Joukovsky , Yonina C. Eldar , Nikos Deligiannis

Unrolled networks have become prevalent in various computer vision and imaging tasks. Although they have demonstrated remarkable efficacy in solving specific computer vision and computational imaging tasks, their adaptation to other…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Eric Chen , Xi Chen , Arian Maleki , Shirin Jalali

We consider inverse problems where the conditional distribution of the observation ${\bf y}$ given the latent variable of interest ${\bf x}$ (also known as the forward model) is known, and we have access to a data set in which multiple…

Machine Learning · Statistics 2023-11-14 Yves Atchade , Xinru Liu , Qiuyun Zhu

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an…

Optimization and Control · Mathematics 2025-10-02 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

Deep learning based unmixing methods have received great attention in recent years and achieve remarkable performance. These methods employ a data-driven approach to extract structure features from hyperspectral image, however, they tend to…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Min Zhao , Linruize Tang , Jie Chen

Machine unlearning algorithms aim to remove the impact of selected training data from a model without the computational expenses of retraining from scratch. Two such algorithms are ``Descent-to-Delete" (D2D) and ``Rewind-to-Delete" (R2D),…

Machine Learning · Computer Science 2026-03-02 Siqiao Mu , Diego Klabjan

Deep learning-based methods have revolutionized the field of imaging inverse problems, yielding state-of-the-art performance across various imaging domains. The best performing networks incorporate the imaging operator within the network…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Romain Vo , Julián Tachella

Deep learning methods are highly effective for many image reconstruction tasks. However, the performance of supervised learned models can degrade when applied to distinct experimental settings at test time or in the presence of distribution…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Shijun Liang , Evan Bell , Avrajit Ghosh , Saiprasad Ravishankar

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

Training deep neural networks is a very demanding task, especially challenging is how to adapt architectures to improve the performance of trained models. We can find that sometimes, shallow networks generalize better than deep networks,…

Machine Learning · Computer Science 2022-08-03 David Peer , Bart Keulen , Sebastian Stabinger , Justus Piater , Antonio Rodríguez-Sánchez

Polynomial regression is a recurrent problem with a large number of applications. In computer vision it often appears in motion analysis. Whatever the application, standard methods for regression of polynomial models tend to deliver biased…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Juan-Manuel Perez-Rua , Tomas Crivelli , Patrick Bouthemy , Patrick Perez

We propose an interpretable graph neural network framework to denoise single or multiple noisy graph signals. The proposed graph unrolling networks expand algorithm unrolling to the graph domain and provide an interpretation of the…

Signal Processing · Electrical Eng. & Systems 2021-09-08 Siheng Chen , Yonina C. Eldar , Lingxiao Zhao

Inverse problems for accelerated MRI typically incorporate domain-specific knowledge about the forward encoding operator in a regularized reconstruction framework. Recently physics-driven deep learning (DL) methods have been proposed to use…

Image and Video Processing · Electrical Eng. & Systems 2020-07-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mingyi Hong , Mehmet Akçakaya

Compressive imaging aims to recover a latent image from under-sampled measurements, suffering from a serious ill-posed inverse problem. Recently, deep neural networks have been applied to this problem with superior results, owing to the…

Image and Video Processing · Electrical Eng. & Systems 2021-10-26 Yixiao Yang , Ran Tao , Kaixuan Wei , Ying Fu

Inverse scattering problems, such as those in electromagnetic imaging using phaseless data (PD-ISPs), involve imaging objects using phaseless measurements of wave scattering. Such inverse problems can be highly non-linear and ill-posed…

Signal Processing · Electrical Eng. & Systems 2022-12-07 Samruddhi Deshmukh , Amartansh Dubey , Ross Murch

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

The integration of optimization problems within neural network architectures represents a fundamental shift from traditional approaches to handling constraints in deep learning. While it is long known that neural networks can incorporate…

Machine Learning · Computer Science 2024-12-31 Calder Katyal

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

This paper develops a randomized approach for incrementally building deep neural networks, where a supervisory mechanism is proposed to constrain the random assignment of the weights and biases, and all the hidden layers have direct links…

Machine Learning · Computer Science 2018-03-19 Dianhui Wang , Ming Li