English
Related papers

Related papers: Restarted contractive operators to learn at equili…

200 papers

We introduce a deep learning (DL) framework for inverse problems in imaging, and demonstrate the advantages and applicability of this approach in passive synthetic aperture radar (SAR) image reconstruction. We interpret image recon-…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Bariscan Yonel , Eric Mason , Birsen Yazıcı

When optimizing over-parameterized models, such as deep neural networks, a large set of parameters can achieve zero training error. In such cases, the choice of the optimization algorithm and its respective hyper-parameters introduces…

Machine Learning · Computer Science 2019-12-06 Gauthier Gidel , Francis Bach , Simon Lacoste-Julien

Transductive few-shot learning has recently triggered wide attention in computer vision. Yet, current methods introduce key hyper-parameters, which control the prediction statistics of the test batches, such as the level of class balance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Long Zhou , Fereshteh Shakeri , Aymen Sadraoui , Mounir Kaaniche , Jean-Christophe Pesquet , Ismail Ben Ayed

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters,…

Optimization and Control · Mathematics 2020-01-23 Carla Bertocchi , Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Marco Prato

We learn recurrent neural network optimizers trained on simple synthetic functions by gradient descent. We show that these learned optimizers exhibit a remarkable degree of transfer in that they can be used to efficiently optimize a broad…

Hyperspectral unmixing (HU) is crucial for analyzing hyperspectral imagery, yet achieving accurate unmixing remains challenging. While traditional methods struggle to effectively model complex spectral-spatial features, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chentong Wang , Jincheng Gao , Fei Zhu , Jie Chen

Reconstructing spectral functions from Euclidean Green's functions is an important inverse problem in physics. The prior knowledge for specific physical systems routinely offers essential regularization schemes for solving the ill-posed…

Computational Physics · Physics 2021-12-14 Lingxiao Wang , Shuzhe Shi , Kai Zhou

Recovering high-resolution images from limited sensory data typically leads to a serious ill-posed inverse problem, demanding inversion algorithms that effectively capture the prior information. Learning a good inverse mapping from training…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Morteza Mardani , Qingyun Sun , Shreyas Vasawanala , Vardan Papyan , Hatef Monajemi , John Pauly , David Donoho

A broad class of problems at the core of computational imaging, sensing, and low-level computer vision reduces to the inverse problem of extracting latent images that follow a prior distribution, from measurements taken under a known…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Steven Diamond , Vincent Sitzmann , Felix Heide , Gordon Wetzstein

Finite Rate of Innovation (FRI) sampling theory enables reconstruction of classes of continuous non-bandlimited signals that have a small number of free parameters from their low-rate discrete samples. This task is often translated into a…

Signal Processing · Electrical Eng. & Systems 2023-07-21 Vincent C. H. Leung , Jun-Jie Huang , Yonina C. Eldar , Pier Luigi Dragotti

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

This paper proposes a set of new error criteria and learning approaches, Adaptive Normalized Risk-Averting Training (ANRAT), to attack the non-convex optimization problem in training deep neural networks (DNNs). Theoretically, we…

Machine Learning · Computer Science 2016-06-10 Zhiguang Wang , Tim Oates , James Lo

In recent years, algorithm unrolling has emerged as a powerful technique for designing interpretable neural networks based on iterative algorithms. Imaging inverse problems have particularly benefited from unrolling-based deep network…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Yanan Zhao , Yuelong Li , Haichuan Zhang , Vishal Monga , Yonina C. Eldar

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high…

Optimization and Control · Mathematics 2025-10-20 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser

In this paper, we unroll the dynamics of the dual ascent (DA) algorithm in two coupled graph neural networks (GNNs) to solve constrained optimization problems. The two networks interact with each other at the layer level to find a saddle…

Machine Learning · Computer Science 2026-02-03 Samar Hadou , Alejandro Ribeiro

Incorporating encoding-decoding nets with adversarial nets has been widely adopted in image generation tasks. We observe that the state-of-the-art achievements were obtained by carefully balancing the reconstruction loss and adversarial…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Zhifei Zhang , Yang Song , Hairong Qi