English
Related papers

Related papers: Online Deep Equilibrium Learning for Regularizatio…

200 papers

Image denoisers have been shown to be powerful priors for solving inverse problems in imaging. In this work, we introduce a generalization of these methods that allows any image restoration network to be used as an implicit prior. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Yuyang Hu , Mauricio Delbracio , Peyman Milanfar , Ulugbek S. Kamilov

We introduce a novel energy formulation for Plug- and-Play (PnP) image recovery. Traditional PnP methods that use a convolutional neural network (CNN) do not have an energy based formulation. The primary focus of this work is to introduce…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Jyothi Rikabh Chand , Mathews Jacob

In recent years, Diffusion Models have become the new state-of-the-art in deep generative modeling, ending the long-time dominance of Generative Adversarial Networks. Inspired by the Regularization by Denoising principle, we introduce an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Pasquale Cascarano , Lorenzo Stacchio , Andrea Sebastiani , Alessandro Benfenati , Ulugbek S. Kamilov , Gustavo Marfia

Deep equilibrium (DEQ) models are widely recognized as a memory efficient alternative to standard neural networks, achieving state-of-the-art performance in language modeling and computer vision tasks. These models solve a fixed point…

Machine Learning · Computer Science 2024-06-25 Mateusz Gabor , Tomasz Piotrowski , Renato L. G. Cavalcante

Denoiser models have become powerful tools for inverse problems, enabling the use of pretrained networks to approximate the score of a smoothed prior distribution. These models are often used in heuristic iterative schemes aimed at solving…

Machine Learning · Computer Science 2025-11-20 Scott Pesme , Giacomo Meanti , Michael Arbel , Julien Mairal

Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenxin Fan , Jian Cheng , Qiyuan Tian , Ruoyou Wu , Juan Zou , Zan Chen , Shanshan Wang

Achieving high-quality Magnetic Resonance Imaging (MRI) reconstruction at accelerated acquisition rates remains challenging due to the inherent ill-posed nature of the inverse problem. Traditional Compressed Sensing (CS) methods, while…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Pierre-Antoine Comby , Benjamin Lapostolle , Matthieu Terris , Philippe Ciuciu

Deep equilibrium models (DEQ) have emerged as a powerful alternative to deep unfolding (DU) for image reconstruction. DEQ models-implicit neural networks with effectively infinite number of layers-were shown to achieve state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Weijie Gan , Chunwei Ying , Parna Eshraghi , Tongyao Wang , Cihat Eldeniz , Yuyang Hu , Jiaming Liu , Yasheng Chen , Hongyu An , Ulugbek S. Kamilov

The inherent ill-posed nature of image reconstruction problems, due to limitations in the physical acquisition process, is typically addressed by introducing a regularisation term that incorporates prior knowledge about the underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Naïl Khelifa , Ferdia Sherry , Carola-Bibiane Schönlieb

Equivariant imaging (EI) enables training signal reconstruction models without requiring ground truth data by leveraging signal symmetries. Deep equilibrium models (DEQs) are a powerful class of neural networks where the output is a fixed…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Alexander Mehta , Ruangrawee Kitichotkul , Vivek K Goyal , Julián Tachella

Poisson-Gaussian noise describes the noise of various imaging systems thus the need of efficient algorithms for Poisson-Gaussian image restoration. Deep learning methods offer state-of-the-art performance but often require sensor-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

Deep Equilibrium Models (DEQs) are an interesting class of implicit model where the model output is implicitly defined as the fixed point of a learned function. These models have been shown to outperform explicit (fixed-depth) models in…

Machine Learning · Computer Science 2025-12-04 Sam McCallum , Kamran Arora , James Foster

Deep image prior (DIP) serves as a good inductive bias for diverse inverse problems. Among them, denoising is known to be particularly challenging for the DIP due to noise fitting with the requirement of an early stopping. To address the…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Yeonsik Jo , Se Young Chun , Jonghyun Choi

In compressed sensing (CS) MRI, model-based methods are pivotal to achieving accurate reconstruction. One of the main challenges in model-based methods is finding an effective prior to describe the statistical distribution of the target…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Tao Hong , Zhaoyi Xu , Se Young Chun , Luis Hernandez-Garcia , Jeffrey A. Fessler

Deep image prior (DIP) is an unsupervised deep learning framework that has been successfully applied to a variety of inverse imaging problems. However, DIP-based methods are inherently prone to overfitting, which leads to performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Panagiotis Gkotsis , Athanasios A. Rontogiannis

Implicit models separate the definition of a layer from the description of its solution process. While implicit layers allow features such as depth to adapt to new scenarios and inputs automatically, this adaptivity makes its computational…

Machine Learning · Computer Science 2023-03-06 Avik Pal , Alan Edelman , Christopher Rackauckas

Deep equilibrium models (DEQs) achieve infinitely deep network representations without stacking layers by exploring fixed points of layer transformations in neural networks. Such models constitute an innovative approach that achieves…

Machine Learning · Computer Science 2026-02-04 Naoki Sato , Hideaki Iiduka

Dynamic imaging addresses the recovery of a time-varying 2D or 3D object at each time instant using its undersampled measurements. In particular, in the case of dynamic tomography, only a single projection at a single view angle may be…

Image and Video Processing · Electrical Eng. & Systems 2024-05-09 Berk Iskender , Marc L. Klasky , Yoram Bresler

We propose a new approach for large-scale high-dynamic range computational imaging. Deep Neural Networks (DNNs) trained end-to-end can solve linear inverse imaging problems almost instantaneously. While unfolded architectures provide…

Instrumentation and Methods for Astrophysics · Physics 2023-09-28 Amir Aghabiglou , Matthieu Terris , Adrian Jackson , Yves Wiaux

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay