English
Related papers

Related papers: Equivariant plug-and-play image reconstruction

200 papers

Deep networks provide state-of-the-art performance in multiple imaging inverse problems ranging from medical imaging to computational photography. However, most existing networks are trained with clean signals which are often hard or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dongdong Chen , Julián Tachella , Mike E. Davies

Equivariance is a powerful inductive bias in neural networks, improving generalisation and physical consistency. Recently, however, non-equivariant models have regained attention, due to their better runtime performance and imperfect…

Machine Learning · Computer Science 2026-05-27 Torben Berndt , Jan Stühmer

We aim at the solution of inverse problems in imaging, by combining a penalized sparse representation of image patches with an unconstrained smooth one. This allows for a straightforward interpretation of the reconstruction. We formulate…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Stanislas Ducotterd , Sebastian Neumayer , Michael Unser

Plug-and-play (PnP) methods that employ application-specific denoisers have been proposed to solve inverse problems, including MRI reconstruction. However, training application-specific denoisers is not feasible for many applications due to…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Sizhuo Liu , Philip Schniter , Rizwan Ahmad

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ernest K. Ryu , Jialin Liu , Sicheng Wang , Xiaohan Chen , Zhangyang Wang , Wotao Yin

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, using adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Kanchana Vaishnavi Gandikota , Jonas Geiping , Zorah Lähner , Adam Czapliński , Michael Moeller

Image denoising stands as a critical challenge in image processing and computer vision, aiming to restore the original image from noise-affected versions caused by various intrinsic and extrinsic factors. This process is essential for…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Peter Luvton , Alfredo Castillejos , Jim Zhao , Christina Chajo

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Kai Sheng Tai , Peter Bailis , Gregory Valiant

Plug-and-play approaches to solving inverse problems such as restoration and super-resolution have recently benefited from Diffusion-based generative priors for natural as well as medical images. However, solutions often use the standard…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Saikat Roy , Mahmoud Mostapha , Radu Miron , Matt Holbrook , Mariappan Nadar

Plug and Play (PnP) methods achieve remarkable results in the framework of image restoration problems for Gaussian data. Nonetheless, the theory available for the Gaussian case cannot be extended to the Poisson case, due to the…

Numerical Analysis · Mathematics 2025-10-20 Alessandro Benfenati

This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-16 Antoine Monod , Julie Delon , Matias Tassano , Andrés Almansa

Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing…

Machine Learning · Computer Science 2022-11-15 Tycho F. A. van der Ouderaa , David W. Romero , Mark van der Wilk

Spectral unmixing is a widely used technique in hyperspectral image processing and analysis. It aims to separate mixed pixels into the component materials and their corresponding abundances. Early solutions to spectral unmixing are…

Signal Processing · Electrical Eng. & Systems 2021-04-27 Min zhao , Xiuheng Wang , Jie Chen , Wei Chen

Equivariant neural networks enforce symmetry within the structure of their convolutional layers, resulting in a substantial improvement in sample efficiency when learning an equivariant or invariant function. Such models are applicable to…

Robotics · Computer Science 2022-03-10 Dian Wang , Robin Walters , Robert Platt

The utilisation of Plug-and-Play (PnP) priors in inverse problems has become increasingly prominent in recent years. This preference is based on the mathematical equivalence between the general proximal operator and the regularised…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yanqi Cheng , Lipei Zhang , Zhenda Shen , Shujun Wang , Lequan Yu , Raymond H. Chan , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Image restoration refers to the process of reconstructing noisy, destroyed, or missing parts of an image, which is an ill-posed inverse problem. A specific regularization term and image degradation are typically assumed to achieve…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Jianwei Ke

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Plug-and-Play (PnP) methods are efficient iterative algorithms for solving ill-posed image inverse problems. PnP methods are obtained by using deep Gaussian denoisers instead of the proximal operator or the gradient-descent step within…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Samuel Hurault , Ulugbek Kamilov , Arthur Leclaire , Nicolas Papadakis

The Plug-and-Play (PnP) framework was recently introduced for low-dose CT reconstruction to leverage the interpretability and the flexibility of model-based methods to incorporate various plugins, such as trained deep learning (DL) neural…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Qifan Xu , Qihui Lyu , Dan Ruan , Ke Sheng