English
Related papers

Related papers: Deep Equilibrium Learning of Explicit Regularizers…

200 papers

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

Most existing methods usually formulate the non-blind deconvolution problem into a maximum-a-posteriori framework and address it by manually designing kinds of regularization terms and data terms of the latent clear images. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Pin-Hung Kuo , Jinshan Pan , Shao-Yi Chien , Ming-Hsuan Yang

Recently, deep unfolding methods that guide the design of deep neural networks (DNNs) through iterative algorithms have received increasing attention in the field of inverse problems. Unlike general end-to-end DNNs, unfolding methods have…

Optimization and Control · Mathematics 2022-11-28 Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang

Implicit models separate the definition of a layer from the description of its solution process. While implicit layers allow features such as depth to adapt to new scenarios and inputs automatically, this adaptivity makes its computational…

Machine Learning · Computer Science 2023-03-06 Avik Pal , Alan Edelman , Christopher Rackauckas

We propose to learn non-convex regularizers with a prescribed upper bound on their weak-convexity modulus. Such regularizers give rise to variational denoisers that minimize a convex energy. They rely on few parameters (less than 15,000)…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Alexis Goujon , Sebastian Neumayer , Michael Unser

This paper aims to solve numerically the two-dimensional inverse medium scattering problem with far-field data. This is a challenging task due to the severe ill-posedness and strong nonlinearity of the inverse problem. As already known, it…

Numerical Analysis · Mathematics 2025-09-25 Kai Li , Bo Zhang , Haiwen Zhang

We propose a novel deep learning method which combines classical regularization with data augmentation for estimating myelin water fraction (MWF) in the brain via biexponential analysis. Our aim is to design an accurate deep learning…

Quantitative Methods · Quantitative Biology 2025-01-31 Mirage Modi , Shashank Sule , Jonathan Palumbo , Michael Rozowski , Mustapha Bouhrara , Wojciech Czaja , Richard G. Spencer

Imaging is a standard example of an inverse problem, where the task of reconstructing a ground truth from a noisy measurement is ill-posed. Recent state-of-the-art approaches for imaging use deep learning, spearheaded by unrolled and…

The present paper deals with the data-driven design of regularizers in the form of artificial neural networks, for solving certain inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy,…

Optimization and Control · Mathematics 2023-03-06 Sebastien Court

Deep Learning (DL) is a machine learning procedure for artificial intelligence that analyzes the input data in detail by increasing neuron sizes and number of the hidden layers. DL has a popularity with the common improvements on the…

Machine Learning · Computer Science 2021-01-26 Gokhan Altan , Yakup Kutlu

Implicit deep learning has recently gained popularity with applications ranging from meta-learning to Deep Equilibrium Networks (DEQs). In its general formulation, it relies on expressing some components of deep learning pipelines…

Machine Learning · Computer Science 2023-05-25 Zaccharie Ramzi , Pierre Ablin , Gabriel Peyré , Thomas Moreau

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

We propose a new class of implicit networks, the multiscale deep equilibrium model (MDEQ), suited to large-scale and highly hierarchical pattern recognition domains. An MDEQ directly solves for and backpropagates through the equilibrium…

Machine Learning · Computer Science 2020-11-25 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Deep equilibrium networks (DEQs) are a new class of models that eschews traditional depth in favor of finding the fixed point of a single nonlinear layer. These models have been shown to achieve performance competitive with the…

Machine Learning · Computer Science 2021-06-29 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Deep neural networks have been shown to be highly miscalibrated. often they tend to be overconfident in their predictions. It poses a significant challenge for safety-critical systems to utilise deep neural networks (DNNs), reliably. Many…

Machine Learning · Computer Science 2022-05-05 Aditya Singh , Alessandro Bay , Biswa Sengupta , Andrea Mirabile

Dense depth and surface normal predictors should possess the equivariant property to cropping-and-resizing -- cropping the input image should result in cropping the same output image. However, we find that state-of-the-art depth and normal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yuanyi Zhong , Anand Bhattad , Yu-Xiong Wang , David Forsyth

Recently, deep learning methods have shown significant improvements in communication systems. In this paper, we study the equalization problem over the nonlinear channel using neural networks. The joint equalizer and decoder based on neural…

Signal Processing · Electrical Eng. & Systems 2018-07-06 Weihong Xu , Zhiwei Zhong , Yair Be'ery , Xiaohu You , Chuan Zhang