English
Related papers

Related papers: Self-Supervised Deep Equilibrium Models for Invers…

200 papers

Neural networks with wide layers have attracted significant attention due to their equivalence to Gaussian processes, enabling perfect fitting of training data while maintaining generalization performance, known as benign overfitting.…

Machine Learning · Computer Science 2023-10-18 Tianxiang Gao , Xiaokai Huo , Hailiang Liu , Hongyang Gao

Deep equilibrium networks (DEQs) are a promising way to construct models which trade off memory for compute. However, theoretical understanding of these models is still lacking compared to traditional networks, in part because of the…

Machine Learning · Computer Science 2022-07-20 Atish Agarwala , Samuel S. Schoenholz

Deep model-based architectures (DMBAs) are widely used in imaging inverse problems to integrate physical measurement models and learned image priors. Plug-and-play priors (PnP) and deep equilibrium models (DEQ) are two DMBA frameworks that…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Junhao Hu , Shirin Shoushtari , Zihao Zou , Jiaming Liu , Zhixin Sun , Ulugbek S. Kamilov

We consider using {\bf\em untrained neural networks} to solve the reconstruction problem of snapshot compressive imaging (SCI), which uses a two-dimensional (2D) detector to capture a high-dimensional (usually 3D) data-cube in a compressed…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Ziyi Meng , Zhenming Yu , Kun Xu , Xin Yuan

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Implicit-depth models such as Deep Equilibrium Networks have recently been shown to match or exceed the performance of traditional deep networks while being much more memory efficient. However, these models suffer from unstable convergence…

Machine Learning · Computer Science 2021-05-05 Ezra Winston , J. Zico Kolter

Image reconstruction from undersampled k-space data plays an important role in accelerating the acquisition of MR data, and a lot of deep learning-based methods have been exploited recently. Despite the achieved inspiring results, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Chen Hu , Cheng Li , Haifeng Wang , Qiegen Liu , Hairong Zheng , Shanshan Wang

Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Reinhard Heckel , Paul Hand

The unrolling method has been investigated for learning variational models in X-ray computed tomography. However, it has been observed that directly unrolling the regularization model through gradient descent does not produce satisfactory…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Yijie Yang , Qifeng Gao , Yuping Duan

Reconstructing MR images using deep neural networks from undersampled k-space data without using fully sampled training references offers significant value in practice, which is a self-supervised regression problem calling for effective…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Liyan Sun , Shaocong Yu , Chi Zhang , Xinghao Ding

Recent attempts to use deep learning for super-resolution reconstruction of turbulent flows have used supervised learning, which requires paired data for training. This limitation hinders more practical applications of super-resolution…

Fluid Dynamics · Physics 2021-02-03 Hyojin Kim , Junhyuk Kim , Sungjin Won , Changghoon Lee

Self-supervised monocular depth estimation (SSMDE) has gained attention in the field of deep learning as it estimates depth without requiring ground truth depth maps. This approach typically uses a photometric consistency loss between a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wonhyeok Choi , Kyumin Hwang , Minwoo Choi , Kiljoon Han , Wonjoon Choi , Mingyu Shin , Sunghoon Im

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Reconstructing dynamic MRI image sequences from undersampled accelerated measurements is crucial for faster and higher spatiotemporal resolution real-time imaging of cardiac motion, free breathing motion and many other applications.…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Andrew Wang , Mike Davies

Deep Equilibrium (DEQ) Models, an emerging class of implicit models that maps inputs to fixed points of neural networks, are of growing interest in the deep learning community. However, training and applying DEQ models is currently done in…

Machine Learning · Computer Science 2023-10-31 Zhengyang Geng , J. Zico Kolter

The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human…

Quantum Physics · Physics 2022-04-05 Ben Jaderberg , Lewis W. Anderson , Weidi Xie , Samuel Albanie , Martin Kiffner , Dieter Jaksch

Supervised deep learning-based hash and vector quantization are enabling fast and large-scale image retrieval systems. By fully exploiting label annotations, they are achieving outstanding retrieval performances compared to the conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Young Kyun Jang , Nam Ik Cho

Deep learning has shown impressive results in reducing noise and artifacts in X-ray computed tomography (CT) reconstruction. Self-supervised CT reconstruction methods are especially appealing for real-world applications because they require…

Image and Video Processing · Electrical Eng. & Systems 2026-05-06 Dirk Elias Schut , Adriaan Graas , Robert van Liere , Tristan van Leeuwen

Magnetic Resonance Imaging (MRI) is widely used in clinical practice, but suffered from prolonged acquisition time. Although deep learning methods have been proposed to accelerate acquisition and demonstrate promising performance, they rely…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Hao Zhang , Qi Wang , Jian Sun , Zhijie Wen , Jun Shi , Shihui Ying

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter