English
Related papers

Related papers: Self-Supervised Deep Equilibrium Models for Invers…

200 papers

Model-based representations recently stand out as a promising framework that embeds latent dynamics information into the representations for downstream off-policy actor-critic learning. It implicitly combines the advantages of both…

Machine Learning · Computer Science 2026-05-13 Jiafei Lyu , Zichuan Lin , Scott Fujimoto , Kai Yang , Yangkun Chen , Saiyong Yang , Zongqing Lu , Deheng Ye

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

We propose SUB-Depth, a universal multi-task training framework for self-supervised monocular depth estimation (SDE). Depth models trained with SUB-Depth outperform the same models trained in a standard single-task SDE framework. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hang Zhou , Sarah Taylor , David Greenwood , Michal Mackiewicz

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

Implicit models such as Deep Equilibrium Models (DEQs) have emerged as promising alternative approaches for building deep neural networks. Their certified robustness has gained increasing research attention due to security concerns.…

Machine Learning · Computer Science 2024-11-05 Weizhi Gao , Zhichao Hou , Han Xu , Xiaorui Liu

Learning based methods are now ubiquitous for solving inverse problems, but their deployment in real-world applications is often hindered by the lack of ground truth references for training. Recent self-supervised learning strategies offer…

Image and Video Processing · Electrical Eng. & Systems 2026-02-27 Victor Sechaud , Laurent Jacques , Patrice Abry , Julián Tachella

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

Image and Video Processing · Electrical Eng. & Systems 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

State-of-the-art computer codes for simulating real physical systems are often characterized by a vast number of input parameters. Performing uncertainty quantification (UQ) tasks with Monte Carlo (MC) methods is almost always infeasible…

Computational Physics · Physics 2018-10-17 Rohit Tripathy , Ilias Bilionis

Multimodal fusion integrates the complementary information present in multiple modalities and has gained much attention recently. Most existing fusion approaches either learn a fixed fusion strategy during training and inference, or are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Jinhong Ni , Yalong Bai , Wei Zhang , Ting Yao , Tao Mei

Reconstructing MRI from highly undersampled measurements is crucial for accelerating medical imaging, but is challenging due to the ill-posedness of the inverse problem. While supervised deep learning (DL) approaches have shown remarkable…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Andrew Wang , Steven McDonagh , Mike Davies

In recent studies on MRI reconstruction, advances have shown significant promise for further accelerating the MRI acquisition. Most state-of-the-art methods require a large amount of fully-sampled data to optimise reconstruction models,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-04 Junwei Yang , Pietro Liò

Supervised training of deep neural networks on pairs of clean image and noisy measurement achieves state-of-the-art performance for many image reconstruction tasks, but such training pairs are difficult to collect. Self-supervised methods…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Tobit Klug , Dogukan Atik , Reinhard Heckel

Deep learning (DL) has shown promise for faster, high quality accelerated MRI reconstruction. However, supervised DL methods depend on extensive amounts of fully-sampled (labeled) data and are sensitive to out-of-distribution (OOD) shifts,…

We propose a model-based deep learning architecture for the reconstruction of highly accelerated diffusion magnetic resonance imaging (MRI) that enables high resolution imaging. The proposed reconstruction jointly recovers all the diffusion…

Image and Video Processing · Electrical Eng. & Systems 2020-01-24 Merry P. Mani , Hemant K. Aggarwal , Sanjay Ghosh , Mathews Jacob

Dual-energy computed tomography (DECT) enables material-specific imaging through acquisitions at two different X-ray energy spectra. Material decomposition from DECT data is an ill-posed inverse problem that is highly sensitive to noise…

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Riccardo Barbano , Zeljko Kereta , Andreas Hauptmann , Simon R. Arridge , Bangti Jin

Dense depth estimation and 3D reconstruction of a surgical scene are crucial steps in computer assisted surgery. Recent work has shown that depth estimation from a stereo images pair could be solved with convolutional neural networks.…

Image and Video Processing · Electrical Eng. & Systems 2021-07-24 Baoru Huang , Jianqing Zheng , Anh Nguyen , David Tuch , Kunal Vyas , Stamatia Giannarou , Daniel S. Elson

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Deep neural network based methods are the state of the art in various image restoration problems. Standard supervised learning frameworks require a set of noisy measurement and clean image pairs for which a distance between the output of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Rihuan Ke , Carola-Bibiane Schönlieb