中文
相关论文

相关论文: Deep Equilibrium Learning of Explicit Regularizers…

200 篇论文

Implicit Neural Representation (INR) has emerged as an effective method for unsupervised image denoising. However, INR models are typically overparameterized; consequently, these models are prone to overfitting during learning, resulting in…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Zipei Yan , Zhengji Liu , Jizhou Li

Works on implicit regularization have studied gradient trajectories during the optimization process to explain why deep networks favor certain kinds of solutions over others. In deep linear networks, it has been shown that gradient descent…

机器学习 · 计算机科学 2023-06-02 Dan Zhao

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

图像与视频处理 · 电气工程与系统科学 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

We construct custom regularization functions for use in supervised training of deep neural networks. Our technique is applicable when the ground-truth labels themselves exhibit internal structure; we derive a regularizer by learning an…

计算机视觉与模式识别 · 计算机科学 2018-04-09 Mohammadreza Mostajabi , Michael Maire , Gregory Shakhnarovich

Deep Equilibrium Models (DEQs) are an interesting class of implicit model where the model output is implicitly defined as the fixed point of a learned function. These models have been shown to outperform explicit (fixed-depth) models in…

机器学习 · 计算机科学 2025-12-04 Sam McCallum , Kamran Arora , James Foster

Equivariant imaging (EI) enables training signal reconstruction models without requiring ground truth data by leveraging signal symmetries. Deep equilibrium models (DEQs) are a powerful class of neural networks where the output is a fixed…

图像与视频处理 · 电气工程与系统科学 2025-11-25 Alexander Mehta , Ruangrawee Kitichotkul , Vivek K Goyal , Julián Tachella

We investigate geometric regularization strategies for learned latent representations in encoder--decoder reduced-order models. In a fixed experimental setting for the advection--diffusion--reaction (ADR) equation, we model latent dynamics…

机器学习 · 计算机科学 2026-03-04 Mikhail Osipov

Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…

最优化与控制 · 数学 2024-01-17 Danilo Riccio , Matthias J. Ehrhardt , Martin Benning

Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in…

图像与视频处理 · 电气工程与系统科学 2021-06-04 Davis Gilton , Gregory Ongie , Rebecca Willett

Deep learning systems are known to exhibit implicit regularization (alt. implicit bias), favoring simple solutions instead of merely minimizing the loss function. In some cases, we can analytically derive the implicit regularization --…

机器学习 · 统计学 2026-05-08 Joseph H. Rudoler , Kevin Tan , Giles Hooker , Konrad P. Kording

The inherent ill-posed nature of image reconstruction problems, due to limitations in the physical acquisition process, is typically addressed by introducing a regularisation term that incorporates prior knowledge about the underlying…

图像与视频处理 · 电气工程与系统科学 2025-03-11 Naïl Khelifa , Ferdia Sherry , Carola-Bibiane Schönlieb

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

数值分析 · 数学 2025-08-22 Fatemeh Pourahmadian , Yang Xu

This paper proposes a regularizer called Implicit Neural Representation Regularizer (INRR) to improve the generalization ability of the Implicit Neural Representation (INR). The INR is a fully connected network that can represent signals…

机器学习 · 计算机科学 2023-03-29 Zhemin Li , Hongxia Wang , Deyu Meng

Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT…

数值分析 · 数学 2021-11-16 Stephan Antholzer , Markus Haltmeier

Deep Equilibrium Models (DEQs) are an established framework for image restoration that learn a problem-adapted regularization by solving a fixed-point (i.e. equilibrium) problem. While flexible and expressive, DEQs are often hindered by…

最优化与控制 · 数学 2026-05-20 Antonin Clerc , Marien Renaud , Baudouin Denis De Seneville , Nicolas Papadakis

Ultrasound elasticity images which enable the visualization of quantitative maps of tissue stiffness can be reconstructed by solving an inverse problem. Classical model-based approaches for ultrasound elastography use deterministic finite…

图像与视频处理 · 电气工程与系统科学 2021-07-29 Narges Mohammadi , Marvin M. Doyley , Mujdat Cetin

Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore…

机器学习 · 计算机科学 2022-08-18 Hyounguk Shon , Janghyeon Lee , Seung Hwan Kim , Junmo Kim

We introduce a new algorithm for regularized reconstruction of multispectral (MS) images from noisy linear measurements. Unlike traditional approaches, the proposed algorithm regularizes the recovery problem by using a prior specified…

图像与视频处理 · 电气工程与系统科学 2019-09-23 Jiaming Liu , Yu Sun , Ulugbek S. Kamilov

We introduce a deep learning (DL) framework for inverse problems in imaging, and demonstrate the advantages and applicability of this approach in passive synthetic aperture radar (SAR) image reconstruction. We interpret image recon-…

计算机视觉与模式识别 · 计算机科学 2018-03-14 Bariscan Yonel , Eric Mason , Birsen Yazıcı