中文
相关论文

相关论文: Deep Equilibrium Learning of Explicit Regularizers…

200 篇论文

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

机器学习 · 计算机科学 2022-02-17 Abinash Nayak

Regularization is critical for solving ill-posed geophysical inverse problems. Explicit regularization is often used, but there are opportunities to explore the implicit regularization effects that are inherent in a Neural Network…

机器学习 · 计算机科学 2024-07-10 Anran Xu , Lindsey J. Heagy

Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient…

机器学习 · 计算机科学 2022-07-20 David G. T. Barrett , Benoit Dherin

Obtaining meaningful solutions for inverse problems has been a major challenge with many applications in science and engineering. Recent machine learning techniques based on proximal and diffusion-based methods have shown promising results.…

机器学习 · 计算机科学 2024-02-08 Moshe Eliasof , Eldad Haber , Eran Treister

Machine Learning (ML) methods and tools have gained great success in many data, signal, image and video processing tasks, such as classification, clustering, object detection, semantic segmentation, language processing, Human-Machine…

机器学习 · 计算机科学 2023-09-06 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

图像与视频处理 · 电气工程与系统科学 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

Model-based optimization methods and discriminative learning methods have been the two dominant strategies for solving various inverse problems in low-level vision. Typically, those two kinds of methods have their respective merits and…

计算机视觉与模式识别 · 计算机科学 2017-04-12 Kai Zhang , Wangmeng Zuo , Shuhang Gu , Lei Zhang

The unrolling method has been investigated for learning variational models in X-ray computed tomography. However, it has been observed that directly unrolling the regularization model through gradient descent does not produce satisfactory…

图像与视频处理 · 电气工程与系统科学 2024-04-19 Yijie Yang , Qifeng Gao , Yuping Duan

Deep learning methods have been successfully used in various computer vision tasks. Inspired by that success, deep learning has been explored in magnetic resonance imaging (MRI) reconstruction. In particular, integrating deep learning and…

图像与视频处理 · 电气工程与系统科学 2023-10-06 Peizhou Huang , Chaoyi Zhang , Xiaoliang Zhang , Xiaojuan Li , Liang Dong , Leslie Ying

This paper introduces an optimal control framework to address the inverse problem using a learned regularizer, with applications in image reconstruction. We build upon the concept of Learnable Optimization Algorithms (LOA), which combine…

最优化与控制 · 数学 2024-09-04 Wanyu Bian

In recent literature there are plenty of works that combine handcrafted and learnable regularizers to solve inverse imaging problems. While this hybrid approach has demonstrated promising results, the motivation for combining handcrafted…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

机器学习 · 统计学 2025-02-04 Yasi Zhang , Oscar Leong

Machine learning techniques for the solution of inverse problems have become an attractive approach in the last decade, while their theoretical foundations are still in their infancy. In this chapter we want to pursue the study of…

数值分析 · 数学 2025-12-10 Martin Burger , Samira Kabri , Gitta Kutyniok , Yunseok Lee , Lukas Weigand

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

机器学习 · 计算机科学 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Matthieu Terris , Thomas Moreau

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible…

机器学习 · 计算机科学 2022-11-15 Colin Ponce , Ruipeng Li , Christina Mao , Panayot Vassilevski

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

机器学习 · 计算机科学 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

统计理论 · 数学 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

机器学习 · 计算机科学 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini