中文
相关论文

相关论文: Deep Equilibrium Learning of Explicit Regularizers…

200 篇论文

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

图像与视频处理 · 电气工程与系统科学 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

In this paper, we propose a deep learning-based method, deep Euler method (DEM) to solve ordinary differential equations. DEM significantly improves the accuracy of the Euler method by approximating the local truncation error with deep…

数值分析 · 数学 2020-03-24 Xing Shen , Xiaoliang Cheng , Kewei Liang

Deep learning is a powerful tool for solving nonlinear differential equations, but usually, only the solution corresponding to the flattest local minimizer can be found due to the implicit regularization of stochastic gradient descent. This…

数值分析 · 数学 2021-03-17 Yiqi Gu , Chunmei Wang , Haizhao Yang

In modern deep learning, the models are learned by applying gradient updates using an optimizer, which transforms the updates based on various statistics. Optimizers are often hand-designed and tuning their hyperparameters is a big part of…

机器学习 · 计算机科学 2024-10-08 Gus Kristiansen , Mark Sandler , Andrey Zhmoginov , Nolan Miller , Anirudh Goyal , Jihwan Lee , Max Vladymyrov

We approach the problem of implicit regularization in deep learning from a geometrical viewpoint. We highlight a regularization effect induced by a dynamical alignment of the neural tangent features introduced by Jacot et al, along a small…

Commercial iterative reconstruction techniques on modern CT scanners target radiation dose reduction but there are lingering concerns over their impact on image appearance and low contrast detectability. Recently, machine learning,…

计算机视觉与模式识别 · 计算机科学 2019-07-16 Hongming Shan , Atul Padole , Fatemeh Homayounieh , Uwe Kruger , Ruhani Doda Khera , Chayanin Nitiwarangkul , Mannudeep K. Kalra , Ge Wang

The solution of nonlinear electromagnetic (EM) inverse scattering problems is typically hindered by several challenges such as ill-posedness, strong nonlinearity, and high computational costs. Recently, deep learning has been demonstrated…

计算物理 · 物理学 2020-01-08 Lianlin Li , Long Gang Wang , Fernando L. Teixeira

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

机器学习 · 计算机科学 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

Classical model-based imaging methods for ultrasound elasticity inverse problem require prior constraints about the underlying elasticity patterns, while finding the appropriate hand-crafted prior for each tissue type is a challenge. In…

图像与视频处理 · 电气工程与系统科学 2021-06-16 Narges Mohammadi , Marvin M. Doyley , Mujdat Cetin

As an integral component of blind image deblurring, non-blind deconvolution removes image blur with a given blur kernel, which is essential but difficult due to the ill-posed nature of the inverse problem. The predominant approach is based…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Dong Gong , Zhen Zhang , Qinfeng Shi , Anton van den Hengel , Chunhua Shen , Yanning Zhang

From the statistical learning perspective, complexity control via explicit regularization is a necessity for improving the generalization of over-parameterized models. However, the impressive generalization performance of neural networks…

机器学习 · 计算机科学 2021-02-09 Taejong Joo , Uijung Chung

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

机器学习 · 计算机科学 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Self-supervised learning (SSL) typically learns representations invariant to semantic-preserving augmentations. While effective for recognition, enforcing strong invariance can suppress transformation-dependent structure that is useful for…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Joohyung Lee , Changhun Kim , Hyunsu Kim , Kwanhyung Lee , Juho Lee

We present a deep learning-based iterative approach to solve the discrete heterogeneous Helmholtz equation for high wavenumbers. Combining classical iterative multigrid solvers and convolutional neural networks (CNNs) via preconditioning,…

机器学习 · 计算机科学 2024-06-07 Bar Lerer , Ido Ben-Yair , Eran Treister

We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a posterior for an…

机器学习 · 计算机科学 2019-10-14 Matthew Willetts , Alexander Camuto , Stephen Roberts , Chris Holmes

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

数值分析 · 数学 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

The explicit regularization and optimality of deep neural networks estimators from independent data have made considerable progress recently. The study of such properties on dependent data is still a challenge. In this paper, we carry out…

机器学习 · 统计学 2025-07-09 William Kengne , Modou Wade

Neural networks have emerged as effective tools for solving ill-posed inverse problems. In many scientific applications, however, observational training data are insufficient, and learned inverse operators must instead be trained on…

数值分析 · 数学 2026-05-26 Sandra R. Babyale , Jodi Mead

In this paper, we propose to reformulate the blind image deblurring task to directly learn an inverse of the degradation model represented by a deep linear network. We introduce Deep Identity Learning (DIL), a novel learning strategy that…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Vamsidhar Saraswathula , Rama Krishna Gorthi

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

数值分析 · 数学 2020-06-09 Markus Haltmeier , Linh V. Nguyen