中文
相关论文

相关论文: Neural Gradient Regularizer

200 篇论文

Sparsity exploiting image reconstruction (SER) methods have been extensively used with Total Variation (TV) regularization for tomographic reconstructions. Local TV methods fail to preserve texture details and often create additional…

计算机视觉与模式识别 · 计算机科学 2018-03-15 Faisal Mahmood , Nauman Shahid , Ulf Skoglund , Pierre Vandergheynst

Gradient regularization (GR) has been shown to improve the generalizability of trained models. While Natural Gradient Descent has been shown to accelerate optimization in the initial phase of training, little attention has been paid to how…

机器学习 · 计算机科学 2026-03-27 Satya Prakash Dash , Hossein Abdi , Wei Pan , Samuel Kaski , Mingfei Sun

We propose a new type of regularization functional for images called oscillation total generalized variation (TGV) which can represent structured textures with oscillatory character in a specified direction and scale. The infimal…

数值分析 · 数学 2018-09-17 Yiming Gao , Kristian Bredies

As an integral component of blind image deblurring, non-blind deconvolution removes image blur with a given blur kernel, which is essential but difficult due to the ill-posed nature of the inverse problem. The predominant approach is based…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Dong Gong , Zhen Zhang , Qinfeng Shi , Anton van den Hengel , Chunhua Shen , Yanning Zhang

Although regularization methods based on derivatives are favored for their robustness and computational simplicity, research exploring higher-order derivatives remains limited. This scarcity can possibly be attributed to the appearance of…

图像与视频处理 · 电气工程与系统科学 2023-09-08 Manu Ghulyani , Muthuvel Arigovindan

Total Variation (TV) is a popular regularization strategy that promotes piece-wise constant signals by constraining the $\ell_1$-norm of the first order derivative of the estimated signal. The resulting optimization problem is usually…

最优化与控制 · 数学 2020-10-20 Hamza Cherkaoui , Jeremias Sulam , Thomas Moreau

In this paper, we propose a regularization technique for noisy-image super-resolution and image denoising. Total variation (TV) regularization is adopted in many image processing applications to preserve the local smoothness. However, TV…

图像与视频处理 · 电气工程与系统科学 2022-02-23 Kaicong Sun , Sven Simon

Existing methods have demonstrated effective performance on a single degradation type. In practical applications, however, the degradation is often unknown, and the mismatch between the model and the degradation will result in a severe…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Mingde Yao , Ruikang Xu , Yuanshen Guan , Jie Huang , Zhiwei Xiong

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently improve…

机器学习 · 计算机科学 2018-05-28 Dániel Varga , Adrián Csiszárik , Zsolt Zombori

Neural Radiance Fields (NeRF) are an advanced technology that creates highly realistic images by learning about scenes through a neural network model. However, NeRF often encounters issues when there are not enough images to work with,…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Jiawei Guo , HungChyun Chou , Ning Ding

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

Vanishing and exploding gradients are two of the main obstacles in training deep neural networks, especially in capturing long range dependencies in recurrent neural networks~(RNNs). In this paper, we present an efficient parametrization of…

机器学习 · 计算机科学 2018-03-28 Jiong Zhang , Qi Lei , Inderjit S. Dhillon

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in reconstruction quality. Unfortunately, these new methods often lack reliability and explainability, and there is a…

图像与视频处理 · 电气工程与系统科学 2023-08-28 Alexis Goujon , Sebastian Neumayer , Pakshal Bohra , Stanislas Ducotterd , Michael Unser

Neural radiance fields (NeRF) have achieved impressive performances in view synthesis by encoding neural representations of a scene. However, NeRFs require hundreds of images per scene to synthesize photo-realistic novel views. Training…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Nagabhushan Somraj , Rajiv Soundararajan

Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper,…

图像与视频处理 · 电气工程与系统科学 2023-10-20 Martin Zach , Florian Knoll , Thomas Pock

Performing gradient descent in a wide neural network is equivalent to computing the posterior mean of a Gaussian Process with the Neural Tangent Kernel (NTK-GP), for a specific prior mean and with zero observation noise. However, existing…

Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their…

机器学习 · 计算机科学 2019-10-21 Dae Hoon Park , Chiu Man Ho , Yi Chang , Huaqing Zhang

Recent work has shown that the structure of convolutional neural networks (CNNs) induces a strong prior that favors natural images. This prior, known as a deep image prior (DIP), is an effective regularizer in inverse problems such as image…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Pallabi Ghosh , Vibhav Vineet , Larry S. Davis , Abhinav Shrivastava , Sudipta Sinha , Neel Joshi

The problem of restoration of digital images from their degraded measurements plays a central role in a multitude of practically important applications. A particularly challenging instance of this problem occurs in the case when the…

计算机视觉与模式识别 · 计算机科学 2016-11-17 Oleg Michailovich

Over the last decades, the total variation (TV) evolved to one of the most broadly-used regularisation functionals for inverse problems, in particular for imaging applications. When first introduced as a regulariser, higher-order…

最优化与控制 · 数学 2020-12-30 Kristian Bredies , Martin Holler