English
Related papers

Related papers: Neural Gradient Regularizer

200 papers

This paper proposes to solve the Total Variation regularized models by finding the residual between the input and the unknown optimal solution. After analyzing a previous method, we developed a new iterative algorithm, named as Residual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Yuanhao Gong

The total variation (TV) flow generates a scale-space representation of an image based on the TV functional. This gradient flow observes desirable features for images, such as sharp edges and enables spectral, scale, and texture analysis.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Tamara G. Grossmann , Sören Dittmer , Yury Korolev , Carola-Bibiane Schönlieb

Numerous total variation (TV) regularizers, engaged in image restoration problem, encode the gradients by means of simple $[-1,1]$ FIR filter. Despite its low computational processing, this filter severely deviates signal's high frequency…

Optimization and Control · Mathematics 2015-06-17 Mahdi S. Hosseini , Konstantinos N. Plataniotis

The core of many approaches for the resolution of variational inverse problems arising in signal and image processing consists of promoting the sought solution to have a sparse representation in a well-suited space. A crucial task in this…

Numerical Analysis · Mathematics 2022-09-07 Gabriele Scrivanti , Emilie Chouzenoux , Jean-Christophe Pesquet

We introduce a new tool for interpreting neural net responses, namely full-gradients, which decomposes the neural net response into input sensitivity and per-neuron sensitivity components. This is the first proposed representation which…

Machine Learning · Computer Science 2019-12-04 Suraj Srinivas , Francois Fleuret

We propose a novel approach to image generation by decomposing an image into a structured sequence, where each element in the sequence shares the same spatial resolution but differs in the number of unique tokens used, capturing different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yikai Wang , Zhouxia Wang , Zhonghua Wu , Qingyi Tao , Kang Liao , Chen Change Loy

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

The spatio-spectral total variation (SSTV) model has been widely used as an effective regularization of hyperspectral images (HSI) for various applications such as mixed noise removal. However, since SSTV computes local spatial differences…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Shingo Takemoto , Kazuki Naganuma , Shunsuke Ono

Neural Radiance Field (NeRF) technology has made significant strides in creating novel viewpoints. However, its effectiveness is hampered when working with sparsely available views, often leading to performance dips due to overfitting.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yuru Xiao , Xianming Liu , Deming Zhai , Kui Jiang , Junjun Jiang , Xiangyang Ji

Despite their success with unstructured data, deep neural networks are not yet a panacea for structured tabular data. In the tabular domain, their efficiency crucially relies on various forms of regularization to prevent overfitting and…

Machine Learning · Computer Science 2023-03-10 Alan Jeffares , Tennison Liu , Jonathan Crabbé , Fergus Imrie , Mihaela van der Schaar

The long sampling time of diffusion models remains a significant bottleneck, which can be mitigated by reducing the number of diffusion time steps. However, the quality of samples with fewer steps is highly dependent on the noise schedule,…

Machine Learning · Computer Science 2025-06-03 Khaled Kahouli , Winfried Ripken , Stefan Gugler , Oliver T. Unke , Klaus-Robert Müller , Shinichi Nakajima

Total variation (TV) is a powerful regularization method that has been widely applied in different imaging applications, but is difficult to apply to diffuse optical tomography (DOT) image reconstruction (inverse problem) due to complex and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Wenqi Lu , Jinming Duan , David Orive-Miguel , Lionel Herve , Iain B Styles

Discrete gradient methods are well-known methods of Geometric Numerical Integration, which preserve the dissipation of gradient systems. The preservation of the dissipation of a system is an important feature in numerous image processing…

Numerical Analysis · Mathematics 2016-03-25 V Grimm , R I McLachlan , D McLaren , G R W Quispel , C-B Schönlieb

The total variation (TV) regularization has phenomenally boosted various variational models for image processing tasks. We propose to combine the backward diffusion process in the earlier literature of image enhancement with the TV…

Image and Video Processing · Electrical Eng. & Systems 2023-06-14 Congpei An , Hao-Ning Wu , Xiaoming Yuan

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learning algorithm. Nonetheless, various forms of regularization,…

Machine Learning · Computer Science 2022-02-23 Navid Azizan , Sahin Lale , Babak Hassibi

This work is about the total variation (TV) minimization which is used for recovering gradient-sparse signals from compressed measurements. Recent studies indicate that TV minimization exhibits a phase transition behavior from failure to…

Information Theory · Computer Science 2019-09-17 Sajad Daei , Farzan Haddadi , Arash Amini

The phenomenon of implicit regularization has attracted interest in recent years as a fundamental aspect of the remarkable generalizing ability of neural networks. In a nutshell, it entails that gradient descent dynamics in many neural…

Machine Learning · Computer Science 2024-02-28 Hong T. M. Chu , Subhro Ghosh , Chi Thanh Lam , Soumendu Sundar Mukherjee

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mukund Varma T , Peihao Wang , Xuxi Chen , Tianlong Chen , Subhashini Venugopalan , Zhangyang Wang

The total variation (TV) model and its related variants have already been proposed for image processing in previous literature. In this paper a novel total variation model based on kernel functions is proposed. In this novel model, we first…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Zhizheng Liang , Lei Zhang , Jin Liu , Yong Zhou