English
Related papers

Related papers: Neural Gradient Regularizer

200 papers

High resolution Magnetic Resonance (MR) images are desired for accurate diagnostics. In practice, image resolution is restricted by factors like hardware and processing constraints. Recently, deep learning methods have been shown to produce…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Venkateswararao Cherukuri , Tiantong Guo , Steve. J. Schiff , Vishal Monga

High resolution magnetic resonance (MR) images are desired for accurate diagnostics. In practice, image resolution is restricted by factors like hardware, cost and processing constraints. Recently, deep learning methods have been shown to…

Machine Learning · Computer Science 2018-09-11 Venkateswararao Cherukuri , Tiantong Guo , Steven J. Schiff , Vishal Monga

In the last decades, unsupervised deep learning based methods have caught researchers attention, since in many real applications, such as medical imaging, collecting a great amount of training examples is not always feasible. Moreover, the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Pasquale Cascarano , Andrea Sebastiani , Maria Colomba Comes , Giorgia Franchini , Federica Porta

We introduce a generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The model assumes that the images in the dataset are non-linear mappings of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Stanley Kruger , Mathews Jacob

Rendering diffuse global illumination in real-time is often approximated by pre-computing and storing irradiance in a 3D grid of probes. As long as most of the scene remains static, probes approximate irradiance for all surfaces immersed in…

Recent works have shown that on sufficiently over-parametrized neural nets, gradient descent with relatively large initialization optimizes a prediction function in the RKHS of the Neural Tangent Kernel (NTK). This analysis leads to global…

Machine Learning · Statistics 2020-04-28 Colin Wei , Jason D. Lee , Qiang Liu , Tengyu Ma

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

Normalization layers are widely used in deep neural networks to stabilize training. In this paper, we consider the training of convolutional neural networks with gradient descent on a single training example. This optimization problem…

Machine Learning · Computer Science 2019-07-24 Zhenwei Dai , Reinhard Heckel

Dynamic imaging involves the reconstruction of a spatio-temporal object at all times using its undersampled measurements. In particular, in dynamic computed tomography (dCT), only a single projection at one view angle is available at a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-14 Berk Iskender , Sushan Nakarmi , Nitin Daphalapurkar , Marc L. Klasky , Yoram Bresler

Recent advances in neural rendering have enabled highly photorealistic 3D scene reconstruction and novel view synthesis. Despite this progress, current state-of-the-art methods struggle to reconstruct high frequency detail, due to factors…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sibi Catley-Chandar , Richard Shaw , Gregory Slabaugh , Eduardo Perez-Pellitero

Neural Radiance Field (NeRF) regresses a neural parameterized scene by differentially rendering multi-view images with ground-truth supervision. However, when interpolating novel views, NeRF often yields inconsistent and visually non-smooth…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Tianlong Chen , Peihao Wang , Zhiwen Fan , Zhangyang Wang

For image denoising problems, the structure tensor total variation (STV)-based models show good performances when compared with other competing regularization approaches. However, the STV regularizer does not couple the local information of…

Optimization and Control · Mathematics 2024-04-05 Xiuhan Sheng , Lijuan Yang , Jingya Chang

Image restoration requires a careful balance between noise suppression and structure preservation. While first-order total variation (TV) regularization effectively preserves edges, it often introduces staircase artifacts, whereas…

Numerical Analysis · Mathematics 2025-11-13 Liang Luo , Lei Zhang

Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. However, they have…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Renata Khasanova , Pascal Frossard

Vector graphics are essential in design, providing artists with a versatile medium for creating resolution-independent and highly editable visual content. Recent advancements in vision-language and diffusion models have fueled interest in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Sagi Polaczek , Yuval Alaluf , Elad Richardson , Yael Vinker , Daniel Cohen-Or

Gradient dynamics play a central role in determining the stability and generalization of deep neural networks. In this work, we provide an empirical analysis of how variance and standard deviation of gradients evolve during training,…

Machine Learning · Computer Science 2025-09-09 Vincent-Daniel Yun

Many methods for processing scalar and vector valued images, volumes and other data in the context of inverse problems are based on variational formulations. Such formulations require appropriate regularization functionals that model…

Numerical Analysis · Mathematics 2019-09-20 Martin Holler , Andreas Weinmann

We introduce a new technique for gradient normalization during neural network training. The gradients are rescaled during the backward pass using normalization layers introduced at certain points within the network architecture. These…

Machine Learning · Computer Science 2021-06-18 Alejandro Cabana , Luis F. Lago-Fernández

Implicit Neural Representation (INR) has been emerging in computer vision in recent years. It has been shown to be effective in parameterising continuous signals such as dense 3D models from discrete image data, e.g. the neural radius field…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Wentian Xu , Jianbo Jiao

Recovering high-resolution images from limited sensory data typically leads to a serious ill-posed inverse problem, demanding inversion algorithms that effectively capture the prior information. Learning a good inverse mapping from training…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Morteza Mardani , Qingyun Sun , Shreyas Vasawanala , Vardan Papyan , Hatef Monajemi , John Pauly , David Donoho