English
Related papers

Related papers: Learning regularization and intensity-gradient-bas…

200 papers

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently improve…

Machine Learning · Computer Science 2018-05-28 Dániel Varga , Adrián Csiszárik , Zsolt Zombori

In latest years, deep learning has gained a leading role in the pansharpening of multiresolution images. Given the lack of ground truth data, most deep learning-based methods carry out supervised training in a reduced-resolution domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Matteo Ciotola , Giovanni Poggi , Giuseppe Scarpa

To overcome inherent hardware limitations of hyperspectral imaging systems with respect to their spatial resolution, fusion-based hyperspectral image (HSI) super-resolution is attracting increasing attention. This technique aims to fuse a…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Xiuheng Wang , Jie Chen , Cédric Richard

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

Machine Learning · Computer Science 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Supervised training of deep neural networks on pairs of clean image and noisy measurement achieves state-of-the-art performance for many image reconstruction tasks, but such training pairs are difficult to collect. Self-supervised methods…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Tobit Klug , Dogukan Atik , Reinhard Heckel

The importance of regularization has been well established in image reconstruction -- which is the computational inversion of imaging forward model -- with applications including deconvolution for microscopy, tomographic reconstruction,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Sanjay Viswanath , Manu Ghulyani , Muthuvel Arigovindan

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

Enabling low precision implementations of deep learning models, without considerable performance degradation, is necessary in resource and latency constrained settings. Moreover, exploiting the differences in sensitivity to quantization…

Machine Learning · Computer Science 2022-10-28 Ignacio Hounie , Juan Elenter , Alejandro Ribeiro

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

Numerical Analysis · Mathematics 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

Learning based methods are now ubiquitous for solving inverse problems, but their deployment in real-world applications is often hindered by the lack of ground truth references for training. Recent self-supervised learning strategies offer…

Image and Video Processing · Electrical Eng. & Systems 2026-02-27 Victor Sechaud , Laurent Jacques , Patrice Abry , Julián Tachella

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

Machine Learning · Computer Science 2018-06-08 Samet Oymak

Existing facial image super-resolution (SR) methods focus mostly on improving artificially down-sampled low-resolution (LR) imagery. Such SR models, although strong at handling artificial LR images, often suffer from significant performance…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Zhiyi Cheng , Xiatian Zhu , Shaogang Gong

A widely used algorithm for transfer learning is fine-tuning, where a pre-trained model is fine-tuned on a target task with a small amount of labeled data. When the capacity of the pre-trained model is significantly larger than the size of…

Machine Learning · Computer Science 2025-08-15 Dongyue Li , Hongyang R. Zhang

As an integral component of blind image deblurring, non-blind deconvolution removes image blur with a given blur kernel, which is essential but difficult due to the ill-posed nature of the inverse problem. The predominant approach is based…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Dong Gong , Zhen Zhang , Qinfeng Shi , Anton van den Hengel , Chunhua Shen , Yanning Zhang

Image registration has traditionally been done using two distinct approaches: learning based methods, relying on robust deep neural networks, and optimization-based methods, applying complex mathematical transformations to warp images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Gabriel De Araujo , Shanlin Sun , Xiaohui Xie

Image normalization is a building block in medical image analysis. Conventional approaches are customarily utilized on a per-dataset basis. This strategy, however, prevents the current normalization algorithms from fully exploiting the…

Machine Learning · Computer Science 2020-10-06 Pierre-Luc Delisle , Benoit Anctil-Robitaille , Christian Desrosiers , Herve Lombaert

In this paper, we investigate the continual learning of Vision Transformers (ViT) for the challenging exemplar-free scenario, with special focus on how to efficiently distill the knowledge of its crucial self-attention mechanism (SAM). Our…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Francesco Pelosin , Saurav Jha , Andrea Torsello , Bogdan Raducanu , Joost van de Weijer

Reflections are very common phenomena in our daily photography, which distract people's attention from the scene behind the glass. The problem of removing reflection artifacts is important but challenging due to its ill-posed nature. The…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yingda Yin , Qingnan Fan , Dongdong Chen , Yujie Wang , Angelica Aviles-Rivero , Ruoteng Li , Carola-Bibiane Schnlieb , Baoquan Chen

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to…

Machine Learning · Computer Science 2020-03-10 Majed El Helou , Frederike Dümbgen , Sabine Süsstrunk