English
Related papers

Related papers: Enhanced Denoising and Convergent Regularisation U…

200 papers

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's predictions under…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Aamir Mustafa , Rafal K. Mantiuk

We propose an approach for dense semantic 3D reconstruction which uses a data term that is defined as potentials over viewing rays, combined with continuous surface area penalization. Our formulation is a convex relaxation which we augment…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Nikolay Savinov , Christian Haene , Lubor Ladicky , Marc Pollefeys

The increasing demand for high image quality in mobile devices brings forth the need for better computational enhancement techniques, and image denoising in particular. At the same time, the images captured by these devices can be…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Tal Remez , Or Litany , Raja Giryes , Alex M. Bronstein

As a powerful statistical image modeling technique, sparse representation has been successfully used in various image restoration applications. The success of sparse representation owes to the development of l1-norm optimization techniques,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Weisheng Dong , Lei Zhang , Guangming Shi , Xiaolin Wu

Regularization is a fundamental technique to prevent over-fitting and to improve generalization performances by constraining a model's complexity. Current Deep Networks heavily rely on regularizers such as Data-Augmentation (DA) or…

Machine Learning · Computer Science 2022-04-12 Randall Balestriero , Leon Bottou , Yann LeCun

In this paper, we propose an interpretable denoising method for graph signals using regularization by denoising (RED). RED is a technique developed for image restoration that uses an efficient (and sometimes black-box) denoiser in the…

Signal Processing · Electrical Eng. & Systems 2026-05-27 Hayate Kojima , Hiroshi Higashi , Yuichi Tanaka

Recent advances in MRI reconstruction have demonstrated remarkable success through deep learning-based models. However, most existing methods rely heavily on large-scale, task-specific datasets, making reconstruction in data-limited…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Guoyao Shen , Yancheng Zhu , Mengyu Li , Ryan McNaughton , Hernan Jara , Sean B. Andersson , Chad W. Farris , Stephan Anderson , Xin Zhang

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

Deep learning has significantly advanced medical imaging analysis, yet variations in image resolution remain an overlooked challenge. Most methods address this by resampling images, leading to either information loss or computational…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ashay Patel , Michela Antonelli , Sebastien Ourselin , M. Jorge Cardoso

This paper considers the constrained total variation (TV) denoising problem for complex-valued images. We extend the definition of TV seminorms for real-valued images to dealing with complex-valued ones. In particular, we introduce two…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Yunhui Gao , Liangcai Cao

Generalization is one of the fundamental issues in machine learning. However, traditional techniques like uniform convergence may be unable to explain generalization under overparameterization. As alternative approaches, techniques based on…

Machine Learning · Computer Science 2022-03-22 Jiaye Teng , Jianhao Ma , Yang Yuan

Using weight decay to penalize the L2 norms of weights in neural networks has been a standard training practice to regularize the complexity of networks. In this paper, we show that a family of regularizers, including weight decay, is…

Machine Learning · Computer Science 2022-06-09 Ziquan Liu , Yufei Cui , Antoni B. Chan

Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT…

Numerical Analysis · Mathematics 2021-11-16 Stephan Antholzer , Markus Haltmeier

We extend a recently introduced deep unrolling framework for learning spatially varying regularisation parameters in inverse imaging problems to the case of Total Generalised Variation (TGV). The framework combines a deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Thanh Trung Vu , Andreas Kofler , Kostas Papafitsoros

Long lasting efforts have been made to reduce radiation dose and thus the potential radiation risk to the patient for computed tomography acquisitions without severe deterioration of image quality. To this end, numerous reconstruction and…

Medical Physics · Physics 2024-10-07 Elias Eulig , Björn Ommer , Marc Kachelrieß

The strength of machine learning models stems from their ability to learn complex function approximations from data; however, this strength also makes training deep neural networks challenging. Notably, the complex models tend to memorize…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mofassir ul Islam Arif , Mohsan Jameel , Josif Grabocka , Lars Schmidt-Thieme

The recent statistical theory of neural networks focuses on nonparametric denoising problems that treat randomness as additive noise. Variability in image classification datasets does, however, not originate from additive noise but from…

Statistics Theory · Mathematics 2025-08-19 Juntong Chen , Sophie Langer , Johannes Schmidt-Hieber

Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The originality of the approach is to define a prior based on…

Machine Learning · Statistics 2018-05-16 Michael Blot , Thomas Robert , Nicolas Thome , Matthieu Cord

This paper introduces a novel variational Bayesian method that integrates Tucker decomposition for efficient high-dimensional inverse problem solving. The method reduces computational complexity by transforming variational inference from a…

Machine Learning · Computer Science 2026-03-18 Qing-Mei Yang , Da-Qing Zhang