English
Related papers

Related papers: On problematic practice of using normalization in …

200 papers

Regularization by denoising (RED) is a widely-used framework for solving inverse problems by leveraging image denoisers as image priors. Recent work has reported the state-of-the-art performance of RED in a number of imaging applications…

Image and Video Processing · Electrical Eng. & Systems 2022-02-11 Yuyang Hu , Jiaming Liu , Xiaojian Xu , Ulugbek S. Kamilov

Adaptive cubic regularization methods for solving nonconvex problems need the efficient computation of the trial step, involving the minimization of a cubic model. We propose a new approach in which this model is minimized in a low…

Optimization and Control · Mathematics 2024-12-02 Stefania Bellavia , Davide Palitta , Margherita Porcelli , Valeria Simoncini

In recent years, a variety of learned regularization frameworks for solving inverse problems in imaging have emerged. These offer flexible modeling together with mathematical insights. The proposed methods differ in their architectural…

We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed…

Optimization and Control · Mathematics 2021-11-17 Yuesheng Xu

There has been tremendous research on the design of image regularizers over the years, from simple Tikhonov and Laplacian to sophisticated sparsity and CNN-based regularizers. Coupled with a model-based loss function, these are typically…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Pravin Nair , Kunal N. Chaudhury

Self-supervised learning is crucial for super-resolution because ground-truth images are usually unavailable for real-world settings. Existing methods derive self-supervision from low-resolution images by creating pseudo-pairs or by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yuehan Zhang , Angela Yao

We develop a multiresolution approach to the problem of polygonal curve approximation. We show theoretically and experimentally that, if the simplification algorithm A used between any two successive levels of resolution satisfies some…

Computational Geometry · Computer Science 2008-07-22 Pierre-François Marteau , Gildas G. Ménier

We present a family of non-local variational regularization methods for solving tomographic problems, where the solutions are functions with range in a closed subset of the Euclidean space, for example if the solution only attains values in…

Optimization and Control · Mathematics 2019-11-18 Melanie Melching , Otmar Scherzer

Recent numerical experiments have demonstrated that the choice of optimization geometry used during training can impact generalization performance when learning expressive nonlinear model classes such as deep neural networks. These…

Machine Learning · Computer Science 2022-04-25 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

Max-norm regularizer has been extensively studied in the last decade as it promotes an effective low-rank estimation for the underlying data. However, such max-norm regularized problems are typically formulated and solved in a batch manner,…

Machine Learning · Statistics 2016-05-17 Jie Shen , Huan Xu , Ping Li

Recent studies have shown that regularization techniques using soft labels, e.g., label smoothing, Mixup, and CutMix, not only enhance image classification accuracy but also mitigate miscalibration due to overconfident predictions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jonghyun Park , Juyeop Kim , Jong-Seok Lee

We give a new proof for an equality of certain max-min and min-max approximation problems involving normal matrices. The previously published proofs of this equality apply tools from matrix theory, (analytic) optimization theory and…

Numerical Analysis · Mathematics 2013-10-23 Jörg Liesen , Petr Tichý

Low-rank structures play important role in recent advances of many problems in image science and data science. As a natural extension of low-rank structures for data with nonlinear structures, the concept of the low-dimensional manifold…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Rongjie Lai , Jia Li

Regularization by denoising (RED) is a broadly applicable framework for solving inverse problems by using priors specified as denoisers. While RED has been shown to provide state-of-the-art performance in a number of applications, existing…

Image and Video Processing · Electrical Eng. & Systems 2020-11-30 Mingyang Xie , Yu Sun , Jiaming Liu , Brendt Wohlberg , Ulugbek S. Kamilov

Mitigating shortcuts, where models exploit spurious correlations in training data, remains a significant challenge for improving generalization. Regularization methods have been proposed to address this issue by enhancing model…

Machine Learning · Computer Science 2025-03-24 Haoyang Hong , Ioanna Papanikolaou , Sonali Parbhoo

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

Recovering corrupted images is one of the most challenging problems in image processing. Among various restoration tasks, blind image deblurring has been extensively studied due to its practical importance and inherent difficulty. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Heng Zhang , Reza Parvaz , Rui Yang

Self-normalized processes are basic to many probabilistic and statistical studies. They arise naturally in the the study of stochastic integrals, martingale inequalities and limit theorems, likelihood-based methods in hypothesis testing and…

Probability · Mathematics 2009-09-29 Victor H. de la Peña , Michael J. Klass , Tze Leung Lai

Optimization is an essential component for solving problems in wide-ranging fields. Ideally, the objective function should be designed such that the solution is unique and the optimization problem can be solved stably. However, the…

Robotics · Computer Science 2020-07-27 Takayuki Osa