English
Related papers

Related papers: Structural changes in nonlocal denoising models ar…

200 papers

Despite recent advances in regularisation theory, the issue of parameter selection still remains a challenge for most applications. In a recent work the framework of statistical learning was used to approximate the optimal Tikhonov…

Machine Learning · Statistics 2019-05-30 Ernesto de Vito , Zeljko Kereta , Valeria Naumova

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

Optimization and Control · Mathematics 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

Total Generalized Variation (TGV) regularization in image reconstruction relies on an infimal convolution type combination of generalized first- and second-order derivatives. This helps to avoid the staircasing effect of Total Variation…

Optimization and Control · Mathematics 2022-05-09 Michael Hintermüller , Kostas Papafitsoros , Carlos N. Rautenberg , Hongpeng Sun

We consider the inverse problem of recovering a continuous-domain function from a finite number of noisy linear measurements. The unknown signal is modeled as the sum of a slowly varying trend and a periodic or quasi-periodic seasonal…

Functional Analysis · Mathematics 2025-05-16 Julien Fageot

In this work we consider a generalized bilevel optimization framework for solving inverse problems. We introduce fractional Laplacian as a regularizer to improve the reconstruction quality, and compare it with the total variation…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Harbir Antil , Zichao Di , Ratna Khatri

One aim of dimensionality reduction is to discover the main factors that explain the data, and as such is paramount to many applications. When working with high dimensional data, autoencoders offer a simple yet effective approach to learn…

Machine Learning · Computer Science 2025-08-29 Benjamin Couéraud , Vikram Sunkara , Christof Schütte

We establish a family of subspace-based learning method for multi-view learning using the least squares as the fundamental basis. Specifically, we investigate orthonormalized partial least squares (OPLS) and study its important properties…

Machine Learning · Computer Science 2020-07-13 Li Wang , Ren-Cang Li , Wen-Wei

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

We extend a recently introduced deep unrolling framework for learning spatially varying regularisation parameters in inverse imaging problems to the case of Total Generalised Variation (TGV). The framework combines a deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Thanh Trung Vu , Andreas Kofler , Kostas Papafitsoros

Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate the condition number of the weight matrix as a regularizing…

Machine Learning · Computer Science 2024-10-02 Rossen Nenov , Daniel Haider , Peter Balazs

We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed…

Optimization and Control · Mathematics 2021-11-17 Yuesheng Xu

Deformable image registration is a fundamental task in medical image analysis and plays a crucial role in a wide range of clinical applications. Recently, deep learning-based approaches have been widely studied for deformable medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Jing Zou , Noémie Debroux , Lihao Liu , Jing Qin , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

In this paper, we consider a primal-dual domain decomposition method for total variation regularized problems appearing in mathematical image processing. The model problem is transformed into an equivalent constrained minimization problem…

Numerical Analysis · Mathematics 2019-12-10 Chang-Ock Lee , Jongho Park

Image reconstruction in X-ray tomography is an ill-posed inverse problem, particularly with limited available data. Regularization is thus essential, but its effectiveness hinges on the choice of a regularization parameter that balances…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Chuyang Wu , Samuli Siltanen

The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 John Lee , Nicholas P. Bertrand , Christopher J. Rozell

This paper studies the parameter tuning problem of positive linear systems for optimizing their stability properties. We specifically show that, under certain regularity assumptions on the parametrization, the problem of finding the…

Optimization and Control · Mathematics 2019-11-26 Masaki Ogura , Masako Kishida , James Lam

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

Machine Learning · Computer Science 2018-06-08 Samet Oymak

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains…

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal