English
Related papers

Related papers: Adaptive image processing: first order PDE constra…

200 papers

Regularization plays a crucial role in reliably utilizing imaging systems for scientific and medical investigations. It helps to stabilize the process of computationally undoing any degradation caused by physical limitations of the imaging…

Image and Video Processing · Electrical Eng. & Systems 2021-05-26 Manu Ghulyani , Deepak G Skariah , Muthuvel Arigovindan

Convex regularizers are often used for sparse learning. They are easy to optimize, but can lead to inferior prediction performance. The difference of $\ell_1$ and $\ell_2$ ($\ell_{1-2}$) regularizer has been recently proposed as a nonconvex…

Machine Learning · Computer Science 2017-06-21 Quanming Yao , James T. Kwok , Xiawei Guo

In a number of tomographic applications, data cannot be fully acquired, resulting in a severely underdetermined image reconstruction. In such cases, conventional methods lead to reconstructions with significant artifacts. To overcome these…

Numerical Analysis · Mathematics 2023-06-21 Simon Göppel , Jürgen Frikel , Markus Haltmeier

Can regularization terms in the training of invertible neural networks lead to known Bayesian point estimators in reconstruction? Invertible networks are attractive for inverse problems due to their inherent stability and interpretability.…

Machine Learning · Computer Science 2025-10-31 Nick Heilenkötter

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve…

Numerical Analysis · Mathematics 2020-03-26 Yoeri E. Boink , Markus Haltmeier , Sean Holman , Johannes Schwab

We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and…

Optimization and Control · Mathematics 2016-08-16 Maïtine Bergounioux , Mounir Haddou

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

The strong correlation between neurons or filters can significantly weaken the generalization ability of neural networks. Inspired by the well-known Tammes problem, we propose a novel diversity regularization method to address this issue,…

Machine Learning · Computer Science 2021-03-24 Zhennan Wang , Canqun Xiang , Wenbin Zou , Chen Xu

This paper addresses the task of learning convex regularizers to guide the reconstruction of images from limited data. By imposing that the reconstruction be amplitude-equivariant, we narrow down the class of admissible functionals to those…

Machine Learning · Statistics 2026-01-19 Michael Unser , Stanislas Ducotterd

Total variation (TV) is a widely used regularizer for stabilizing the solution of ill-posed inverse problems. In this paper, we propose a novel proximal-gradient algorithm for minimizing TV regularized least-squares cost functional. Our…

Information Theory · Computer Science 2016-01-05 Ulugbek S. Kamilov

Total Generalized Variation (TGV) has recently been proven certainly successful in image processing for preserving sharp features as well as smooth transition variations. However, none of the existing works aims at numerically calculating…

Computational Geometry · Computer Science 2021-06-09 Zheng Liu , YanLei Li , Weina Wang , Ligang Liu , Renjie Chen

In this paper we consider the training of single hidden layer neural networks by pseudoinversion, which, in spite of its popularity, is sometimes affected by numerical instability issues. Regularization is known to be effective in such…

Neural and Evolutionary Computing · Computer Science 2015-08-26 Rossella Cancelliere , Mario Gai , Patrick Gallinari , Luca Rubini

In inverse problems, prior information and a priori-based regularization techniques play important roles. In this paper, we focus on image restoration problems, especially on restoring images whose texture mainly follow one direction. In…

Numerical Analysis · Mathematics 2017-08-23 Rasmus Dalgas Kongskov , Yiqiu Dong , Kim Knudsen

Hyperparameter optimization can be formulated as a bilevel optimization problem, where the optimal parameters on the training set depend on the hyperparameters. We aim to adapt regularization hyperparameters for neural networks by fitting…

Machine Learning · Computer Science 2019-03-08 Matthew MacKay , Paul Vicol , Jon Lorraine , David Duvenaud , Roger Grosse

Several generalizations of the traditional Tikhonov-Phillips regularization method have been proposed during the last two decades. Many of these generalizations are based upon inducing stability throughout the use of different penalizers…

Functional Analysis · Mathematics 2014-03-25 Gisela L. Mazzieri , Ruben D. Spies , Karina G. Temperini

In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation).…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xenju Xu , Guanghui Wang , Alan Sullivan , Ziming Zhang

We investigate the ill-posed inverse problem of recovering unknown spatially dependent parameters in nonlinear evolution PDEs. We propose a bi-level Landweber scheme, where the upper-level parameter reconstruction embeds a lower-level state…

Numerical Analysis · Mathematics 2024-03-07 Tram Thi Ngoc Nguyen

As application demands for online convex optimization accelerate, the need for designing new methods that simultaneously cover a large class of convex functions and impose the lowest possible regret is highly rising. Known online…

Machine Learning · Computer Science 2019-06-04 Saeed Masoudian , Ali Arabzadeh , Mahdi Jafari Siavoshani , Milad Jalal , Alireza Amouzad

Despite the popularity and practical success of total variation (TV) regularization for function estimation, surprisingly little is known about its theoretical performance in a statistical setting. While TV regularization has been known for…

Statistics Theory · Mathematics 2026-05-08 Miguel del Álamo , Housen Li , Axel Munk