English
Related papers

Related papers: Learning optimal spatially-dependent regularizatio…

200 papers

In this work, we illustrate the connection between adaptive mesh refinement for finite element discretized PDEs and the recently developed \emph{bi-level regularization algorithm}. By adaptive mesh refinement according to data noise,…

Numerical Analysis · Mathematics 2025-10-15 Christian Aarset , Tram Thi Ngoc Nguyen

We propose the superiorization of incremental algorithms for tomographic image reconstruction. The resulting methods follow a better path in its way to finding the optimal solution for the maximum likelihood problem in the sense that they…

Optimization and Control · Mathematics 2019-04-03 Elias S. Helou , Marcelo V. W. Zibetti , Eduardo X. Miqueles

1D Total Variation (TV) denoising, considering the data fidelity and the Total Variation (TV) regularization, proposes a good restored signal preserving shape edges. The main issue is how to choose the weight $\lambda$ balancing those two…

Signal Processing · Electrical Eng. & Systems 2020-12-18 Zhanhao Liu , Marion Perrodin , Thomas Chambrion , Radu Stoica

The aim of this paper is to test and analyze a novel technique for image reconstruction in positron emission tomography, which is based on (total variation) regularization on both the image space and the projection space. We formulate our…

Numerical Analysis · Mathematics 2014-07-24 Martin Burger , Jahn Müller , Evangelos Papoutsellis , Carola-Bibiane Schönlieb

This paper studies an inverse boundary value problem for a semilinear Helmholtz equation with Neumann boundary conditions in a bounded domain $\Omega \subset \mathbb{R}^n$ ($n\ge2$). The objective is to recover the unknown linear and…

Numerical Analysis · Mathematics 2026-03-10 Long-Ling Du , Zejun Sun , Li-Li Wang , Guang-Hui Zheng

This article studies Gauss-Newton-type methods for over-determined systems to find solutions to bilevel programming problems. To proceed, we use the lower-level value function reformulation of bilevel programs and consider necessary…

Optimization and Control · Mathematics 2020-03-09 Joerg Fliege , Andrey Tin , Alain Zemkoho

Non-smooth regularization is widely used in image reconstruction to eliminate the noise while preserving subtle image structures. In this work, we investigate the use of proximal Newton (PN) method to solve an optimization problem with a…

Signal Processing · Electrical Eng. & Systems 2019-12-05 Tao Ge , Umberto Villa , Ulugbek S. Kamilov , Joseph A. O'Sullivan

Various tasks in data science are modeled utilizing the variational regularization approach, where manually selecting regularization parameters presents a challenge. The difficulty gets exacerbated when employing regularizers involving a…

Optimization and Control · Mathematics 2025-07-08 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Learning processes are useful methodologies able to improve knowledge of real phenomena. These are often dependent on hyperparameters, variables set before the training process and regulating the learning procedure. Hyperparameters…

Optimization and Control · Mathematics 2023-11-10 Flavia Esposito , Laura Selicato , Caterina Sportelli

This paper is concerned with an elliptic optimal control problem with total variation (TV) restriction on the control in the constraints. We introduce a regularized optimal control problem by applying a quadratic regularization of the dual…

Optimization and Control · Mathematics 2025-01-24 Christian Meyer , Annika Schiemann

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameters are handled by continuous relaxation and rounding…

Machine Learning · Computer Science 2025-03-20 Sara Venturini , Marianna de Santis , Jordan Patracone , Francesco Rinaldi , Saverio Salzo , Martin Schmidt

Bilevel optimization is an important formulation for many machine learning problems. Current bilevel optimization algorithms assume that the gradient of the upper-level function is Lipschitz. However, recent studies reveal that certain…

Machine Learning · Computer Science 2024-01-19 Jie Hao , Xiaochuan Gong , Mingrui Liu

This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimization problem. We first show that this bilevel problem is…

Optimization and Control · Mathematics 2025-07-11 Rujun Jiang , Xu Shi , Weizheng Song , Jiulin Wang

Variational methods for revealing visual concepts learned by convolutional neural networks have gained significant attention during the last years. Being based on noisy gradients obtained via back-propagation such methods require the…

Machine Learning · Computer Science 2018-05-02 Maximilian Baust , Florian Ludwig , Christian Rupprecht , Matthias Kohl , Stefan Braunewell

We address the image restoration problem under Poisson noise corruption. The Kullback-Leibler divergence, which is typically adopted in the variational framework as data fidelity term in this case, is coupled with the second-order Total…

Numerical Analysis · Mathematics 2022-05-27 Daniela di Serafino , Monica Pragliola

We consider the problem of optimal location of a Dirichlet region in a $d$-dimensional domain $\Omega$ subjected to a given right-hand side $f$ in order to minimize some given functional of the configuration. While in the literature the…

Optimization and Control · Mathematics 2013-04-17 Giuseppe Buttazzo , Al-hassem Nayam

Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo. This simulated data does not model many of the important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ke Wang , Michaël Gharbi , He Zhang , Zhihao Xia , Eli Shechtman

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We unify and extend the semigroup and the PDE approaches to stochastic maximal regularity of time-dependent semilinear parabolic problems with noise given by a cylindrical Brownian motion. We treat random coefficients that are only…

Analysis of PDEs · Mathematics 2019-02-12 Pierre Portal , Mark Veraar

We propose a supervised machine learning approach for boosting existing signal and image recovery methods and demonstrate its efficacy on example of image reconstruction in computed tomography. Our technique is based on a local nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2013-12-02 Joseph Shtok , Michael Zibulevsky , Michael Elad