English
Related papers

Related papers: On Learning the Optimal Regularization Parameter i…

200 papers

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

By the recent advances in computer technology leading to the invention of more powerful processors, the importance of creating models using data training is even greater than ever. Given the significance of this issue, this work tries to…

Optimization and Control · Mathematics 2023-12-27 Saman Khoramian

We investigate continuous regularization methods for linear inverse problems of static and dynamic type. These methods are based on dynamic programming approaches for linear quadratic optimal control problems. We prove regularization…

Optimization and Control · Mathematics 2021-01-27 S. Kindermann , A. Leitao

The focus of this book is on the analysis of regularization methods for solving \emph{nonlinear inverse problems}. Specifically, we place a strong emphasis on techniques that incorporate supervised or unsupervised data derived from prior…

Optimization and Control · Mathematics 2025-06-24 Clemens Kirisits , Bochra Mejri , Sergei Pereverzev , Otmar Scherzer , Cong Shi

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

Neural networks have emerged as effective tools for solving ill-posed inverse problems. In many scientific applications, however, observational training data are insufficient, and learned inverse operators must instead be trained on…

Numerical Analysis · Mathematics 2026-05-26 Sandra R. Babyale , Jodi Mead

Learning a smooth graph signal from partially observed data is a well-studied task in graph-based machine learning. We consider this task from the perspective of optimal recovery, a mathematical framework for learning a function from…

Machine Learning · Computer Science 2023-05-31 Simon Foucart , Chunyang Liao , Nate Veldt

In performative learning, the data distribution reacts to the deployed model - for example, because strategic users adapt their features to game it - which creates a more complex dynamic than in classical supervised learning. One should…

Machine Learning · Computer Science 2025-10-15 Edwige Cyffers , Alireza Mirrokni , Marco Mondelli

These lecture notes summarize various summer schools that I have given on the topic of solving inverse problems (state and parameter estimation) by combining optimally measurement observations and parametrized PDE models. After defining a…

Numerical Analysis · Mathematics 2022-03-16 Olga Mula

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

We study a class of statistical inverse problems with non-linear pointwise operators motivated by concrete statistical applications. A two-step procedure is proposed, where the first step smoothes the data and inverts the non-linearity.…

Statistics Theory · Mathematics 2016-11-08 Kolyan Ray , Johannes Schmidt-Hieber

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Testing of hypotheses is a well studied topic in mathematical statistics. Recently, this issue has also been addressed in the context of Inverse Problems, where the quantity of interest is not directly accessible but only after the…

Statistics Theory · Mathematics 2024-04-09 Remo Kretschmann , Daniel Wachsmuth , Frank Werner

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

The problem of ranking/ordering instances, instead of simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the ranking problem in a rigorous statistical framework. The goal is to learn…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Gábor Lugosi , Nicolas Vayatis

Despite recent advances in regularisation theory, the issue of parameter selection still remains a challenge for most applications. In a recent work the framework of statistical learning was used to approximate the optimal Tikhonov…

Machine Learning · Statistics 2019-05-30 Ernesto de Vito , Zeljko Kereta , Valeria Naumova