English
Related papers

Related papers: Coupled regularization with multiple data discrepa…

200 papers

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

In a number of tomographic applications, data cannot be fully acquired, resulting in a severely underdetermined image reconstruction. In such cases, conventional methods lead to reconstructions with significant artifacts. To overcome these…

Numerical Analysis · Mathematics 2023-06-21 Simon Göppel , Jürgen Frikel , Markus Haltmeier

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Most of the recent results in polynomial functional regression have been focused on an in-depth exploration of single-parameter regularization schemes. In contrast, in this study we go beyond that framework by introducing an algorithm for…

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

Data augmentation has been proven to be an effective technique for developing machine learning models that are robust to known classes of distributional shifts (e.g., rotations of images), and alignment regularization is a technique often…

Machine Learning · Computer Science 2022-06-07 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Large pre-trained models, such as Bert, GPT, and Wav2Vec, have demonstrated great potential for learning representations that are transferable to a wide variety of downstream tasks . It is difficult to obtain a large quantity of supervised…

Computation and Language · Computer Science 2022-12-23 Neeraj Kumar , Ankur Narang , Brejesh Lall

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

We present an adaptive regularization scheme for optimizing composite energy functionals arising in image analysis problems. The scheme automatically trades off data fidelity and regularization depending on the current data fit during the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Byung-Woo Hong , Ja-Keoung Koo , Martin Burger , Stefano Soatto

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

We provide estimators for a large class of inverse problems, including nonlinear inverse problems. Using complexity regularization technics we provide adaptive estimators achieving the best rate over the collection of models.

Statistics Theory · Mathematics 2007-06-13 Jean Michel Loubes , Ludeña Carenne

We propose a new approach to linear ill-posed inverse problems. Our algorithm alternates between enforcing two constraints: the measurements and the statistical correlation structure in some transformed space. We use a non-linear multiscale…

Computational Engineering, Finance, and Science · Computer Science 2018-12-04 Ivan Dokmanić , Joan Bruna , Stéphane Mallat , Maarten de Hoop

In this paper, we prove optimal convergence rates results for regularisation methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalises existing convergence rates results on optimality to general…

Functional Analysis · Mathematics 2015-11-11 Vinicius Albani , Peter Elbau , Maarten V. de Hoop , Otmar Scherzer

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

Inverse problems in imaging are typically ill-posed and are usually solved by employing regularized optimization techniques. The usage of appropriate constraints can restrict the solution space, thus making it feasible for a reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Jasleen Birdi , Tamal Majumder , Debanjan Halder , Muskan Kularia , Kedar Khare

Recent works have shown that most deep learning models are often poorly calibrated, i.e., they may produce overconfident predictions that are wrong. It is therefore desirable to have models that produce predictive uncertainty estimates that…

Machine Learning · Computer Science 2020-03-02 Saiteja Utpala , Piyush Rai

For an ill-posed inverse problem, particularly with incomplete and limited measurement data, regularization is an essential tool for stabilizing the inverse problem. Among various forms of regularization, the lp penalty term provides a…

Numerical Analysis · Mathematics 2021-12-23 Jihun Han , Yoonsang Lee

Owing to the edge preserving ability and low computational cost of the total variation (TV), variational models with the TV regularization have been widely investigated in the field of multiplicative noise removal. The key points of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Dai-Qiang Chen , Li-Zhi Cheng

The maximum likelihood method is the best-known method for estimating the probabilities behind the data. However, the conventional method obtains the probability model closest to the empirical distribution, resulting in overfitting. Then…

Machine Learning · Statistics 2023-10-03 Akihisa Ichiki

By the recent advances in computer technology leading to the invention of more powerful processors, the importance of creating models using data training is even greater than ever. Given the significance of this issue, this work tries to…

Optimization and Control · Mathematics 2023-12-27 Saman Khoramian