English
Related papers

Related papers: Uniform multi-penalty regularization for linear il…

200 papers

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

Ensemble Kalman inversion is a parallelizable methodology for solving inverse or parameter estimation problems. Although it is based on ideas from Kalman filtering, it may be viewed as a derivative-free optimization method. In its most…

Numerical Analysis · Mathematics 2024-12-20 Neil K. Chada , Andrew M. Stuart , Xin T. Tong

In this paper, we discuss the construction, analysis and implementation of a novel iterative regularization scheme with general convex penalty term for nonlinear inverse problems in Banach spaces based on the homotopy perturbation…

Numerical Analysis · Mathematics 2018-01-10 Jing Wang , Wei Wang , Bo Han

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

We present a framework for solving a broad class of ill-posed inverse problems governed by partial differential equations (PDEs), where the target coefficients of the forward operator are recovered through an iterative regularization scheme…

Uniformly regular equilibrium problems are natural generalizations of abstract equilibrium prob lems and they are defined over the uniformly prox-regular nonconvex sets. Some new efficient implicit methods for solving uniformly regular…

Optimization and Control · Mathematics 2025-02-11 Oday Hazaimah

We consider efficient methods for computing solutions to dynamic inverse problems, where both the quantities of interest and the forward operator (measurement process) may change at different time instances but we want to solve for all the…

Numerical Analysis · Mathematics 2021-07-14 Mirjeta Pasha , Arvind K. Saibaba , Silvia Gazzola , Malena I. Espanol , Eric de Sturler

We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable…

Machine Learning · Statistics 2012-06-08 Hannes Nickisch , Matthias Seeger

High-dimensional datasets are frequently subject to contamination by outliers and heavy-tailed noise, which can severely bias standard regularized estimators like the Lasso. While Maximum Mean Discrepancy (MMD) has recently been introduced…

Methodology · Statistics 2026-02-25 Xiaoning Kang , Lulu Kang

An overview is given of Bayesian inversion and regularization procedures. In particular, the conceptual basis of the maximum entropy method (MEM) is discussed, and extensions to positive/negative and complex data are highlighted. Other…

Astrophysics · Physics 2009-11-06 A. N. Lasenby , R. B. Barreiro , M. P. Hobson

This paper presents a general convergence theory of penalty based numerical methods for elliptic constrained inequality problems, including variational inequalities, hemivariational inequalities, and variational-hemivariational…

Numerical Analysis · Mathematics 2019-12-18 Weimin Han , Mircea Sofonea

Existing score-based methods for inverse problems often resort to approximate minimization of the KL divergence between the inversion distribution and the Bayesian posterior. Such an approximation leads to severe mode collapse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weimin Bai , Yuxuan Gu , Yifei Wang , Weijian Luo , He Sun

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

Several generalizations of the traditional Tikhonov-Phillips regularization method have been proposed during the last two decades. Many of these generalizations are based upon inducing stability throughout the use of different penalizers…

Functional Analysis · Mathematics 2014-03-25 Gisela L. Mazzieri , Ruben D. Spies , Karina G. Temperini

We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and…

Optimization and Control · Mathematics 2016-08-16 Maïtine Bergounioux , Mounir Haddou

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

We study Newton type methods for inverse problems described by nonlinear operator equations $F(u)=g$ in Banach spaces where the Newton equations $F'(u_n;u_{n+1}-u_n) = g-F(u_n)$ are regularized variationally using a general data misfit…

Numerical Analysis · Mathematics 2015-04-01 Thorsten Hohage , Frank Werner

Model predictive control (MPC) has become a hot cake technology for various applications due to its ability to handle multi-input multi-output systems with physical constraints. The optimization solvers require considerable time, limiting…

Systems and Control · Electrical Eng. & Systems 2022-01-11 Abhijith Sharma , Chaitanya Jugade , Shreya Yawalkar , Vaishali Patne , Deepak Ingole , Dayaram Sonawane

The paper is devoted to the penalty Robin-Robin domain decomposition methods (DDMs), proposed by us for the solution of unilateral multibody contact problems of elasticity. These DDMs are based on the penalty method for variational…

Numerical Analysis · Mathematics 2015-04-28 Ivan I. Dyyak , Ihor I. Prokopyshyn , Ivan A. Prokopyshyn