English
Related papers

Related papers: Higher order error estimates for regularization of…

200 papers

In this paper we study a Tikhonov-type method for ill-posed nonlinear operator equations $\gdag = F(\udag)$ where $\gdag$ is an integrable, non-negative function. We assume that data are drawn from a Poisson process with density $t\gdag$…

Numerical Analysis · Mathematics 2015-04-01 Frank Werner , Thorsten Hohage

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

Primal-dual splitting involving proximity operators in order to be able to find some approximation to the minimizer for a general form of Tikhonov type functional is in the focus of this work. This approximation is produced by a pair of…

Numerical Analysis · Mathematics 2019-03-19 Erdem Altuntac

In this paper we study a variational problem in the space of functions of bounded Hessian. Our model constitutes a straightforward higher-order extension of the well known ROF functional (total variation minimisation) to which we add a…

Numerical Analysis · Mathematics 2013-08-09 Konstantinos Papafitsoros , Carola-Bibiane Schönlieb

In this paper, we propose a reduced order approach for 3D variational data assimilation governed by parametrized partial differential equations. In contrast to the classical 3D-VAR formulation that penalizes the measurement error directly,…

Numerical Analysis · Mathematics 2019-05-16 Nicole Aretz-Nellesen , Martin A. Grepl , Karen Veroy

Several new estimation methods have been recently proposed for the linear regression model with observation error in the design. Different assumptions on the data generating process have motivated different estimators and analysis. In…

Statistics Theory · Mathematics 2014-12-24 Alexandre Belloni , Mathieu Rosenbaum , Alexandre B. Tsybakov

We interpret steady linear statistical inverse problems as artificial dynamic systems with white noise and introduce a stochastic differential equation (SDE) system where the inverse of the ending time $T$ naturally plays the role of the…

Numerical Analysis · Mathematics 2020-04-10 Shuai Lu , Pingping Niu , Frank Werner

This article addresses the issue of estimating observation parameters (response and error parameters) in inverse problems. The focus is on cases where regularization is introduced in a Bayesian framework and the prior is modeled by a…

Machine Learning · Statistics 2026-02-13 Jean-François Giovannelli

In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square…

Optimization and Control · Mathematics 2021-12-07 Nikita Doikov , Yurii Nesterov

We study weighted Tikhonov regularization for large-scale linear discrete ill-posed problems with random noise. Under a polynomial upper-bound assumption on the generalized eigenvalues of the discrete forward operator, we derive stochastic…

Numerical Analysis · Mathematics 2026-05-19 Duan-Peng Ling , Wenlong Zhang

In this study, we examine numerical approximations for 2nd-order linear-nonlinear differential equations with diverse boundary conditions, followed by the residual corrections of the first approximations. We first obtain numerical results…

Numerical Analysis · Mathematics 2023-06-19 Shovan Sourav Datta Pranta , Md. Shafiqul Islam

In recent years, a series of convergence rates conditions for regularization methods has been developed. Mainly, the motivations for developing novel conditions came from the desire to carry over convergence rates results from the Hilbert…

Functional Analysis · Mathematics 2014-09-29 Roman Andreev , Peter Elbau , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

We consider the problem of estimating the inverse covariance matrix by maximizing the likelihood function with a penalty added to encourage the sparsity of the resulting matrix. We propose a new approach based on the split Bregman method to…

Machine Learning · Statistics 2015-03-17 Gui-Bo Ye , Jian-Feng Cai , Xiaohui Xie

This paper investigates tradeoffs among optimization errors, statistical rates of convergence and the effect of heavy-tailed errors for high-dimensional robust regression with nonconvex regularization. When the additive errors in linear…

Statistics Theory · Mathematics 2021-01-01 Xiaoou Pan , Qiang Sun , Wen-Xin Zhou

Variational analysis provides the theoretical foundations and practical tools for constructing optimization algorithms without being restricted to smooth or convex problems. We survey the central concepts in the context of a concrete but…

Optimization and Control · Mathematics 2025-04-08 Johannes O. Royset

Error bound analysis, which estimates the distance of a point to the solution set of an optimization problem using the optimality residual, is a powerful tool for the analysis of first-order optimization algorithms. In this paper, we use…

Optimization and Control · Mathematics 2020-07-01 Jiawei Zhang , Zhiquan Luo

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Data-driven approaches for inverse problems aim for learning model and regularization parameters from observed data samples, and…

Optimization and Control · Mathematics 2024-11-28 Mathias Staudigl , Simon Weissmann , Tristan van Leeuwen

Solving inverse problems involving measurement noise and modeling errors requires regularization in order to avoid data overfit. Geophysical inverse problems, in which the Earth's highly heterogeneous structure is unknown, present a…

Geophysics · Physics 2022-03-31 Ali Siahkoohi , Rafael Orozco , Gabrio Rizzuti , Felix J. Herrmann