English
Related papers

Related papers: A priori stopping rule for an iterative Bregman me…

200 papers

We consider linear inverse problems under white noise. These types of problems can be tackled with, e.g., iterative regularisation methods and the main challenge is to determine a suitable stopping index for the iteration. Convergence…

Numerical Analysis · Mathematics 2022-05-02 Tim Jahn

The first-order optimality conditions for a generic nonlinear optimization problem are generated as part of the terminal transversality conditions of an optimal control problem. It is shown that the Lagrangian of the optimization problem is…

Optimization and Control · Mathematics 2022-03-17 I. M. Ross

In this paper we propose a new statistical stopping rule for constrained maximum likelihood iterative algorithms applied to ill-posed inverse problems. To this aim we extend the definition of Tikhonov regularization in a statistical…

Numerical Analysis · Mathematics 2012-12-14 Federico Benvenuto , Michele Piana

Early stopping of iterative algorithms is a widely-used form of regularization in statistics, commonly used in conjunction with boosting and related gradient-type algorithms. Although consistency results have been established in some…

Machine Learning · Statistics 2018-03-15 Yuting Wei , Fanny Yang , Martin J. Wainwright

We study Newton type methods for inverse problems described by nonlinear operator equations $F(u)=g$ in Banach spaces where the Newton equations $F'(u_n;u_{n+1}-u_n) = g-F(u_n)$ are regularized variationally using a general data misfit…

Numerical Analysis · Mathematics 2015-04-01 Thorsten Hohage , Frank Werner

This work is concerned with a class of optimal control problems governed by a partial differential equation that are motivated by an application in radiotherapy treatment planning, where the primary design objective is to minimize the…

Optimization and Control · Mathematics 2017-04-24 Richard C. Barnard , Christian Clason

In this paper, we propose a new framework for solving a general dynamic optimal stopping problem without time consistency. A sophisticated solution is proposed and is well-defined for any time setting with general flows of objectives. A…

Optimization and Control · Mathematics 2026-02-02 Hanqing Jin , Yanzhao Yang

In this paper, we analyze the convergence %semi-convergence properties of projected non-stationary block iterative methods (P-BIM) aiming to find a constrained solution to large linear, usually both noisy and ill-conditioned, systems of…

Numerical Analysis · Mathematics 2022-02-11 Mahdi Mirzapour , Andrzej Cegielski , Tommy Elfving

The present paper studies a kind of robust optimization problems with constraint. The problem is formulated through Backward Stochastic Differential Equations (BSDEs) with quadratic generators. A necessary condition is established for the…

Optimization and Control · Mathematics 2024-02-14 Peng Luo , Alexander Schied , Xiaole Xue

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We consider the discretization of parabolic initial boundary value problems by finite element methods in space and a Runge-Kutta time stepping scheme. Order optimal a-priori error estimates are derived in an energy-norm under natural…

Numerical Analysis · Mathematics 2015-07-21 Herbert Egger

We derive a posteriori error estimators for an optimal control problem governed by a convection-reaction-diffusion equation; control constraints are also considered. We consider a family of low-order stabilized finite element methods to…

Numerical Analysis · Mathematics 2017-04-24 Alejandro Allendes , Enrique Otarola , Richard Rankin

We study the choice of the regularisation parameter for linear ill-posed problems in the presence of data noise and operator perturbations, for which a bound on the operator error is known but the data noise-level is unknown. We introduce a…

Numerical Analysis · Mathematics 2018-07-16 Uno Hämarik , Urve Kangro , Stefan Kindermann , Kemal Raik

We propose and analyze a perturbative regularization method to approximate quadratic optimization problems with finite-dimensional degeneracy. The original problem is first approximated by a regularized problem depending on a small positive…

Numerical Analysis · Mathematics 2026-03-16 C. G. Gebhardt , I. Romero

The paper aims at the development of an apparatus for analysis and construction of near optimal solutions of singularly perturbed (SP) optimal controls problems (that is, problems of optimal control of SP systems) considered on the infinite…

Optimization and Control · Mathematics 2014-08-20 Vladimir Gaitsgory , Sergei Rossomakhine

A discretization of an optimal control problem of a stochastic parabolic equation driven by multiplicative noise is analyzed. The state equation is discretized by the continuous piecewise linear element method in space and by the backward…

Numerical Analysis · Mathematics 2021-02-23 Binjie Li

We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either…

Optimization and Control · Mathematics 2024-06-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

Many problems in machine learning write as the minimization of a sum of individual loss functions over the training examples. These functions are usually differentiable but, in some cases, their gradients are not Lipschitz continuous, which…

Optimization and Control · Mathematics 2024-04-29 S. Chraibi , F. Iutzeler , J. Malick , A. Rogozin

A general result on the method of randomized stopping is proved. It is applied to optimal stopping of controlled diffusion processes with unbounded coefficients to reduce it to an optimal control problem without stopping. This is motivated…

Probability · Mathematics 2008-05-15 Istvan Gyongy , David Siska

An iterative learning algorithm is presented for continuous-time linear-quadratic optimal control problems where the system is externally symmetric with unknown dynamics. Both finite-horizon and infinite-horizon problems are considered. It…

Optimization and Control · Mathematics 2025-10-10 Hamed Taghavian , Florian Dorfler , Mikael Johansson