English
Related papers

Related papers: Penalty-based smoothness conditions in convex vari…

200 papers

This paper concerns parameterized convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional Banach (resp. finite-dimensional) spaces and that are indexed by an arbitrary fixed set T…

Optimization and Control · Mathematics 2011-02-07 M. J. CÁnovas , M. A. LÓpez , B. S. Mordukhovich , J. Parra

The presence of non-convexity in smooth optimization problems arising from deep learning have sparked new smoothness conditions in the literature and corresponding convergence analyses. We discuss these smoothness conditions, order them,…

Machine Learning · Computer Science 2024-09-23 Vivak Patel , Christian Varner

We deal with a boundary detection problem arising in nondestructive testing of materials. The problem consists in recovering an unknown portion of the boundary, where a Robin condition is satisfied, with the use of a Cauchy data pair…

Numerical Analysis · Mathematics 2013-05-07 Hui Cao , Sergei V. Pereverzev , Eva Sincich

We consider the efficient numerical minimization of Tikhonov functionals with nonlinear operators and non-smooth and non-convex penalty terms, which appear for example in variational regularization. For this, we consider a new class of SCD…

Numerical Analysis · Mathematics 2024-10-18 Helmut Gfrerer , Simon Hubmer , Ronny Ramlau

Tikhonov regularization for projected solutions of large-scale ill-posed problems is considered. The Golub-Kahan iterative bidiagonalization is used to project the problem onto a subspace and regularization then applied to find a subspace…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Saeed Vatankhah , Vahid E. Ardestani

The original motivation for this paper was to provide an efficient quantitative analysis of convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional (resp. finite-dimensional)…

Optimization and Control · Mathematics 2011-02-11 M. J. Cánovas , M. A. LóPez , B. S. Mordukhovich , J. Parra

In the literature on singular perturbation (Lavrentiev regularization) for the stable approximate solution of operator equations with monotone operators in the Hilbert space the phenomena of conditional stability and local well-posedness…

Numerical Analysis · Mathematics 2016-11-23 Radu Ioan Bot , Bernd Hofmann

This paper is devoted to studying the stationary solutions of a general constrained optimization problem through its associated unconstrained penalized problems. We aim to answer the question, "what do the stationary solutions of a…

Optimization and Control · Mathematics 2022-06-28 Ashkan Mohammadi

In this article, we consider the Tikhonov regularization of an optimal control problem of semilinear partial differential equations with box constraints on the control. We derive a-priori regularization error estimates for the control under…

Optimization and Control · Mathematics 2017-05-04 Frank Pörner , Daniel Wachsmuth

We study settings where gradient penalties are used alongside risk minimization with the goal of obtaining predictors satisfying different notions of monotonicity. Specifically, we present two sets of contributions. In the first part of the…

Machine Learning · Computer Science 2022-05-18 Joao Monteiro , Mohamed Osama Ahmed , Hossein Hajimirsadeghi , Greg Mori

Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization…

Numerical Analysis · Mathematics 2024-06-05 Silvia Gazzola , Ali Gholami

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

We consider joint Tikhonov- and Lavrentiev-regularization of control problems with pointwise control- and state-constraints. We derive error estimates for the error which is introduced by the Tikhonov regularization. With the help of this…

Optimization and Control · Mathematics 2010-10-26 Dirk A. Lorenz , Arnd Rösch

Tomographic reconstruction is an ill-posed inverse problem that calls for regularization. One possibility is to require sparsity of the unknown in an orthonormal wavelet basis. This in turn can be achieved by variational regularization…

Numerical Analysis · Mathematics 2018-01-17 Zenith Purisha , Juho Rimpeläinen , Tatiana Bubba , Samuli Siltanen

In high-dimensional and/or non-parametric regression problems, regularization (or penalization) is used to control model complexity and induce desired structure. Each penalty has a weight parameter that indicates how strongly the structure…

Machine Learning · Statistics 2017-03-30 Jean Feng , Noah Simon

Most of the literature on the solution of linear ill-posed operator equations, or their discretization, focuses only on the infinite-dimensional setting or only on the solution of the algebraic linear system of equations obtained by…

Numerical Analysis · Mathematics 2018-12-05 Ronny Ramlau , Lothar Reichel

Many practical optimization problems lack strong convexity. Fortunately, recent studies have revealed that first-order algorithms also enjoy linear convergences under various weaker regularity conditions. While the relationship among…

Optimization and Control · Mathematics 2026-02-05 Feng-Yi Liao , Lijun Ding , Yang Zheng

The objective of this paper is to introduce and study a complicated nonlinear system, called coupled variational-hemivariational inequalities, which is described by a highly nonlinear coupled system of inequalities on Banach spaces. We…

Analysis of PDEs · Mathematics 2023-09-12 YR. Bai , S. Migorski , VT. Nguyen , JW. Peng

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

On normed vector spaces there is a well-known connection between the Tikhonov well-posedness of a minimisation problem and the differentiability of an associated convex conjugate function. We show how this duality naturally generalises to…

Functional Analysis · Mathematics 2025-08-29 Jan Fischer , Jobst Ziebell