English
Related papers

Related papers: Variational regularization with oversmoothing pena…

200 papers

A number of important results of studying large deformations of hyper-elastic shells are obtained using discrete methods of mathematical physics. In the present paper, using the variational method for solving nonlinear boundary problems of…

Analysis of PDEs · Mathematics 2015-06-26 V. A. Trotsenko

Non-smooth optimization is a core ingredient of many imaging or machine learning pipelines. Non-smoothness encodes structural constraints on the solutions, such as sparsity, group sparsity, low-rank and sharp edges. It is also the basis for…

Optimization and Control · Mathematics 2022-05-04 Clarice Poon , Gabriel Peyré

We investigate non-convex optimization problems in $BV(\Omega)$ with two-sided pointwise inequality constraints. We propose a regularization and penalization method to numerically solve the problem. Under certain conditions, weak limit…

Optimization and Control · Mathematics 2021-10-06 Carolin Natemeyer , Daniel Wachsmuth

We study the inverse boundary value problem for the Helmholtz equation using the Dirichlet-to-Neumann map at selected frequency as the data. We develop an explicit reconstruction of the wavespeed using a multi-level nonlinear projected…

Numerical Analysis · Mathematics 2014-06-11 Elena Beretta , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

The Cauchy problem for a nonlinear elastic wave equations with viscoelastic damping terms is considered on the 3 dimensional whole space. Decay and smoothing properties of the solutions are investigated when the initial data are…

Analysis of PDEs · Mathematics 2021-11-09 Yoshiyuki Kagei , Hiroshi Takeda

The representer theorem is one of the most important mathematical foundations for regularised learning and kernel methods. Classical formulations of the theorem state sufficient conditions under which a regularisation problem on a Hilbert…

Functional Analysis · Mathematics 2019-11-04 Kevin Schlegel

We explore the $k$-smoothness of bounded linear operators between Banach spaces, using the newly introduced notion of index of smoothness. The characterization of the $k$-smoothness of operators between Hilbert spaces follows as a direct…

Functional Analysis · Mathematics 2024-08-14 Debmalya Sain , Shamim Sohel , Kallol Paul

Recently, the stochastic asymptotical regularization (SAR) has been developed in (\emph{Inverse Problems}, 39: 015007, 2023) for the uncertainty quantification of the stable approximate solution of linear ill-posed inverse problems. In this…

Numerical Analysis · Mathematics 2024-08-27 Haie Long , Ye Zhang

In this work, we study first-order algorithms for solving Bilevel Optimization (BO) where the objective functions are smooth but possibly nonconvex in both levels and the variables are restricted to closed convex sets. As a first step, we…

Optimization and Control · Mathematics 2024-02-13 Jeongyeol Kwon , Dohyun Kwon , Stephen Wright , Robert Nowak

We present a new optimization-theoretic approach to analyzing Follow-the-Leader style algorithms, particularly in the setting where perturbations are used as a tool for regularization. We show that adding a strongly convex penalty function…

Machine Learning · Computer Science 2014-05-26 Jacob Abernethy , Chansoo Lee , Abhinav Sinha , Ambuj Tewari

We study the solutions of infinite dimensional linear inverse problems over Banach spaces. The regularizer is defined as the total variation of a linear mapping of the function to recover, while the data fitting term is a near arbitrary…

Optimization and Control · Mathematics 2017-11-03 Axel Flinth , Pierre Weiss

This work proposes an efficient batch algorithm for feature selection in reinforcement learning (RL) with theoretical convergence guarantees. To mitigate the estimation bias inherent in conventional regularization schemes, the first…

Machine Learning · Computer Science 2025-09-22 Kyohei Suzuki , Konstantinos Slavakis

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl

We introduce and analyze a fast iterative method based on sequential Bregman projections for nonlinear inverse problems in Banach spaces. The key idea, in contrast to the standard Landweber method, is to use multiple search directions per…

Numerical Analysis · Mathematics 2018-08-01 Anne Wald

We provide a concise proof of existence for nonlinear operator equations in separable Banach spaces. Notably, the operator is not assumed to be monotone. Instead, our main hypotheses consist of a continuity assumption and a generalized…

Analysis of PDEs · Mathematics 2025-03-21 Roland Becker , Malte Braack

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

Variational regularization and the quasisolutions method are justified for unbounded closed, possibly nonlinear, operators. The argument is quite simple and yields general results.

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

We review various characterizations of uniform convexity and smoothness on norm balls in finite-dimensional spaces and connect results stemming from the geometry of Banach spaces with \textit{scaling inequalities} used in analysing the…

Optimization and Control · Mathematics 2021-02-19 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta