English
Related papers

Related papers: Tikhonov regularization of a second order dynamica…

200 papers

In this paper, we study the stochastic convergence of regularized solutions for backward heat conduction problems. These problems are recognized as ill-posed due to the exponential decay of eigenvalues associated with the forward problems.…

Numerical Analysis · Mathematics 2023-11-08 Zhongjian Wang , Wenlong Zhang , Zhiwen Zhang

We consider stochastic gradient methods under the interpolation regime where a perfect fit can be obtained (minimum loss at each observation). While previous work highlighted the implicit regularization of such algorithms, we consider an…

Optimization and Control · Mathematics 2020-04-01 Anant Raj , Francis Bach

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

Optimization and Control · Mathematics 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

Although the \emph{residual method}, or \emph{constrained regularization}, is frequently used in applications, a detailed study of its properties is still missing. This sharply contrasts the progress of the theory of Tikhonov…

Optimization and Control · Mathematics 2012-12-06 Markus Grasmair , Markus Haltmeier , Otmar Scherzer

We investigate the use of Tikhonov regularization with the minimum support stabilizer for underdetermined 2-D inversion of gravity data. This stabilizer produces models with non-smooth properties which is useful for identifying geologic…

Computational Engineering, Finance, and Science · Computer Science 2022-08-16 Saeed Vatankhah , Vahid E Ardestani , Rosemary A Renaut

We propose a comprehensive framework for solving constrained variational inequalities via various classes of evolution equations displaying multi-scale aspects. In an infinite-dimensional Hilbertian framework, the class of dynamical systems…

Optimization and Control · Mathematics 2025-07-25 Siqi Qu , Mathias Staudigl , Juan Peypouquet

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

Machine Learning · Statistics 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

In this paper, we propose a second-order continuous primal-dual dynamical system with time-dependent positive damping terms for a separable convex optimization problem with linear equality constraints. By the Lyapunov function approach, we…

Optimization and Control · Mathematics 2020-07-27 Xin He , Rong Hu , Ya-Ping Fang

We investigate regularity of minimizers in two dimensions for certain classes of non-smooth convex functionals. In particular our results apply to the surface tensions that appear in recent works on random surfaces and random tilings of…

Analysis of PDEs · Mathematics 2019-12-19 Daniela De Silva , Ovidiu Savin

It is well known that Tikhonov regularization is one of the most commonly used methods for solving ill-posed problems. One of the most widely applied approaches is based on constructing a new dataset whose sample size is greater than the…

Optimization and Control · Mathematics 2020-12-11 Ning Zhang

We are interested in the question of stability in the field of shape optimization, with focus on the strategy using second order shape derivative. More precisely, we identify structural hypotheses on the hessian of the considered shape…

Optimization and Control · Mathematics 2018-07-25 Marc Dambrine , Jimmy Lamboley , M Dambrine-J

In this paper we derive the asymptotic distributions of two distinct regularized estimators for functional canonical correlation as well as their associated eigenvalues, eigenvectors and projection operators. The methods we developed…

Statistics Theory · Mathematics 2015-02-10 David B. King

In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square…

Optimization and Control · Mathematics 2021-12-07 Nikita Doikov , Yurii Nesterov

In a real Hilbert space setting, we study the convergence properties of an inexact gradient algorithm featuring both viscous and Hessian driven damping for convex differentiable optimization. In this algorithm, the gradient evaluation can…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Jalal Fadili , Vyachelav Kungurtsev

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of…

Optimization and Control · Mathematics 2019-08-01 Sumeet Singh , Spencer M. Richards , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

In nonsmooth optimization, a negative subgradient is not necessarily a descent direction, making the design of convergent descent methods based on zeroth-order and first-order information a challenging task. The well-studied bundle methods…

Optimization and Control · Mathematics 2025-05-13 Hanyang Li , Ying Cui

We introduce a new restarting scheme for a continuous inertial dynamics with Hessian driven-damping, and establish a linear convergence rate for the function values along the restarted trajectories. The proposed routine is implemented…

Optimization and Control · Mathematics 2026-04-13 Juan José Maulén , Huiyuan Guo , Juan Peypouquet

We study Tikhonov regularization for certain classes of non-linear ill-posed operator equations in Hilbert space. Emphasis is on the case where the solution smoothness fails to have a finite penalty value, as in the preceding study…

Numerical Analysis · Mathematics 2019-04-04 Bernd Hofmann , Peter Mathé

In a bounded domain of $\mathbb{R}^n$ with smooth boundary, we study the regularity of the viscosity solution, $T$, of the Dirichlet problem for the eikonal equation associated with a family of smooth vector fields $\{X_1,\ldots ,X_N\}$,…

Optimization and Control · Mathematics 2017-05-30 Paolo Albano , Piermarco Cannarsa , Teresa Scarinci