English
Related papers

Related papers: Fast optimization via inertial dynamics with close…

200 papers

In a Hilbert space setting $\mathcal H$, given $\Phi: \mathcal H \to \mathbb R$ a convex continuously differentiable function, and $\alpha$ a positive parameter, we consider the inertial system with Asymptotic Vanishing Damping…

Optimization and Control · Mathematics 2017-06-20 Hedy Attouch , Zaki Chbani , Hassan Riahi

In a Hilbert setting we study the convergence properties of a second order in time dynamical system combining viscous and Hessian-driven damping with time scaling in relation with the minimization of a nonsmooth and convex function. The…

Optimization and Control · Mathematics 2022-03-03 Radu Ioan Bot , Mikhail A. Karapetyants

We introduce an autonomous system with closed-loop damping for first-order convex optimization. While, to this day, optimal rates of convergence are almost exclusively achieved by non-autonomous methods via open-loop damping (e.g.,…

Optimization and Control · Mathematics 2024-04-16 Severin Maier , Camille Castera , Peter Ochs

In a Hilbert space, we provide a fast dynamic approach to the hierarchical minimization problem which consists in finding the minimum norm solution of a convex minimization problem. For this, we study the convergence properties of the…

Optimization and Control · Mathematics 2021-08-21 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

In this paper we carry out an asymptotic analysis of the proximal-gradient dynamical system \begin{equation*}\left\{ \begin{array}{ll} \dot x(t) +x(t) = \prox_{\gamma f}\big[x(t)-\gamma\nabla\Phi(x(t))-ax(t)-by(t)\big],\\ \dot…

Optimization and Control · Mathematics 2016-10-05 Radu Ioan Bot , Ernö Robert Csetnek

In a separable Hilbert space, we study the minimization problem of a convex smooth function with Lipschitz continuous gradient whose evaluations are corrupted by random noise. To this end, we associate a stochastic inertial system that…

Optimization and Control · Mathematics 2025-12-18 Chiara Schindler

This paper deals with a second order dynamical system with a Tikhonov regularization term in connection to the minimization problem of a convex Fr\'echet differentiable function. The fact that beside the asymptotically vanishing damping we…

Optimization and Control · Mathematics 2024-01-08 Szilárd Csaba László

In this paper we propose new numerical algorithms in the setting of unconstrained optimization problems and we study the rate of convergence in the iterates of the objective function. Furthermore, our algorithms are based upon splitting and…

Optimization and Control · Mathematics 2020-02-11 Cristian Daniel Alecsa

We introduce a novel adaptive damping technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non-convex Rosenbrock's function, we show an…

Optimization and Control · Mathematics 2021-12-08 Subhransu Bhattacharjee , Ian Petersen

In a Hilbertian framework, for the minimization of a general convex differentiable function $f$, we introduce new inertial dynamics and algorithms that generate trajectories and iterates that converge fastly towards the minimizer of $f$…

Optimization and Control · Mathematics 2021-04-27 Hedy Attouch , Szilard Laszlo

In connection with the optimization problem $$\inf_{x\in argmin \Psi}\{\Phi(x)+\Theta(x)\},$$ where $\Phi$ is a proper, convex and lower semicontinuous function and $\Theta$ and $\Psi$ are convex and smooth functions defined on a real…

Optimization and Control · Mathematics 2016-03-16 Radu Ioan Bot , Ernö Robert Csetnek

Second-order continuous-time dissipative dynamical systems with viscous and Hessian driven damping have inspired effective first-order algorithms for solving convex optimization problems. While preserving the fast convergence properties of…

Optimization and Control · Mathematics 2022-03-18 Hedy Attouch , Jalal Fadili , Vyacheslav Kungurtsev

In a Hilbert setting we aim to study a second order in time differential equation, combining viscous and Hessian-driven damping, containing a time scaling parameter function and a Tikhonov regularization term. The dynamical system is…

Optimization and Control · Mathematics 2024-04-24 Robert Ernö Csetnek , Mikhail A. Karapetyants

In this paper, we examine the convergence properties of heavy-ball dynamics with Hessian-driven damping in smooth non-convex optimization problems satisfying a {\L}ojasiewicz condition. In this general setting, we provide a series of tight,…

Optimization and Control · Mathematics 2025-06-16 Vassilis Apidopoulos , Vasiliki Mavrogeorgou , Theodoros G. Tsironis

First-order optimization algorithms can be considered as a discretization of ordinary differential equations (ODEs) \cite{su2014differential}. In this perspective, studying the properties of the corresponding trajectories may lead to…

Optimization and Control · Mathematics 2022-06-22 Jean-François Aujol , Charles Dossal , Văn Hào Hoàng , Hippolyte Labarrière , Aude Rondepierre

In the framework of a real Hilbert space, we address the problem of finding the zeros of the sum of a maximally monotone operator $A$ and a cocoercive operator $B$. We study the asymptotic behaviour of the trajectories generated by a second…

Optimization and Control · Mathematics 2022-01-05 Radu Ioan Bot , David Alexander Hulett

In this work, we approach the problem of finding the zeros of a continuous and monotone operator through a second-order dynamical system with a damping term of the form $1/t^{r}$, where $r\in [0, 1]$. The system features the time derivative…

Optimization and Control · Mathematics 2024-07-23 Radu Ioan Bot , David Alexander Hulett , Dang-Khoa Nguyen

In this paper, we propose a second-order continuous primal-dual dynamical system with time-dependent positive damping terms for a separable convex optimization problem with linear equality constraints. By the Lyapunov function approach, we…

Optimization and Control · Mathematics 2020-07-27 Xin He , Rong Hu , Ya-Ping Fang

This paper develops a primal-dual dynamical system where the coefficients are designed in closed-loop way for solving a convex optimization problem with linear equality constraints. We first introduce a ``second-order primal" +…

Optimization and Control · Mathematics 2026-03-03 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

We provide a control-theoretic perspective on optimal tensor algorithms for minimizing a convex function in a finite-dimensional Euclidean space. Given a function $\Phi: \mathbb{R}^d \rightarrow \mathbb{R}$ that is convex and twice…

Optimization and Control · Mathematics 2026-01-21 Tianyi Lin , Michael. I. Jordan