English
Related papers

Related papers: Levenberg-Marquardt dynamics associated to variati…

200 papers

We consider the minimization of a convex objective function subject to the set of minima of another convex function, under the assumption that both functions are twice continuously differentiable. We approach this optimization problem from…

Optimization and Control · Mathematics 2016-08-16 Radu Ioan Bot , Ernö Robert Csetnek

In a separable real Hilbert space, we study the problem of minimizing a convex function with Lipschitz continuous gradient in the presence of noisy evaluations. To this end, we associate a stochastic Heavy Ball system, incorporating a…

Optimization and Control · Mathematics 2025-10-06 Radu Ioan Bot , Chiara Schindler

We investigate the convergence rates of the trajectories generated by implicit first and second order dynamical systems associated to the determination of the zeros of the sum of a maximally monotone operator and a monotone and Lipschitz…

Optimization and Control · Mathematics 2015-04-09 Radu Ioan Bot , Ernö Robert Csetnek

We consider the Nesterov accelerated primal-dual dynamical system \[ \begin{cases} \ddot{x}(t)+\dfrac{\alpha}{t}\dot{x}(t) +\nabla f(x(t)) +A^\top\bigl(\lambda(t)+\theta t\dot{\lambda}(t)\bigr)+\beta A^\top(Ax(t)-b)=0,\\[0.6em]…

Optimization and Control · Mathematics 2026-05-28 Xin He , Nan-Jing Huang , Yi-Bin Xiao , Ya-Ping Fang

This paper deals with a Tikhonov regularized second-order inertial dynamical system that incorporates time scaling, asymptotically vanishing damping and Hessian-driven damping for solving convex optimization problems. Under appropriate…

Optimization and Control · Mathematics 2026-04-30 Xiangkai Sun , Guoxiang Tian , Huan Zhang

In this paper we investigate in a Hilbert space setting a second order dynamical system of the form $$\ddot{x}(t)+\g(t)\dot{x}(t)+x(t)-J_{\lambda(t) A}\big(x(t)-\lambda(t) D(x(t))-\lambda(t)\beta(t)B(x(t))\big)=0,$$ where $A:{\mathcal…

Dynamical Systems · Mathematics 2017-01-20 Radu Ioan Bot , Ernö Robert Csetnek , Szilárd Csaba László

Given a single trajectory of a dynamical system, we analyze the performance of the nonparametric least squares estimator (LSE). More precisely, we give nonasymptotic expected $l^2$-distance bounds between the LSE and the true regression…

Machine Learning · Computer Science 2022-02-22 Ingvar Ziemann , Henrik Sandberg , Nikolai Matni

In this work, we approach the minimization of a continuously differentiable convex function under linear equality constraints by a second-order dynamical system with an asymptotically vanishing damping term. The system under consideration…

Optimization and Control · Mathematics 2022-09-15 David Alexander Hulett , Dang-Khoa Nguyen

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

In a real Hilbert space $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order evolution equation $$ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = 0, $$ where…

Optimization and Control · Mathematics 2015-07-20 Hedy Attouch , Juan Peypouquet , Patrick Redont

In the framework of real Hilbert spaces we study continuous in time dynamics as well as numerical algorithms for the problem of approaching the set of zeros of a single-valued monotone and continuous operator $V$. The starting poin is a…

Optimization and Control · Mathematics 2024-02-23 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

In order to circumvent the difficulties in solving numerically the discrete optimal transport problem, in which one minimizes the linear target function $P\mapsto\langle C,P\rangle:=\sum_{i,j}C_{ij}P_{ij}$, Cuturi introduced a variant of…

Optimization and Control · Mathematics 2020-11-30 Daiji Tsutsui

In a Hilbert setting we aim to study a second order in time differential equation, combining viscous and Hessian-driven damping, containing a time scaling parameter function and a Tikhonov regularization term. The dynamical system is…

Optimization and Control · Mathematics 2024-04-24 Robert Ernö Csetnek , Mikhail A. Karapetyants

In this paper we propose a primal-dual dynamical approach to the minimization of a structured convex function consisting of a smooth term, a nonsmooth term, and the composition of another nonsmooth term with a linear continuous operator. In…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilard Laszlo

In a Hilbertian framework, for the minimization of a general convex differentiable function $f$, we introduce new inertial dynamics and algorithms that generate trajectories and iterates that converge fastly towards the minimizer of $f$…

Optimization and Control · Mathematics 2021-04-27 Hedy Attouch , Szilard Laszlo

In a Hilbert setting, we introduce a new dynamical system and associated algorithms for solving monotone inclusions by rapid methods. Given a maximal monotone operator $A$, the evolution is governed by the time dependent operator $I -(I +…

Optimization and Control · Mathematics 2015-04-20 Hedy Attouch , Maicon Marques Alves , Benar F. Svaiter

In a Hilbert setting, we develop fast methods for convex unconstrained optimization. We rely on the asymptotic behavior of an inertial system combining geometric damping with temporal scaling. The convex function to minimize enters the…

Optimization and Control · Mathematics 2020-09-17 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

We study the asymptotic behavior of the trajectory of a nonautonomous evolution equation governed by a quasi-nonexpansive operator in Hilbert spaces. We prove the weak convergence of the trajectory to a fixed point of the operator by…

Optimization and Control · Mathematics 2020-09-08 Ming Zhu , Rong Hu , Ya-Ping Fang

In a Hilbert framework, we introduce continuous and discrete dynamical systems which aim at solving inclusions governed by structured monotone operators $A=\partial\Phi+B$, where $\partial\Phi$ is the subdifferential of a convex lower…

Optimization and Control · Mathematics 2014-03-26 Boushra Abbas , Hedy Attouch

In this article, we provide a novel and broadly-applicable contraction-theoretic approach to continuous-time time-varying convex optimization. For any parameter-dependent contracting dynamics, we show that the tracking error is…

Optimization and Control · Mathematics 2025-07-24 Alexander Davydov , Veronica Centorrino , Anand Gokhale , Giovanni Russo , Francesco Bullo