English
Related papers

Related papers: Fractional-Order Nesterov Dynamics for Convex Opti…

200 papers

We develop the theory of fractional gradient flows: an evolution aimed at the minimization of a convex, l.s.c.~energy, with memory effects. This memory is characterized by the fact that the negative of the (sub)gradient of the energy equals…

Analysis of PDEs · Mathematics 2021-01-05 Wenbo Li , Abner J. Salgado

In this work, we approach the problem of finding the zeros of a continuous and monotone operator through a second-order dynamical system with a damping term of the form $1/t^{r}$, where $r\in [0, 1]$. The system features the time derivative…

Optimization and Control · Mathematics 2024-07-23 Radu Ioan Bot , David Alexander Hulett , Dang-Khoa Nguyen

In this work, we introduce a new class of neural network operators designed to handle problems where memory effects and randomness play a central role. In this work, we introduce a new class of neural network operators designed to handle…

Machine Learning · Computer Science 2025-05-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

We propose a class of \textit{Euler-Lagrange} equations indexed by a pair of parameters ($\alpha,r$) that generalizes Nesterov's accelerated gradient methods for convex ($\alpha=1$) and strongly convex ($\alpha=0$) functions from a…

Optimization and Control · Mathematics 2025-08-19 Xu Cheng , Jiaqi Liu , Zaijiu Shang

In this paper, by using a characterization of functions having fractional derivative, we propose a rigorous fractional Lyapunov function candidate method to analyze stability of fractional-order nonlinear systems. First, we prove an…

Classical Analysis and ODEs · Mathematics 2018-01-16 H. T. Tuan , Hieu Trinh

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

Optimization and Control · Mathematics 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

Much recent interest has focused on the design of optimization algorithms from the discretization of an associated optimization flow, i.e., a system of differential equations (ODEs) whose trajectories solve an associated optimization…

Optimization and Control · Mathematics 2022-02-02 Pedro Cisneros-Velarde , Francesco Bullo

We introduce a generic scheme for accelerating first-order optimization methods in the sense of Nesterov, which builds upon a new analysis of the accelerated proximal point algorithm. Our approach consists of minimizing a convex objective…

Optimization and Control · Mathematics 2015-10-27 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

Fractional gradient descent has been studied extensively, with a focus on its ability to extend traditional gradient descent methods by incorporating fractional-order derivatives. This approach allows for more flexibility in navigating…

Machine Learning · Computer Science 2024-11-25 Teodor Alexandru Szente , James Harrison , Mihai Zanfir , Cristian Sminchisescu

The notion of fractional dynamics is related to equations of motion with one or a few terms with derivatives of a fractional order. This type of equation appears in the description of chaotic dynamics, wave propagation in fractal media, and…

Classical Physics · Physics 2015-03-19 Vasily E. Tarasov , George M. Zaslavsky

We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously…

Optimization and Control · Mathematics 2021-03-12 Priyank Srivastava , Jorge Cortes

This paper contributes to the exploration of a recently introduced computational paradigm known as second-order flows, which are characterized by novel dissipative hyperbolic partial differential equations extending accelerated gradient…

Numerical Analysis · Mathematics 2025-05-13 Haifan Chen , Guozhi Dong , José A. Iglesias , Wei Liu , Ziqing Xie

In a Hilbert space setting, for convex optimization, we show the convergence of the iterates to optimal solutions for a class of accelerated first-order algorithms. They can be interpreted as discrete temporal versions of an inertial…

Optimization and Control · Mathematics 2021-07-14 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

In this article a family of second order ODEs associated to inertial gradient descend is studied. These ODEs are widely used to build trajectories converging to a minimizer $x^*$ of a function $F$, possibly convex. This family includes the…

Optimization and Control · Mathematics 2019-07-08 Othmane Sebbouh , Charles Dossal , Aude Rondepierre

In this paper, we propose a second-order continuous primal-dual dynamical system with time-dependent positive damping terms for a separable convex optimization problem with linear equality constraints. By the Lyapunov function approach, we…

Optimization and Control · Mathematics 2020-07-27 Xin He , Rong Hu , Ya-Ping Fang

In a Hilbert setting, we develop a gradient-based dynamic approach for fast solving convex optimization problems. By applying time scaling, averaging, and perturbation techniques to the continuous steepest descent (SD), we obtain…

Optimization and Control · Mathematics 2023-05-05 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We consider a conflict-controlled dynamical system described by a nonlinear ordinary fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1).$ Basing on the finite-difference Gr\"{u}nwald-Letnikov…

Optimization and Control · Mathematics 2019-02-26 Mikhail Gomoyunov

We investigate the integration of Nesterov-type acceleration into primal-dual methods for structured convex optimization. While proximal splitting algorithms efficiently handle composite problems of the form $\min_x f(x)+g(x)+h(Kx)$,…

Optimization and Control · Mathematics 2026-04-13 Laurent Condat , Abdurakhmon Sadiev , Peter Richtárik

In a Hilbert setting, we develop fast methods for convex unconstrained optimization. We rely on the asymptotic behavior of an inertial system combining geometric damping with temporal scaling. The convex function to minimize enters the…

Optimization and Control · Mathematics 2020-09-17 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

The main purpose of this paper is to study the fractional-order model with Caputo derivative associated to Lagrange system. For this fractional-order system we investigate the existence and uniqueness of solutions of initial value problem,…

Dynamical Systems · Mathematics 2022-11-22 Mihai Ivan