中文
相关论文

相关论文: Fractional-Order Nesterov Dynamics for Convex Opti…

200 篇论文

We develop the theory of fractional gradient flows: an evolution aimed at the minimization of a convex, l.s.c.~energy, with memory effects. This memory is characterized by the fact that the negative of the (sub)gradient of the energy equals…

偏微分方程分析 · 数学 2021-01-05 Wenbo Li , Abner J. Salgado

In this work, we approach the problem of finding the zeros of a continuous and monotone operator through a second-order dynamical system with a damping term of the form $1/t^{r}$, where $r\in [0, 1]$. The system features the time derivative…

最优化与控制 · 数学 2024-07-23 Radu Ioan Bot , David Alexander Hulett , Dang-Khoa Nguyen

In this work, we introduce a new class of neural network operators designed to handle problems where memory effects and randomness play a central role. In this work, we introduce a new class of neural network operators designed to handle…

机器学习 · 计算机科学 2025-05-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

We propose a class of \textit{Euler-Lagrange} equations indexed by a pair of parameters ($\alpha,r$) that generalizes Nesterov's accelerated gradient methods for convex ($\alpha=1$) and strongly convex ($\alpha=0$) functions from a…

最优化与控制 · 数学 2025-08-19 Xu Cheng , Jiaqi Liu , Zaijiu Shang

In this paper, by using a characterization of functions having fractional derivative, we propose a rigorous fractional Lyapunov function candidate method to analyze stability of fractional-order nonlinear systems. First, we prove an…

经典分析与常微分方程 · 数学 2018-01-16 H. T. Tuan , Hieu Trinh

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

最优化与控制 · 数学 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

Much recent interest has focused on the design of optimization algorithms from the discretization of an associated optimization flow, i.e., a system of differential equations (ODEs) whose trajectories solve an associated optimization…

最优化与控制 · 数学 2022-02-02 Pedro Cisneros-Velarde , Francesco Bullo

We introduce a generic scheme for accelerating first-order optimization methods in the sense of Nesterov, which builds upon a new analysis of the accelerated proximal point algorithm. Our approach consists of minimizing a convex objective…

最优化与控制 · 数学 2015-10-27 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

Fractional gradient descent has been studied extensively, with a focus on its ability to extend traditional gradient descent methods by incorporating fractional-order derivatives. This approach allows for more flexibility in navigating…

机器学习 · 计算机科学 2024-11-25 Teodor Alexandru Szente , James Harrison , Mihai Zanfir , Cristian Sminchisescu

The notion of fractional dynamics is related to equations of motion with one or a few terms with derivatives of a fractional order. This type of equation appears in the description of chaotic dynamics, wave propagation in fractal media, and…

经典物理 · 物理学 2015-03-19 Vasily E. Tarasov , George M. Zaslavsky

We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously…

最优化与控制 · 数学 2021-03-12 Priyank Srivastava , Jorge Cortes

This paper contributes to the exploration of a recently introduced computational paradigm known as second-order flows, which are characterized by novel dissipative hyperbolic partial differential equations extending accelerated gradient…

数值分析 · 数学 2025-05-13 Haifan Chen , Guozhi Dong , José A. Iglesias , Wei Liu , Ziqing Xie

In a Hilbert space setting, for convex optimization, we show the convergence of the iterates to optimal solutions for a class of accelerated first-order algorithms. They can be interpreted as discrete temporal versions of an inertial…

最优化与控制 · 数学 2021-07-14 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

In this article a family of second order ODEs associated to inertial gradient descend is studied. These ODEs are widely used to build trajectories converging to a minimizer $x^*$ of a function $F$, possibly convex. This family includes the…

最优化与控制 · 数学 2019-07-08 Othmane Sebbouh , Charles Dossal , Aude Rondepierre

In this paper, we propose a second-order continuous primal-dual dynamical system with time-dependent positive damping terms for a separable convex optimization problem with linear equality constraints. By the Lyapunov function approach, we…

最优化与控制 · 数学 2020-07-27 Xin He , Rong Hu , Ya-Ping Fang

In a Hilbert setting, we develop a gradient-based dynamic approach for fast solving convex optimization problems. By applying time scaling, averaging, and perturbation techniques to the continuous steepest descent (SD), we obtain…

最优化与控制 · 数学 2023-05-05 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We consider a conflict-controlled dynamical system described by a nonlinear ordinary fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1).$ Basing on the finite-difference Gr\"{u}nwald-Letnikov…

最优化与控制 · 数学 2019-02-26 Mikhail Gomoyunov

We investigate the integration of Nesterov-type acceleration into primal-dual methods for structured convex optimization. While proximal splitting algorithms efficiently handle composite problems of the form $\min_x f(x)+g(x)+h(Kx)$,…

最优化与控制 · 数学 2026-04-13 Laurent Condat , Abdurakhmon Sadiev , Peter Richtárik

In a Hilbert setting, we develop fast methods for convex unconstrained optimization. We rely on the asymptotic behavior of an inertial system combining geometric damping with temporal scaling. The convex function to minimize enters the…

最优化与控制 · 数学 2020-09-17 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

The main purpose of this paper is to study the fractional-order model with Caputo derivative associated to Lagrange system. For this fractional-order system we investigate the existence and uniqueness of solutions of initial value problem,…

动力系统 · 数学 2022-11-22 Mihai Ivan