English
Related papers

Related papers: Dissipativity Theory for Nesterov's Accelerated Me…

200 papers

Iterative first-order methods such as gradient descent and its variants are widely used for solving optimization and machine learning problems. There has been recent interest in analytic or numerically efficient methods for computing…

Systems and Control · Computer Science 2020-03-24 Laurent Lessard , Peter Seiler

The objective is to design distributed coordination strategies for a network of agents in a cyber-physical environment. In particular, we concentrate on the rendez-vous of agents having double-integrator dynamics with the addition of a…

Optimization and Control · Mathematics 2015-10-02 Claudio de Persis , Romain Postoyan

Partial differential equations (PDEs) describing thermodynamically isolated systems typically possess conserved quantities (like mass, momentum, and energy) and dissipated quantities (like entropy). Preserving these conservation and…

Numerical Analysis · Mathematics 2025-12-01 Boris D. Andrews , Patrick E. Farrell

Here, we study the ultimately bounded stability of network of mismatched systems using Lyapunov direct method. We derive an upper bound on the norm of the error of network states from its average states, which it achieves in finite time.…

Systems and Control · Computer Science 2016-07-25 Saeed Manaffam , Alireza Seyedi , Azadeh Vosoughi , Tara Javidi

We present a family of algorithms, called descent algorithms, for optimizing convex and non-convex functions. We also introduce a new first-order algorithm, called rescaled gradient descent (RGD), and show that RGD achieves a faster…

Optimization and Control · Mathematics 2020-01-07 Ashia Wilson , Lester Mackey , Andre Wibisono

We consider problems of minimizing functionals $\mathcal{F}$ of probability measures on the Euclidean space. To propose an accelerated gradient descent algorithm for such problems, we consider gradient flow of transport maps that give…

Optimization and Control · Mathematics 2023-09-06 Ken'ichiro Tanaka

We consider the task of designing sparse control laws for large-scale systems by directly minimizing an infinite horizon quadratic cost with an $\ell_1$ penalty on the feedback controller gains. Our focus is on an improved algorithm that…

Optimization and Control · Mathematics 2013-12-18 Matt Wytock , J. Zico Kolter

This work proposes an Accelerated Primal-Dual Fixed-Point (APDFP) method that employs Nesterov type acceleration to solve composite problems of the form min f(x) + g(Bx), where g is nonsmooth and B is a linear operator. The APDFP features…

Optimization and Control · Mathematics 2025-11-04 Ya-Nan Zhu

We propose and investigate a method for identifying timescales of dissipation in nonequilibrium steady states modeled as discrete-state Markov jump processes. The method is based on how the irreversibility-measured by the statistical…

Statistical Mechanics · Physics 2023-07-24 Freddy A. Cisneros , Nikta Fakhri , Jordan M. Horowitz

Three similar convergence notions are considered. Two of them are the long established notions of convergent dynamics and incremental stability. The other is the more recent notion of contraction analysis. All three convergence notions…

Optimization and Control · Mathematics 2018-11-06 Duc N. Tran , Björn S. Rüffer , Christopher M. Kellett

Understanding how systems respond to external perturbations is a fundamental challenge in physics, particularly for non-equilibrium and non-stationary processes. The fluctuation-dissipation theorem provides a complete framework for…

Statistical Mechanics · Physics 2026-05-06 Jiming Zheng , Zhiyue Lu

We propose a technique for the design and analysis of adaptation algorithms in dynamical systems. The technique applies both to systems with conventional Lyapunov-stable target dynamics and to ones of which the desired dynamics around the…

Optimization and Control · Mathematics 2007-05-23 Tyukin Ivan , Danil Prokhorov , Cees van Leeuwen

We present and discuss a general density-matrix description of energy-dissipation and decoherence phenomena in open quantum systems, able to overcome the intrinsic limitations of the conventional Markov approximation. In particular, the…

Quantum Physics · Physics 2015-05-30 Michele Pepe , David Taj , Rita Claudia Iotti , Fausto Rossi

We introduce a novel approach based on stochastic optimization to find the optimal sampling distribution for the data-driven stability analysis of switched linear systems. Our goal is to address limitations of existing approaches, in…

Optimization and Control · Mathematics 2025-09-01 Alexis Vuille , Guillaume O. Berger , Raphaël M. Jungers

We study learning properties of accelerated gradient descent methods for linear least-squares in Hilbert spaces. We analyze the implicit regularization properties of Nesterov acceleration and a variant of heavy-ball in terms of…

Machine Learning · Computer Science 2019-12-17 Nicolò Pagliana , Lorenzo Rosasco

Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i.e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results…

Machine Learning · Computer Science 2026-03-18 Hiroyasu Tsukamoto , Soon-Jo Chung , Jean-Jacques E. Slotine

This study presents a constructive methodology for designing accelerated convex optimisation algorithms in continuous-time domain. The two key enablers are the classical concept of passivity in control theory and the time-dependent change…

Optimization and Control · Mathematics 2024-09-16 Namhoon Cho , Hyo-Sang Shin

This paper proposes two nonlinear dynamics to solve constrained distributed optimization problem for resource allocation over a multi-agent network. In this setup, coupling constraint refers to resource-demand balance which is preserved at…

Systems and Control · Electrical Eng. & Systems 2023-10-30 Mohammadreza Doostmohammadian , Alireza Aghasi , Maria Vrakopoulou , Hamid R. Rabiee , Usman A. Khan , Themistoklis Charalambou

We introduce and investigate the asymptotic behaviour of the trajectories of a second order dynamical system with Tikhonov regularization for solving a monotone equation with single valued, monotone and continuous operator acting on a real…

Optimization and Control · Mathematics 2024-11-27 Ernö Robert Csetnek , Szilárd Csaba László

This paper enhances the classic Smagorinsky model by introducing an innovative, adaptive dissipation term that adjusts dynamically with distance from boundary regions. This modification addresses a known limitation of the standard model…