English
Related papers

Related papers: Finite-Time Optimization via Scaled Gradient-Momen…

200 papers

For addressing optimisation tasks on finite dimensional quantum systems, we give a comprehensive account of the foundations of gradient flows on Riemannian manifolds including new developments: we extend former results from Lie groups such…

Quantum Physics · Physics 2010-12-07 T. Schulte-Herbrueggen , S. J. Glaser , G. Dirr , U. Helmke

We perform a convergence analysis of a discrete-in-time minimization scheme approximating a finite dimensional singularly perturbed gradient flow. We allow for different scalings between the viscosity parameter $\varepsilon$ and the time…

Analysis of PDEs · Mathematics 2018-11-14 Giovanni Scilla , Francesco Solombrino

In this paper, we propose two projection dynamical systems for solving inverse quasi-variational inequality problems in finite-dimensional Hilbert spaces-one ensuring finite-time stability and the other guaranteeing fixed-time stability. We…

Optimization and Control · Mathematics 2025-03-07 Nam Van Tran , Le Thi Thanh Hai

Stochastic gradient descent is an optimisation method that combines classical gradient descent with random subsampling within the target functional. In this work, we introduce the stochastic gradient process as a continuous-time…

Probability · Mathematics 2021-05-11 Jonas Latz

Finite-size scaling is a key tool in statistical physics, used to infer critical behavior in finite systems. Here we use the analogous concept of finite-time scaling to describe the bifurcation diagram at finite times in discrete dynamical…

Adaptation and Self-Organizing Systems · Physics 2018-04-12 Alvaro Corral , Lluis Alseda , Josep Sardanyes

A new energy-based stochastic extension of the Schrodinger equation for which the wave function collapses after the passage of a finite amount of time is proposed. An exact closed-form solution to the dynamical equation, valid for all…

Quantum Physics · Physics 2009-11-11 Dorje C. Brody , Lane P. Hughston

We introduce a new formulation for the finite element immersed boundary method which makes use of a distributed Lagrange multiplier. We prove that a full discretization of our model, based on a semi-implicit time advancing scheme, is…

Numerical Analysis · Mathematics 2015-03-05 Daniele Boffi , Nicola Cavallini , Lucia Gastaldi

The acceleration of gradient-based optimization methods is a subject of significant practical and theoretical importance, particularly within machine learning applications. While much attention has been directed towards optimizing within…

Optimization and Control · Mathematics 2024-11-12 Shi Chen , Qin Li , Oliver Tse , Stephen J. Wright

Algorithms for decentralized optimization and learning rely on local optimization steps coupled with combination steps over a graph. Recent works have demonstrated that using a time-varying sequence of matrices that achieves finite-time…

Optimization and Control · Mathematics 2026-02-17 Aaron Fainman , Stefan Vlaski

We study the time-averaged flow in a model of particles that randomly hop on a finite directed graph. In the limit as the number of particles and the time window go to infinity but the graph remains finite, the large-deviation rate…

Statistical Mechanics · Physics 2020-12-02 Davide Gabrielli , D. R. Michiel Renger

We develop a theory of finite-time scaling for dynamic quantum criticality by considering the competition among an external time scale, an intrinsic reaction time scale and an imaginary time scale arising respectively from an external…

Statistical Mechanics · Physics 2013-03-11 Shuai Yin , Xizhou Qin , Chaohong Lee , Fan Zhong

We analyze the convergence rate of various momentum-based optimization algorithms from a dynamical systems point of view. Our analysis exploits fundamental topological properties, such as the continuous dependence of iterates on their…

Optimization and Control · Mathematics 2021-04-13 Michael Muehlebach , Michael I. Jordan

We investigate the long time behavior of solutions to a shape and topology optimization problem with respect to the time-dependent Navier--Stokes equations. The sought topology is represented by a stationary phase-field that represents a…

Optimization and Control · Mathematics 2026-05-04 Michael Hinze , Christian Kahle , John Sebastian H. Simon

This article derives lower bounds on the convergence rate of continuous-time gradient-based optimization algorithms. The algorithms are subjected to a time-normalization constraint that avoids a reparametrization of time in order to make…

Optimization and Control · Mathematics 2020-08-04 Michael Muehlebach , Michael I. Jordan

An efficient multigrid framework is developed for the time marching of steady-state compressible flows with a spatially high-order ($p$-order polynomial) modal discontinuous Galerkin method. The core algorithm that based on a global…

Computational Physics · Physics 2018-07-04 Shu-Jie Li

In this paper, we consider continuous-time semi-decentralized dynamics for the equilibrium computation in a class of aggregative games. Specifically, we propose a scheme where decentralized projected-gradient dynamics are driven by an…

Optimization and Control · Mathematics 2018-03-29 Claudio De Persis , Sergio Grammatico

This paper studies the design of feedback controllers to steer a switching linear time-invariant dynamical system towards the solution trajectory of a time-varying convex optimization problem. We propose two types of controllers: (i) a…

Optimization and Control · Mathematics 2022-02-22 Gianluca Bianchin , Jorge I. Poveda , Emiliano Dall'Anese

Controlling complex dynamical systems has been a topic of considerable interest in academic circles in recent decades. While existing works have primarily focused on closed-loop control schemes with infinite-time durations, this paper…

Optimization and Control · Mathematics 2025-01-08 Xiaoxiao Peng , Shijie Zhou

We propose a new strategy for the determination of the step scaling function $\sigma(u)$ in finite size scaling studies using the Gradient Flow. In this approach the determination of $\sigma(u)$ is broken in two pieces: a change of the flow…

High Energy Physics - Lattice · Physics 2021-02-03 Alessandro Nada , Alberto Ramos

This paper is concerned with the problem of shape optimization of two-dimensional flows governed by the time-dependent Navier-Stokes equations. We derive the structures of shape gradients with respect to the shape of the variable domain for…

Optimization and Control · Mathematics 2007-05-23 Zhiming Gao , Yichen Ma , Hongwei Zhuang