English
Related papers

Related papers: Finite-Time Optimization via Scaled Gradient-Momen…

200 papers

While the optimization landscape of policy gradient methods has been recently investigated for partially observed linear systems in terms of both static output feedback and dynamical controllers, they only provide convergence guarantees to…

Optimization and Control · Mathematics 2023-04-25 Feiran Zhao , Xingyun Fu , Keyou You

We introduce a novel algorithm for gradient-based optimization of stochastic objective functions. The method may be seen as a variant of SGD with momentum equipped with an adaptive learning rate automatically adjusted by an 'energy'…

Optimization and Control · Mathematics 2022-03-24 Hailiang Liu , Xuping Tian

We present an algorithm for the simulation of the exact real-time dynamics of classical many-body systems with discrete energy levels. In the same spirit of kinetic Monte Carlo methods, a stochastic solution of the master equation is found,…

Statistical Mechanics · Physics 2016-07-20 Alejandro Mendoza-Coto , Rogelio Díaz-Méndez , Guido Pupillo

This paper presents a distributed continuous-time optimization framework aimed at overcoming the challenges posed by time-varying cost functions and constraints in multi-agent systems, particularly those subject to disturbances. By…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Zeinab Ebrahimi , Mohammad Deghat

Hybrid quantum-classical algorithms hold great promise for solving quantum control problems on near-term quantum computers. In this work, we employ the hybrid framework that integrates digital quantum simulation with classical optimization…

Quantum Physics · Physics 2025-07-01 Tangyou Huang , Jing-Jun Zhu , Zhong-Yi Ni

To overcome the oscillation problem in the classical momentum-based optimizer, recent work associates it with the proportional-integral (PI) controller, and artificially adds D term producing a PID controller. It suppresses oscillation with…

Machine Learning · Computer Science 2019-01-28 Dan Wang , Mengqi Ji , Yong Wang , Haoqian Wang , Lu Fang

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

This paper studies sequences of graphs satisfying the finite-time consensus property (i.e., iterating through such a finite sequence is equivalent to performing global or exact averaging) and their use in Gradient Tracking. We provide an…

Optimization and Control · Mathematics 2025-01-30 Edward Duc Hien Nguyen , Xin Jiang , Bicheng Ying , César A. Uribe

This paper develops a sequential-linearization feedback optimization framework for driving nonlinear dynamical systems to an optimal steady state. A fundamental challenge in feedback optimization is the requirement of accurate first-order…

Optimization and Control · Mathematics 2025-07-22 Shijie Huang , Sergio Grammatico

We introduce a new class of extremum seeking controllers able to achieve fixed time convergence to the solution of optimization problems defined by static and dynamical systems. Unlike existing approaches in the literature, the convergence…

Optimization and Control · Mathematics 2019-12-17 Jorge I. Poveda , Miroslav Krstic

Momentum methods for convex optimization often rely on precise choices of algorithmic parameters, based on knowledge of problem parameters, in order to achieve fast convergence, as well as to prevent oscillations that could severely…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Justin H. Le , Andrew R. Teel

We study topology optimization governed by the incompressible Navier-Stokes flows using a phase field model. Novel stabilized semi-implicit schemes for the gradient flows of Allen-Cahn and Cahn-Hilliard types are proposed for solving the…

Numerical Analysis · Mathematics 2024-05-09 Jiajie Li , Shengfeng Zhu

Optimization problems with continuous data appear in, e.g., robust machine learning, functional data analysis, and variational inference. Here, the target function is given as an integral over a family of (continuously) indexed target…

Machine Learning · Computer Science 2023-11-01 Kexin Jin , Jonas Latz , Chenguang Liu , Carola-Bibiane Schönlieb

We propose a new objective function for finite-horizon episodic Markov decision processes that better captures Bellman's principle of optimality, and provide an expression for the gradient of the objective.

Machine Learning · Computer Science 2019-06-10 Philip S. Thomas , Scott M. Jordan , Yash Chandak , Chris Nota , James Kostas

Accelerated gradient methods have had significant impact in machine learning -- in particular the theoretical side of machine learning -- due to their ability to achieve oracle lower bounds. But their heuristic construction has hindered…

Computation · Statistics 2018-02-16 Michael Betancourt , Michael I. Jordan , Ashia C. Wilson

There are much recent interests in solving noncovnex min-max optimization problems due to its broad applications in many areas including machine learning, networked resource allocations, and distributed optimization. Perhaps, the most…

Optimization and Control · Mathematics 2021-12-20 Thinh T. Doan

This paper investigates the problem of regulating in real time a linear dynamical system to the solution trajectory of a time-varying constrained convex optimization problem. The proposed feedback controller is based on an adaptation of the…

Optimization and Control · Mathematics 2021-09-13 Gianluca Bianchin , Jorge Cortes , Jorge I. Poveda , Emiliano Dall'Anese

We present a global optimization routine for the variational quantum algorithms, which utilizes the dynamic tunneling flow. Originally designed to leverage information gathered by a gradient-based optimizer around local minima, we adapt the…

Quantum Physics · Physics 2024-08-05 Seung Park , Kyunghyun Baek , Seungjin Lee , Mahn-Soo Choi

In this work, we present a high-order finite volume framework for the numerical simulation of shallow water flows. The method is designed to accurately capture complex dynamics inherent in shallow water systems, particularly suited for…

Numerical Analysis · Mathematics 2025-05-14 Mirco Ciallella , Lorenzo Micalizzi , Victor Michel-Dansac , Philipp Öffner , Davide Torlo

We introduce a new class of quantum models with time-dependent Hamiltonians of a special scaling form. By using a couple of time-dependent unitary transformations, the time evolution of these models is expressed in terms of related systems…

Quantum Physics · Physics 2009-11-07 L. Samaj
‹ Prev 1 3 4 5 6 7 10 Next ›