English
Related papers

Related papers: A Speed Restart Scheme for a Dynamical System with…

200 papers

We propose a new method for controlling linear dynamical systems under adversarial disturbances and cost functions. Our algorithm achieves a running time that scales polylogarithmically with the inverse of the stability margin, improving…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Anand Brahmbhatt , Gon Buzaglo , Sofiia Druchyna , Elad Hazan

Infrequent Metadynamics is a popular method to obtain the rates of long timescale processes from accelerated simulations. The inference procedure is based on rescaling the first-passage times of Metadynamics trajectories using a…

Chemical Physics · Physics 2025-03-04 Ofir Blumer , Shlomi Reuveni , Barak Hirshberg

We consider minimizing finite-sum and expectation objective functions via Hessian-averaging based subsampled Newton methods. These methods allow for gradient inexactness and have fixed per-iteration Hessian approximation costs. The recent…

Optimization and Control · Mathematics 2024-08-15 Thomas O'Leary-Roseberry , Raghu Bollapragada

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

In this work, we approach the minimization of a continuously differentiable convex function under linear equality constraints by a second-order dynamical system with an asymptotically vanishing damping term. The system under consideration…

Optimization and Control · Mathematics 2022-09-15 David Alexander Hulett , Dang-Khoa Nguyen

We present a conservative/dissipative time integration scheme for nonlinear mechanical systems. Starting from a weak form, we derive algorithmic forces and velocities that guarantee the desired conservation/dissipation properties. Our…

Numerical Analysis · Mathematics 2019-11-01 Cristian G. Gebhardt , Ignacio Romero , Raimund Rolfes

We study a nonsmooth nonconvex optimization problem defined over nonconvex constraints, where the feasible set is given by the intersection of the closure of an open set and a smooth manifold. By endowing the open set with a Riemannian…

Optimization and Control · Mathematics 2025-07-28 Kuangyu Ding , Kim-Chuan Toh

An algorithm for a family of self-starting high-order implicit time integration schemes with controllable numerical dissipation is proposed for both linear and nonlinear transient problems. This work builds on the previous works of the…

Numerical Analysis · Mathematics 2024-09-23 Daniel O'Shea , Xiaoran Zhang , Shayan Mohammadian , Chongmin Song

Inspired by the recent paper (L. Ying, Mirror descent algorithms for minimizing interacting free energy, Journal of Scientific Computing, 84 (2020), pp. 1-14),we explore the relationship between the mirror descent and the variable metric…

Optimization and Control · Mathematics 2021-06-28 Li Wang , Ming Yan

Non-convex sampling is a key challenge in machine learning, central to non-convex optimization in deep learning as well as to approximate probabilistic inference. Despite its significance, theoretically there remain many important…

Machine Learning · Computer Science 2024-09-18 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical…

Optimization and Control · Mathematics 2022-05-23 Xin He , Rong Hu , Ya-Ping Fang

We consider a multidimensional time-homogeneous dynamical system and add a randomly perturbed time-dependent deterministic signal to some of its components, giving rise to a high-dimensional system of stochastic differential equations,…

Probability · Mathematics 2019-08-02 Simon Holbach

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

Gradient restarting has been shown to improve the numerical performance of accelerated gradient methods. This paper provides a mathematical analysis to understand these advantages. First, we establish global linear convergence guarantees…

Optimization and Control · Mathematics 2025-05-28 Chenglong Bao , Liang Chen , Jiahong Li , Zuowei Shen

As has long been known to computer scientists, the performance of probabilistic algorithms characterized by relatively large runtime fluctuations can be improved by applying a restart, i.e., episodic interruption of a randomized…

Statistical Mechanics · Physics 2023-06-21 Dmitry Starkov , Sergey Belan

We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a…

Optimization and Control · Mathematics 2024-06-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

In this paper, we consider the convergence rate with respect to Wasserstein distance in the invariance principle for deterministic nonuniformly hyperbolic systems, where both discrete time systems and flows are included. Our results apply…

Dynamical Systems · Mathematics 2023-01-04 Zhenxin Liu , Zhe Wang

This paper is devoted to the study of acceleration methods for an inequality constrained convex optimization problem by using Lyapunov functions. We first approximate such a problem as an unconstrained optimization problem by employing the…

Optimization and Control · Mathematics 2024-11-25 Juan Liu , Nan-Jing Huang , Xian-Jun Long , Xue-song Li

Our work is part of the close link between continuous-time dissipative dynamical systems and optimization algorithms, and more precisely here, in the stochastic setting. We aim to study stochastic convex minimization problems through the…

Optimization and Control · Mathematics 2025-02-21 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen
‹ Prev 1 3 4 5 6 7 10 Next ›