English
Related papers

Related papers: Worst Exponential Decay Rate for Degenerate Gradie…

200 papers

Stochastic gradient descent is an optimisation method that combines classical gradient descent with random subsampling within the target functional. In this work, we introduce the stochastic gradient process as a continuous-time…

Probability · Mathematics 2021-05-11 Jonas Latz

We give the first almost-linear total time algorithm for deciding if a flow of cost at most $F$ still exists in a directed graph, with edge costs and capacities, undergoing decremental updates, i.e., edge deletions, capacity decreases, and…

Data Structures and Algorithms · Computer Science 2024-07-16 Jan van den Brand , Li Chen , Rasmus Kyng , Yang P. Liu , Simon Meierhans , Maximilian Probst Gutenberg , Sushant Sachdeva

We present an effective numerical procedure, which is based on the computational scheme from [Heid et al., arXiv:1906.06954], for the numerical approximation of excited states of Schr\"odingers equation. In particular, this procedure…

Numerical Analysis · Mathematics 2021-09-16 Pascal Heid

While the asymptotic stability of positive linear systems in the presence of bounded time delays has been thoroughly investigated, the theory for nonlinear positive systems is considerably less well-developed. This paper presents a set of…

Systems and Control · Computer Science 2016-11-18 Hamid Reza Feyzmahdavian , Themistoklis Charalambous , Mikael Johansson

Autoregressive exogenous (ARX) systems are the general class of input-output dynamical systems used for modeling stochastic linear dynamical systems (LDS) including partially observable LDS such as LQG systems. In this work, we study the…

Machine Learning · Computer Science 2021-08-30 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

We consider in this work a model conservative system subject to dissipation and Gaussian-type stochastic perturbations. The original conservative system possesses a continuous set of steady states, and is thus degenerate. We characterize…

Probability · Mathematics 2019-02-26 Wenqing Hu

A new adaptive predictive controller for constrained linear systems is presented. The main feature of the proposed controller is the partition of the input in two components. The first part is used to persistently excite the system, in…

Systems and Control · Computer Science 2018-04-23 Bernardo A. Hernandez , Paul A. Trodden

Stochastic gradient descent (SGD) is a simple and popular method to solve stochastic optimization problems which arise in machine learning. For strongly convex problems, its convergence rate was known to be O(\log(T)/T), by running SGD for…

Machine Learning · Computer Science 2015-03-19 Alexander Rakhlin , Ohad Shamir , Karthik Sridharan

Although persistent excitation is often acknowledged as a sufficient condition to exponentially converge in the field of adaptive parameter estimation, it must be noted that in practical applications this may be unguaranteed. Recently, more…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Siyu Chen , Jing Na , Yingbo Huang

This paper focuses on an AC optimal power flow (OPF) problem for distribution feeders equipped with controllable distributed energy resources (DERs). We consider a solution method that is based on a continuous approximation of the projected…

Optimization and Control · Mathematics 2026-02-26 Damola Ajeyemi , Yiting Chen , Antonin Colot , Jorge Cortes , Emiliano Dall'Anese

We study the stability of a type of stratified flows of the two dimensional inviscid incompressible MHD equations with velocity damping. The exponential stability for the perturbation near certain stratified flow is investigated in a…

Analysis of PDEs · Mathematics 2019-10-24 Yi Du , Wang Yang , Yi Zhou

We propose graph-dependent implicit regularisation strategies for distributed stochastic subgradient descent (Distributed SGD) for convex problems in multi-agent learning. Under the standard assumptions of convexity, Lipschitz continuity,…

Machine Learning · Computer Science 2018-09-20 Dominic Richards , Patrick Rebeschini

We consider the following problem: find a fixed-order linear controller that maximizes the closed-loop asymptotic decay rate for the classical two-mass-spring system. This can be formulated as the problem of minimizing the abscissa (maximum…

Optimization and Control · Mathematics 2007-05-23 Didier Henrion , Michael L. Overton

The scope of this research is the identification of unknown piecewise constant parameters of linear regression equation under the finite excitation condition. Compared to the known methods, to make the computational burden lower, only one…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Anton Glushchenko , Konstantin Lastochkin

The modified Method of Successive Approximations (MSA) is an iterative scheme for approximating solutions to stochastic control problems in continuous time based on Pontryagin Optimality Principle which, starting with an initial open loop…

Optimization and Control · Mathematics 2023-10-10 Deven Sethi , David Šiška

We consider the problem of recovering a real-valued $n$-dimensional signal from $m$ phaseless, linear measurements and analyze the amplitude-based non-smooth least squares objective. We establish local convergence of subgradient descent…

Machine Learning · Computer Science 2021-08-31 Paul Hand , Oscar Leong , Vladislav Voroninski

We develop a methodology to automatically compute worst-case performance bounds for a class of decentralized algorithms that optimize the average of local functions distributed across a network. We extend the recently proposed PEP approach…

Optimization and Control · Mathematics 2022-03-14 Sebastien Colla , Julien M. Hendrickx

By analyzing accelerated proximal gradient methods under a local quadratic growth condition, we show that restarting these algorithms at any frequency gives a globally linearly convergent algorithm. This result was previously known only for…

Optimization and Control · Mathematics 2019-10-04 Olivier Fercoq , Zheng Qu

This paper concerns an optimal impulse control problem associated with a refracted L\'{e}vy process, involving the reduction of reserves to a predetermined level whenever they exceed a specified threshold. The ruin time is determined by…

Optimization and Control · Mathematics 2026-01-29 Zhongqin Gao , Yan Lv , Jingmin He

Voltage control in power distribution networks has been greatly challenged by the increasing penetration of volatile and intermittent devices. These devices can also provide limited reactive power resources that can be used to regulate the…

Systems and Control · Computer Science 2016-07-26 Hao Jan Liu , Wei Shi , Hao Zhu
‹ Prev 1 8 9 10 Next ›