English
Related papers

Related papers: Approximate Gradient Descent Convergence Dynamics …

200 papers

Control of network systems with uncertain local dynamics has remained an open problem for a long time. In this paper, a distributed minimax adaptive control algorithm is proposed for such networks whose local dynamics has an uncertain…

Systems and Control · Electrical Eng. & Systems 2023-11-03 Venkatraman Renganathan , Anders Rantzer , Olle Kjellqvist

In this paper, we propose an adaptive stopping rule for kernel-based gradient descent (KGD) algorithms. We introduce the empirical effective dimension to quantify the increments of iterations in KGD and derive an implementable early…

Machine Learning · Computer Science 2023-06-14 Xiangyu Chang , Shao-Bo Lin

We present theoretical results and experiments with parallel algorithms for computing an adaptive, online control with the objective of attenuating a power grid cascading failure.

Optimization and Control · Mathematics 2010-12-21 Daniel Bienstock

Transmission line failures in power systems propagate and cascade non-locally. In this work, we propose an adaptive control strategy that offers strong guarantees in both the mitigation and localization of line failures. Specifically, we…

Systems and Control · Electrical Eng. & Systems 2022-05-16 Chen Liang , Linqi Guo , Alessandro Zocca , Steven H. Low , Adam Wierman

The minimization of operation costs for natural gas transport networks is studied. Based on a recently developed model hierarchy ranging from detailed models of instationary partial differential equations with temperature dependence to…

Optimization and Control · Mathematics 2017-12-08 Volker Mehrmann , Martin Schmidt , Jeroen J. Stolwijk

Adaptive guaranteed-performance consensus control problems for multi-agent systems are investigated, where the adjustable convergence speed is discussed. This paper firstly proposes a novel adaptive guaranteed-performance consensus…

Systems and Control · Computer Science 2019-06-12 Hai-Ying Ma , Xiao Jia , Ning Cai , Jian-Xiang Xi

The paper derives analytical expressions for the asymptotic average updating direction of the adaptive moment generation (ADAM) algorithm when applied to recursive identification of nonlinear systems. It is proved that the standard…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Torbjörn Wigren , Ruoqi Zhang , Per Mattsson

In this paper, we design two compressed decentralized algorithms for solving nonconvex stochastic optimization under two different scenarios. Both algorithms adopt a momentum technique to achieve fast convergence and a message-compression…

Machine Learning · Computer Science 2025-08-08 Wei Liu , Anweshit Panda , Ujwal Pandey , Christopher Brissette , Yikang Shen , George M. Slota , Naigang Wang , Jie Chen , Yangyang Xu

Selecting the best hyperparameters for a particular optimization instance, such as the learning rate and momentum, is an important but nonconvex problem. As a result, iterative optimization methods such as hypergradient descent lack global…

Machine Learning · Computer Science 2023-12-05 Xinyi Chen , Elad Hazan

This paper considers decentralized optimization with application to machine learning on graphs. The growing size of neural network (NN) models has motivated prior works on decentralized stochastic gradient algorithms to incorporate…

Optimization and Control · Mathematics 2021-10-12 Arjun Ashok Rao , Hoi-To Wai

Communication networks form the backbone of our society. Topology control algorithms optimize the topology of such communication networks. Due to the importance of communication networks, a topology control algorithm should guarantee…

Software Engineering · Computer Science 2018-05-10 Roland Kluge , Michael Stein , Gergely Varró , Andy Schürr , Matthias Hollick , Max Mühlhäuser

We propose a distributed algorithm for controlling traffic signals. Our algorithm is adapted from backpressure routing, which has been mainly applied to communication and power networks. We formally prove that our algorithm ensures global…

Systems and Control · Computer Science 2015-03-20 Tichakorn Wongpiromsarn , Tawit Uthaicharoenpong , Yu Wang , Emilio Frazzoli , Danwei Wang

The inherent approximation ability of neural networks plays an essential role in adaptive neural control, where the prerequisite for existence of the compact set is crucial in the control designs. Instead of using practical system state, in…

Systems and Control · Electrical Eng. & Systems 2025-05-01 Mingxuan Sun , Shengxiang Zou

This paper presents a distributed adaptive control strategy for multi-agent systems with heterogeneous dynamics and collision avoidance. We propose an adaptive control strategy designed to ensure leader-following formation consensus while…

Systems and Control · Electrical Eng. & Systems 2024-10-14 Armel Koulong , Ali Pakniyat

We study distributed optimization algorithms for minimizing the average of \emph{heterogeneous} functions distributed across several machines with a focus on communication efficiency. In such settings, naively using the classical stochastic…

Machine Learning · Computer Science 2020-11-18 Ilqar Ramazanli , Han Nguyen , Hai Pham , Sashank J. Reddi , Barnabas Poczos

We study a class of deep neural networks with networks that form a directed acyclic graph (DAG). For backpropagation defined by gradient descent with adaptive momentum, we show weights converge for a large class of nonlinear activation…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Chirag Agarwal , Joe Klobusicky , Dan Schonfeld

Adaptive control achieves concurrent parameter learning and stable control under uncertainties that are linearly parameterized with known nonlinear features. Nonetheless, it is often difficult to obtain such nonlinear features. To address…

Systems and Control · Electrical Eng. & Systems 2025-11-17 Sunbochen Tang , Haoyuan Sun , Navid Azizan

This paper presents convergence analysis of a novel data-driven feedback control algorithm designed for generating online controls based on partial noisy observational data. The algorithm comprises a particle filter-enabled state estimation…

Optimization and Control · Mathematics 2024-05-31 Siming Liang , Hui Sun , Richard Archibald , Feng Bao

We introduce a stochastic model that describes the quasi-static dynamics of an electric transmission network under perturbations introduced by random load fluctuations, random removing of system components from service, random repair times…

Physics and Society · Physics 2007-05-23 Marian Anghel , Kenneth A. Werley , Adilson E. Motter

Elastic structures can be designed to exhibit precise, complex, and exotic functions. While recent work has focused on the quasistatic limit governed by force balance, the mechanics at a finite driving rate are governed by Newton's…

Soft Condensed Matter · Physics 2024-12-17 Marc Berneman , Daniel Hexner