English
Related papers

Related papers: Concurrent learning in high-order tuners for param…

200 papers

Gradient-descent based iterative algorithms pervade a variety of problems in estimation, prediction, learning, control, and optimization. Recently iterative algorithms based on higher-order information have been explored in an attempt to…

Machine Learning · Computer Science 2021-03-25 Spencer McDonald , Yingnan Cui , Joseph E. Gaudio , Anuradha M. Annaswamy

Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, momentum-based methods, with accelerated learning guarantees, have…

Machine Learning · Computer Science 2021-06-10 José M. Moreu , Anuradha M. Annaswamy

Concurrent learning is a recently developed adaptive update scheme that can be used to guarantee parameter convergence without requiring persistent excitation. However, this technique requires knowledge of state derivatives, which are…

Systems and Control · Computer Science 2021-07-07 Anup Parikh , Rushikesh Kamalapurkar , Warren E. Dixon

We consider two high-order tuners that have been shown to have accelerated performance, one based on Polyak's heavy ball method and another based on Nesterov's acceleration method. We show that parameter estimates are bounded and converge…

Optimization and Control · Mathematics 2022-09-15 Yingnan Cui , Anuradha M. Annaswamy

High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with…

Optimization and Control · Mathematics 2021-06-08 Joseph E. Gaudio , Anuradha M. Annaswamy , José M. Moreu , Michael A. Bolender , Travis E. Gibson

This paper demonstrates the applicability of the combination of concurrent learning as a tool for parameter estimation and non-parametric Gaussian Process for online disturbance learning. A control law is developed by using both techniques…

Systems and Control · Electrical Eng. & Systems 2021-06-03 Vedant Bhandari , Erkan Kayacan

In deterministic systems, reinforcement learning-based online approximate optimal control methods typically require a restrictive persistence of excitation (PE) condition for convergence. This paper presents a concurrent learning-based…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Patrick Walters , Warren Dixon

Recently, adaptive control systems with relaxed persistent excitation (PE) conditions have been proposed to guarantee true parameter convergence and improve the transient response. However, in some cases, sufficient control performance and…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Satoshi Tsuruhara , Kazuhisa Ito

This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying…

Optimization and Control · Mathematics 2023-03-21 Peter A. Fisher , Anuradha M. Annaswamy

Observer-based methods are widely used to estimate the disturbances of different dynamic systems. However, a drawback of the conventional disturbance observers is that they all assume persistent excitation (PE) of the systems. As a result,…

Systems and Control · Electrical Eng. & Systems 2023-06-07 Zengjie Zhang , Fangzhou Liu , Tong Liu , Jianbin Qiu , Martin Buss

Continual learning aims to incrementally acquire new concepts in data streams while resisting forgetting previous knowledge. With the rise of powerful pre-trained models (PTMs), there is a growing interest in training incremental learning…

Machine Learning · Computer Science 2024-11-05 Linglan Zhao , Xuerui Zhang , Ke Yan , Shouhong Ding , Weiran Huang

We propose a new discrete-time online parameter estimation algorithm that combines two different aspects, one that adds momentum, and another that includes a time-varying learning rate. It is well known that recursive least squares based…

Optimization and Control · Mathematics 2023-03-21 Yingnan Cui , Anuradha M. Annaswamy

We introduce a class of concurrent learning (CL) algorithms designed to solve parameter estimation problems with convergence rates ranging from hyperexponential to prescribed-time while utilizing alternating datasets during the learning…

Optimization and Control · Mathematics 2025-02-28 Daniel E. Ochoa , Jorge I. Poveda

This work presents a solution to the adaptive tracking control of Euler Lagrange systems with guaranteed tracking and parameter estimation error convergence. Specifically a concurrent learning based update rule fused by the filtered version…

Systems and Control · Electrical Eng. & Systems 2022-06-14 Erkan Zergeroglu , Enver Tatlicioglu , Serhat Obuz

This paper introduces an adaptive-neuro geometric control for a centralized multi-quadrotor cooperative transportation system, which enhances both adaptivity and disturbance rejection. Our strategy is to coactively tune the model parameters…

Systems and Control · Electrical Eng. & Systems 2025-09-03 Tianhua Gao , Kohji Tomita , Akiya Kamimura

A concurrent learning (CL)-based parameter estimator is developed to identify the unknown parameters in a linearly parameterized uncertain control-affine nonlinear system. Unlike state-of-the-art CL techniques that assume knowledge of the…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Ben Reish , Girish Chowdhary , Warren E. Dixon

This paper proposes a composite learning backstepping control (CLBC) strategy based on modular backstepping and high-order tuners to achieve closed-loop exponential stability without high-gain feedback and PE. A novel composite learning…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Tian Shi , Shihua Li , Changyun Wen , Yongping Pan

Stability of recurrent models is closely linked with trainability, generalizability and in some applications, safety. Methods that train stable recurrent neural networks, however, do so at a significant cost to expressibility. We propose an…

Machine Learning · Computer Science 2019-12-24 Max Revay , Ian R. Manchester

Penalized regression models are popularly used in high-dimensional data analysis to conduct variable selection and model fitting simultaneously. Whereas success has been widely reported in literature, their performances largely depend on…

Machine Learning · Statistics 2013-12-16 Wei Sun , Junhui Wang , Yixin Fang

This paper deals with the problem of finite-time learning for unknown discrete-time nonlinear systems' dynamics, without the requirement of the persistence of excitation. Two finite-time concurrent learning methods are presented to…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Farzaneh Tatari , Christos Panayiotou , Marios Polycarpou
‹ Prev 1 2 3 10 Next ›