English
Related papers

Related papers: Memory Augmented Neural Network Adaptive Controlle…

200 papers

This work presents a solution to the adaptive tracking control of Euler Lagrange systems with guaranteed tracking and parameter estimation error convergence. Specifically a concurrent learning based update rule fused by the filtered version…

Systems and Control · Electrical Eng. & Systems 2022-06-14 Erkan Zergeroglu , Enver Tatlicioglu , Serhat Obuz

To be effective in sequential data processing, Recurrent Neural Networks (RNNs) are required to keep track of past events by creating memories. While the relation between memories and the network's hidden state dynamics was established over…

Machine Learning · Computer Science 2019-09-17 Doron Haviv , Alexander Rivkind , Omri Barak

Robots and automated systems are increasingly being introduced to unknown and dynamic environments where they are required to handle disturbances, unmodeled dynamics, and parametric uncertainties. Robust and adaptive control strategies are…

Robotics · Computer Science 2018-08-03 Karime Pereida , Angela Schoellig

Existing Continual Learning (CL) approaches have focused on addressing catastrophic forgetting by leveraging regularization methods, replay buffers, and task-specific components. However, realistic CL solutions must be shaped not only by…

Machine Learning · Computer Science 2023-10-11 Jinyung Hong , Theodore P. Pavlic

Popular approaches for minimizing loss in data-driven learning often involve an abstraction or an explicit retention of the history of gradients for efficient parameter updates. The aggregated history of gradients nudges the parameter…

Machine Learning · Computer Science 2021-06-22 Paul-Aymeric McRae , Prasanna Parthasarathi , Mahmoud Assran , Sarath Chandar

Investment decisions can benefit from incorporating an accumulated knowledge of the past to drive future decision making. We introduce Continual Learning Augmentation (CLA) which is based on an explicit memory structure and a feed forward…

Machine Learning · Computer Science 2019-01-28 Daniel Philps , Tillman Weyde , Artur d'Avila Garcez , Roy Batchelor

We present a structured neural network architecture that is inspired by linear time-varying dynamical systems. The network is designed to mimic the properties of linear dynamical systems which makes analysis and control simple. The…

Robotics · Computer Science 2018-08-06 Alexander Broad , Ian Abraham , Todd Murphey , Brenna Argall

Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to…

Neural networks have proven practical for a synergistic combination of advanced control techniques. This work analyzes the implementation of rectified linear unit neural networks to achieve constrained control in differentially flat…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Huu-Thinh Do , Ionela Prodan , Florin Stoican

Abstraction-based techniques are an attractive approach for synthesizing correct-by-construction controllers to satisfy high-level temporal requirements. A main bottleneck for successful application of these techniques is the memory…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Rupak Majumdar , Mahmoud Salamati , Sadegh Soudjani

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

This paper proposes an adaptive neural-compilation framework to address the problem of efficient program learning. Traditional code optimisation strategies used in compilers are based on applying pre-specified set of transformations that…

Artificial Intelligence · Computer Science 2016-05-27 Rudy Bunel , Alban Desmaison , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Modern automation systems rely on closed loop control, wherein a controller interacts with a controlled process, based on observations. These systems are increasingly complex, yet most controllers are linear Proportional-Integral-Derivative…

Machine Learning · Computer Science 2021-01-27 Johannes Günther , Elias Reichensdörfer , Patrick M. Pilarski , Klaus Diepold

Motor adaptation displays a structure-learning effect: adaptation to a new perturbation occurs more quickly when the subject has prior exposure to perturbations with related structure. Although this `learning-to-learn' effect is well…

Artificial Intelligence · Computer Science 2017-07-14 Ari Weinstein , Matthew M. Botvinick

Model Predictive Control (MPC) is a method to control nonlinear systems with guaranteed stability and constraint satisfaction but suffers from high computation times. Approximate MPC (AMPC) with neural networks (NNs) has emerged to address…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Henrik Hose , Alexander Gräfe , Sebastian Trimpe

The article sets and solves the task to control an error of the artificial neural network with variable signal conductivity. This kind of neural networks was especially developed to construct timetables. Behavior of such a neural network…

Optimization and Control · Mathematics 2016-08-17 Alexander Ignatenkov , Alexey Olshansky

Adapter-based tuning has recently arisen as an alternative to fine-tuning. It works by adding light-weight adapter modules to a pretrained language model (PrLM) and only updating the parameters of adapter modules when learning on a…

Computation and Language · Computer Science 2021-06-08 Ruidan He , Linlin Liu , Hai Ye , Qingyu Tan , Bosheng Ding , Liying Cheng , Jia-Wei Low , Lidong Bing , Luo Si

We present a new neuroadaptive architecture: Deep Neural Network based Model Reference Adaptive Control (DMRAC). Our architecture utilizes the power of deep neural network representations for modeling significant nonlinearities while…

Machine Learning · Computer Science 2019-09-19 Girish Joshi , Girish Chowdhary

Optimal control provides a principled framework for transforming dynamical system models into intelligent decision-making, yet classical computational approaches are often too expensive for real-time deployment in dynamic or uncertain…

Optimization and Control · Mathematics 2026-01-01 Wuzhe Xu , Jiequn Han , Rongjie Lai