English

On the Role of Models in Learning Control: Actor-Critic Iterative Learning Control

Systems and Control 2020-07-06 v2 Systems and Control

Abstract

Learning from data of past tasks can substantially improve the accuracy of mechatronic systems. Often, for fast and safe learning a model of the system is required. The aim of this paper is to develop a model-free approach for fast and safe learning for mechatronic systems. The developed actor-critic iterative learning control (ACILC) framework uses a feedforward parameterization with basis functions. These basis functions encode implicit model knowledge and the actor-critic algorithm learns the feedforward parameters without explicitly using a model. Experimental results on a printer setup demonstrate that the developed ACILC framework is capable of achieving the same feedforward signal as preexisting model-based methods without using explicit model knowledge.

Keywords

Cite

@article{arxiv.2007.00430,
  title  = {On the Role of Models in Learning Control: Actor-Critic Iterative Learning Control},
  author = {Maurice Poot and Jim Portegies and Tom Oomen},
  journal= {arXiv preprint arXiv:2007.00430},
  year   = {2020}
}

Comments

6 pages, 4 figures, 21st IFAC World Congress 2020

R2 v1 2026-06-23T16:46:03.789Z