中文
相关论文

相关论文: On the Role of Models in Learning Control: Actor-C…

200 篇论文

This paper introduces a novel model-free and a partially model-free algorithm for inverse optimal control (IOC), also known as inverse reinforcement learning (IRL), aimed at estimating the cost function of continuous-time nonlinear…

系统与控制 · 电气工程与系统科学 2025-03-20 Hamed Jabbari Asl , Eiji Uchibe

This paper presents an iterative learning control (ILC) scheme for continuously operated repetitive systems for which no initial condition reset exists. To accomplish this, we develop a lifted system representation that accounts for the…

系统与控制 · 电气工程与系统科学 2021-08-17 Maxwell Wu , Mitchell Cobb , James Reed , Kirti Mishra , Chris Vermillion , Kira Barton

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

机器学习 · 计算机科学 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

机器学习 · 计算机科学 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth

This article focuses on making discrete-time Adaptive Iterative Learning Control (ILC) more effective using multiple estimation models. Existing strategies use the tracking error to adjust the parametric estimates. Our strategy uses the…

系统与控制 · 电气工程与系统科学 2024-06-14 Ram Padmanabhan , Rajini Makam , Koshy George

Deciding what and when to observe is critical when making observations is costly. In a medical setting where observations can be made sequentially, making these observations (or not) should be an active choice. We refer to this as the…

机器学习 · 计算机科学 2019-06-18 Jinsung Yoon , James Jordon , Mihaela van der Schaar

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

机器学习 · 计算机科学 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

A comprehensive approach addressing identification and control for learningbased Model Predictive Control (MPC) for linear systems is presented. The design technique yields a data-driven MPC law, based on a dataset collected from the…

系统与控制 · 计算机科学 2018-10-31 Enrico Terzi , Lorenzo Fagiano , Marcello Farina , Riccardo Scattolini

This paper states that Model-Free Control (MFC), which must not be confused with Model-Free Reinforcement Learning, is a new tool for Machine Learning (ML). MFC is easy to implement and should be substituted in control engineering to ML via…

系统与控制 · 电气工程与系统科学 2020-12-11 Michel Fliess , Cédric Join

Reinforcement Learning (RL) and its integration with deep learning have achieved impressive performance in various robotic control tasks, ranging from motion planning and navigation to end-to-end visual manipulation. However, stability is…

机器人学 · 计算机科学 2020-07-16 Minghao Han , Lixian Zhang , Jun Wang , Wei Pan

We introduce a model that learns active learning algorithms via metalearning. For a distribution of related tasks, our model jointly learns: a data representation, an item selection heuristic, and a method for constructing prediction…

机器学习 · 计算机科学 2017-08-02 Philip Bachman , Alessandro Sordoni , Adam Trischler

This paper proposes a robust control strategy that integrates Iterative Learning Control (ILC) with a simple lateral neural network to enhance the trajectory tracking performance of a linear Lorentz force actuator under friction and model…

系统与控制 · 电气工程与系统科学 2025-11-18 Ali Mashhadireza , Ali Sadighi

Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to…

机器学习 · 计算机科学 2021-12-02 Chayan Banerjee , Zhiyong Chen , Nasimul Noman , Mohsen Zamani

In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…

系统与控制 · 电气工程与系统科学 2023-02-07 Mohammed I. Abouheaf , Hashim A. Hashim , Mohammad A. Mayyas , Kyriakos G. Vamvoudakis

LLMs have shown strong in-context learning (ICL) abilities, but have not yet been extended to signal processing systems. Inspired by their design, we have proposed for the first time ICL using transformer models applicable to motor…

机器学习 · 计算机科学 2026-02-10 Tong Jian , Tianyu Dai , Tao Yu

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

系统与控制 · 电气工程与系统科学 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

机器人学 · 计算机科学 2022-12-07 Jacob Sacks , Byron Boots

With the increasing penetration of renewable energy sources, growing demand variability, and evolving grid control strategies, accurate and efficient load modeling has become a critical yet challenging task. Traditional methods, such as…

系统与控制 · 电气工程与系统科学 2025-03-11 Ding Lin , Han Guo , Jianhui Wang , Meng Yue , Tianqiao Zhao

Force interaction is inevitable when robots face multiple operation scenarios. How to make the robot competent in force control for generalized operations such as multi-tasks still remains a challenging problem. Aiming at the…

机器人学 · 计算机科学 2024-03-26 Bo Zhou , Yuyao Sun , Wenbo Liu , Ruixuan Jiao , Fang Fang , Shihua Li

Rapid development of large-scale pre-training has resulted in foundation models that can act as effective feature extractors on a variety of downstream tasks and domains. Motivated by this, we study the efficacy of pre-trained vision models…