中文
相关论文

相关论文: On the Role of Models in Learning Control: Actor-C…

200 篇论文

Curriculum learning and imitation learning have been leveraged extensively in the robotics domain. However, minimal research has been done on leveraging these ideas on control tasks over highly stochastic time-series data. Here, we…

机器学习 · 计算机科学 2024-01-17 Woosung Koh , Insu Choi , Yuntae Jang , Gimin Kang , Woo Chang Kim

Packet dropouts in control systems poses a critical challenge, as it can significantly compromise system performance and stability. In these conditions, classical controllers often struggle to deliver effective control, as they rely on…

系统与控制 · 电气工程与系统科学 2026-05-29 Kianoush Aqabakee , Kosar Behnia , Amirhossein Heydarian Ardakani , Farzaneh Abdollahi , Elham Shirazi

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

机器人学 · 计算机科学 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples. Our framework is motivated by actor-critic reinforcement learning, but can be applied to both reinforcement and supervised learning.…

机器学习 · 计算机科学 2017-06-30 Flood Sung , Li Zhang , Tao Xiang , Timothy Hospedales , Yongxin Yang

Iterative learning control (ILC) is a powerful technique for high performance tracking in the presence of modeling errors for optimal control applications. There is extensive prior work showing its empirical effectiveness in applications…

机器人学 · 计算机科学 2021-12-10 Anirudh Vemula , Wen Sun , Maxim Likhachev , J. Andrew Bagnell

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

机器人学 · 计算机科学 2025-02-28 Cong Li

The sudden onset of deleterious and oscillatory dynamics (often called instabilities) is a known challenge in many fluid, plasma, and aerospace systems. These dynamics are difficult to address because they are nonlinear, chaotic, and are…

机器学习 · 计算机科学 2024-05-31 John W. Brooks , Christine M. Greve

Solving motion tasks autonomously and accurately is a core ability for intelligent real-world systems. To achieve genuine autonomy across multiple systems and tasks, key challenges include coping with unknown dynamics and overcoming the…

系统与控制 · 电气工程与系统科学 2025-09-24 Jan-Hendrik Ewering , Alessandro Papa , Simon F. G. Ehlers , Thomas Seel , Michael Meindl

This study presents an Actor-Critic Cooperative Compensated Model Predictive Controller (AC3MPC) designed to address unknown system dynamics. To avoid the difficulty of modeling highly complex dynamics and ensuring realtime control…

机器人学 · 计算机科学 2026-01-27 Prakhar Gupta , Jonathon M Smereka , Yunyi Jia

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

最优化与控制 · 数学 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Model-based compression is an effective, facilitating, and expanded model of neural network models with limited computing and low power. However, conventional models of compression techniques utilize crafted features [2,3,12] and explore…

机器学习 · 统计学 2018-07-10 Hamed Hakkak

Traditionally, reinforcement learning methods predict the next action based on the current state. However, in many situations, directly applying actions to control systems or robots is dangerous and may lead to unexpected behaviors because…

机器人学 · 计算机科学 2020-11-03 Nan Lin , Yuxuan Li , Yujun Zhu , Ruolin Wang , Xiayu Zhang , Jianmin Ji , Keke Tang , Xiaoping Chen , Xinming Zhang

A key open challenge in agile quadrotor flight is how to combine the flexibility and task-level generality of model-free reinforcement learning (RL) with the structure and online replanning capabilities of model predictive control (MPC),…

机器人学 · 计算机科学 2026-01-21 Angel Romero , Elie Aljalbout , Yunlong Song , Davide Scaramuzza

In the literature, actor-critic model predictive control (AC-MPC) integrates MPC with reinforcement learning to enable high-performance control of complex dynamical systems. However, its differentiable MPC layer requires repeatedly solving…

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

机器人学 · 计算机科学 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

In-context learning (ICL) allows some autoregressive models to solve tasks via next-token prediction and without needing further training. This has led to claims about these model's ability to solve (learn) unseen tasks with only a few…

计算与语言 · 计算机科学 2026-02-12 Adrian de Wynter

A robust Learning Model Predictive Controller (LMPC) for uncertain systems performing iterative tasks is presented. At each iteration of the control task the closed-loop state, input and cost are stored and used in the controller design.…

系统与控制 · 电气工程与系统科学 2021-07-06 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

Iterative Learning Control (ILC) enables high control performance through learning from measured data, using only limited model knowledge in the form of a nominal parametric model. Robust stability requires robustness to modeling errors,…

系统与控制 · 计算机科学 2020-03-30 Lennart Blanken , Tom Oomen

The advances in unsupervised object-centric representation learning have significantly improved its application to downstream tasks. Recent works highlight that disentangled object representations can aid policy learning in image-based,…

人工智能 · 计算机科学 2025-03-21 Leonid Ugadiarov , Vitaliy Vorobyov , Aleksandr I. Panov