中文
相关论文

相关论文: SPRINQL: Sub-optimal Demonstrations driven Offline…

200 篇论文

Automatic laparoscope motion control is fundamentally important for surgeons to efficiently perform operations. However, its traditional control methods based on tool tracking without considering information hidden in surgical scenes are…

机器人学 · 计算机科学 2022-04-08 Bin Li , Ruofeng Wei , Jiaqi Xu , Bo Lu , Chi-Hang Yee , Chi-Fai Ng , Pheng-Ann Heng , Qi Dou , Yun-Hui Liu

Inverse reinforcement learning (IRL) aims to recover the reward function of an expert agent from demonstrations of behavior. It is well-known that the IRL problem is fundamentally ill-posed, i.e., many reward functions can explain the…

机器学习 · 计算机科学 2024-06-07 Filippo Lazzati , Mirco Mutti , Alberto Maria Metelli

The transformation towards intelligence in various industries is creating more demand for intelligent and flexible products. In the field of robotics, learning-based methods are increasingly being applied, with the purpose of training…

机器人学 · 计算机科学 2022-09-09 Xinjie Liu

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement learning (RL) in…

机器学习 · 计算机科学 2022-12-08 Chao Li

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

机器学习 · 计算机科学 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

机器人学 · 计算机科学 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

机器学习 · 计算机科学 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

Online imitation learning (IL) is an algorithmic framework that leverages interactions with expert policies for efficient policy optimization. Here policies are optimized by performing online learning on a sequence of loss functions that…

机器学习 · 计算机科学 2021-02-23 Xinyan Yan , Byron Boots , Ching-An Cheng

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Inverse Reinforcement Learning (IRL) is a powerful set of techniques for imitation learning that aims to learn a reward function that rationalizes expert demonstrations. Unfortunately, traditional IRL methods suffer from a computational…

机器学习 · 计算机科学 2024-01-31 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Imitation learning (IL) provides a data-driven framework for approximating policies for large-scale combinatorial optimisation problems formulated as sequential decision problems (SDPs), where exact solution methods are computationally…

机器学习 · 计算机科学 2026-04-13 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

Learning from datasets without interaction with environments (Offline Learning) is an essential step to apply Reinforcement Learning (RL) algorithms in real-world scenarios. However, compared with the single-agent counterpart, offline…

人工智能 · 计算机科学 2021-10-27 Yiqin Yang , Xiaoteng Ma , Chenghao Li , Zewu Zheng , Qiyuan Zhang , Gao Huang , Jun Yang , Qianchuan Zhao

Existing offline in-context reinforcement learning (ICRL) methods have predominantly relied on supervised training objectives, which are known to have limitations in offline RL settings. In this study, we explore the integration of RL…

We are interested in solving the problem of imitation learning with a limited amount of real-world expert data. Existing offline imitation methods often struggle with poor data coverage and severe performance degradation. We propose a…

机器人学 · 计算机科学 2025-10-06 Yilin Wang , Shangzhe Li , Haoyi Niu , Zhiao Huang , Weitong Zhang , Hao Su

Imitation learning (IL) consists of a set of tools that leverage expert demonstrations to quickly learn policies. However, if the expert is suboptimal, IL can yield policies with inferior performance compared to reinforcement learning (RL).…

机器学习 · 计算机科学 2018-05-29 Ching-An Cheng , Xinyan Yan , Nolan Wagener , Byron Boots

Recent advances in imitative reinforcement learning (IRL) have considerably enhanced the ability of autonomous agents to assimilate expert demonstrations, leading to rapid skill acquisition in a range of demanding tasks. However, such…

机器人学 · 计算机科学 2025-06-26 Hang Zhou , Yihao Qin , Dan Xu , Yiding Ji

Learning robust driving policies from large-scale, real-world datasets is a central challenge in autonomous driving, as online data collection is often unsafe and impractical. While Behavioral Cloning (BC) offers a straightforward approach…

机器学习 · 计算机科学 2025-08-28 Antonio Guillen-Perez

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

机器学习 · 计算机科学 2026-02-02 Shi Bo , AmirEmad Ghassami

Offline reinforcement learning (RL) presents a promising approach for learning reinforced policies from offline datasets without the need for costly or unsafe interactions with the environment. However, datasets collected by humans in…

机器学习 · 计算机科学 2024-03-12 Rui Yang , Han Zhong , Jiawei Xu , Amy Zhang , Chongjie Zhang , Lei Han , Tong Zhang

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

机器学习 · 计算机科学 2021-02-12 Mengjiao Yang , Ofir Nachum