中文
相关论文

相关论文: Value from Observations: Towards Large-Scale Imita…

200 篇论文

This paper studies Learning from Observations (LfO) for imitation learning with access to state-only demonstrations. In contrast to Learning from Demonstration (LfD) that involves both action and state supervision, LfO is more practical in…

机器学习 · 计算机科学 2019-11-19 Chao Yang , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu , Junzhou Huang , Chuang Gan

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

机器学习 · 计算机科学 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

机器学习 · 计算机科学 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Observational learning requires an agent to learn to perform a task by referencing only observations of the performed task. This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and…

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

机器学习 · 计算机科学 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

Despite its promise, imitation learning often fails in long-horizon environments where perfect replication of demonstrations is unrealistic and small errors can accumulate catastrophically. We introduce Cago (Capability-Aware Goal…

人工智能 · 计算机科学 2026-01-14 Yuanlin Duan , Yuning Wang , Wenjie Qiu , He Zhu

Learning from demonstration is widely used as an efficient way for robots to acquire new skills. However, it typically requires that demonstrations provide full access to the state and action sequences. In contrast, learning from…

机器学习 · 计算机科学 2020-08-05 Zachary W. Robertson , Matthew R. Walter

Imitation learning from observation (LfO) is more preferable than imitation learning from demonstration (LfD) due to the nonnecessity of expert actions when reconstructing the expert policy from the expert data. However, previous studies…

机器人学 · 计算机科学 2020-10-19 Zhihao Cheng , Liu Liu , Aishan Liu , Hao Sun , Meng Fang , Dacheng Tao

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

机器学习 · 计算机科学 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Imitation Learning (IL) is an appealing approach to learn desirable autonomous behavior. However, directing IL to achieve arbitrary goals is difficult. In contrast, planning-based algorithms use dynamics models and reward functions to…

机器学习 · 计算机科学 2019-10-02 Nicholas Rhinehart , Rowan McAllister , Sergey Levine

Imitation learning frameworks that learn robot control policies from demonstrators' motions via hand-mounted demonstration interfaces have attracted increasing attention. However, due to differences in physical characteristics between…

机器人学 · 计算机科学 2026-02-18 Kei Takahashi , Hikaru Sasaki , Takamitsu Matsubara

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

机器学习 · 计算机科学 2021-03-11 Zhangjie Cao , Dorsa Sadigh

Offline reinforcement learning (RL) learns effective policies from pre-collected datasets, offering a practical solution for applications where online interactions are risky or costly. Model-based approaches are particularly advantageous…

机器学习 · 计算机科学 2026-05-14 Xuyang Chen , Keyu Yan , Guojian Wang , Lin Zhao

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

机器人学 · 计算机科学 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

Inverse reinforcement learning (IRL), which infers reward functions from demonstrations, is a valuable tool for modeling and understanding decision-making behavior. Many variants of IRL have been developed to capture complexities of human…

机器学习 · 计算机科学 2026-05-14 Leo Benac , Abhishek Sharma , Alihan Huyuk , Finale Doshi-Velez

In this work we formulate and treat an extension of the Imitation from Observations problem. Imitation from Observations is a generalisation of the well-known Imitation Learning problem where state-only demonstrations are considered. In our…

系统与控制 · 电气工程与系统科学 2022-10-11 Tom Lefebvre