中文
相关论文

相关论文: Sample-Efficient Expert Query Control in Active Im…

200 篇论文

Offline Imitation Learning (IL) methods such as Behavior Cloning are effective at acquiring complex robotic manipulation skills. However, existing IL-trained policies are confined to executing the task at the same speed as shown in…

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

We introduce Correspondence-Oriented Imitation Learning (COIL), a conditional policy learning framework for visuomotor control with a flexible task representation in 3D. At the core of our approach, each task is defined by the intended…

机器人学 · 计算机科学 2025-12-08 Yunhao Cao , Zubin Bhaumik , Jessie Jia , Xingyi He , Kuan Fang

Imitation learning is often used in addition to reinforcement learning in environments where reward design is difficult or where the reward is sparse, but it is difficult to be able to imitate well in unknown states from a small amount of…

机器学习 · 计算机科学 2024-01-31 Ryoma Furuyama , Daiki Kuyoshi , Satoshi Yamane

Standard reinforcement learning (RL) algorithms assume that the observation of the next state comes instantaneously and at no cost. In a wide variety of sequential decision making tasks ranging from medical treatment to scientific…

人工智能 · 计算机科学 2020-05-27 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn

We introduce Information Condensing Active Learning (ICAL), a batch mode model agnostic Active Learning (AL) method targeted at Deep Bayesian Active Learning that focuses on acquiring labels for points which have as much information as…

机器学习 · 计算机科学 2020-02-21 Siddhartha Jain , Ge Liu , David Gifford

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

机器学习 · 计算机科学 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

The aim in imitation learning is to learn effective policies by utilizing near-optimal expert demonstrations. However, high-quality demonstrations from human experts can be expensive to obtain in large numbers. On the other hand, it is…

机器学习 · 计算机科学 2021-10-29 Mengjiao Yang , Sergey Levine , Ofir Nachum

Approaches for teaching learning agents via human demonstrations have been widely studied and successfully applied to multiple domains. However, the majority of imitation learning work utilizes only behavioral information from the…

Imitation learning practitioners have often noted that conditioning policies on previous actions leads to a dramatic divergence between "held out" error and performance of the learner in situ. Interactive approaches can provably address…

机器学习 · 计算机科学 2021-02-12 Jonathan Spencer , Sanjiban Choudhury , Arun Venkatraman , Brian Ziebart , J. Andrew Bagnell

Some imitation learning methods combine behavioural cloning with self-supervision to infer actions from state pairs. However, most rely on a large number of expert trajectories to increase generalisation and human intervention to capture…

机器学习 · 计算机科学 2024-07-23 Nathan Gavenski , Juarez Monteiro , Felipe Meneguzzi , Michael Luck , Odinaldo Rodrigues

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Imitation learning, in which learning is performed by demonstration, has been studied and advanced for sequential decision-making tasks in which a reward function is not predefined. However, imitation learning methods still require numerous…

机器学习 · 计算机科学 2024-01-24 Dahuin Jung , Hyungyu Lee , Sungroh Yoon

Recovering reward function from expert demonstrations is a fundamental problem in reinforcement learning. The recovered reward function captures the motivation of the expert. Agents can imitate experts by following these reward functions in…

机器学习 · 计算机科学 2024-06-27 Fan-Ming Luo , Xingchen Cao , Rong-Jun Qin , Yang Yu

Imitation learning (IL) enables autonomous behavior by learning from expert demonstrations. While more sample-efficient than comparative alternatives like reinforcement learning, IL is sensitive to compounding errors induced by distribution…

系统与控制 · 电气工程与系统科学 2025-12-22 Aditya Gahlawat , Ahmed Aboudonia , Sandeep Banik , Naira Hovakimyan , Nikolai Matni , Aaron D. Ames , Gioele Zardini , Alberto Speranzon

Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In…

机器学习 · 计算机科学 2021-12-14 Yang Liu , Yongzhe Chang , Shilei Jiang , Xueqian Wang , Bin Liang , Bo Yuan

Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. In previous work, to work…

机器学习 · 计算机科学 2024-08-27 Risto Vuorio , Pim de Haan , Johann Brehmer , Hanno Ackermann , Daniel Dijkman , Taco Cohen

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

最优化与控制 · 数学 2024-05-28 Zhongshi Sun , Guangyan Jia

Few-Shot Class-Incremental Learning has shown remarkable efficacy in efficient learning new concepts with limited annotations. Nevertheless, the heuristic few-shot annotations may not always cover the most informative samples, which largely…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Zitong Huang , Ze Chen , Yuanze Li , Bowen Dong , Erjin Zhou , Yong Liu , Rick Siow Mong Goh , Chun-Mei Feng , Wangmeng Zuo