English
Related papers

Related papers: Asking for Help: Failure Prediction in Behavioral …

200 papers

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

Artificial Intelligence · Computer Science 2024-06-10 Federico Malato , Ville Hautamaki

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions. When performing demonstrations, experts are not always consistent and might…

Machine Learning · Computer Science 2021-01-05 Sagar Gubbi Venkatesh , Nihesh Rathod , Shishir Kolathaya , Bharadwaj Amrutur

This study presents the first evaluation of general-purpose imitation learning for surgeon-robot collaborative assistance in open surgery, targeting suture following: the grab-pull-release motion an assistant performs at every stitch. We…

Robotics · Computer Science 2026-05-28 Xucheng Wang , Zhizhou Yang , Xiaoman Zhang , Sung Eun Kim , Romain Hardy , Pranav Rajpurkar

Behavioral cloning (BC) can recover a good policy from abundant expert data, but may fail when expert data is insufficient. This paper considers a situation where, besides the small amount of expert data, a supplementary dataset is…

Machine Learning · Computer Science 2023-01-30 Ziniu Li , Tian Xu , Yang Yu , Zhi-Quan Luo

Vision-language-action (VLA) models have advanced robot manipulation through large-scale pretraining, but real-world deployment remains challenging due to partial observability and delayed feedback. Reinforcement learning addresses this via…

Learning real-world robotic manipulation is challenging, particularly when limited demonstrations are available. Existing methods for few-shot manipulation often rely on simulation-augmented data or pre-built modules like grasping and pose…

Learning from Demonstrations (LfD) via Behavior Cloning (BC) works well on multiple complex tasks. However, a limitation of the typical LfD approach is that it requires expert demonstrations for all scenarios, including those in which the…

Robotics · Computer Science 2019-12-06 Jing Bi , Vikas Dhiman , Tianyou Xiao , Chenliang Xu

Relying on multi-modal observations, embodied robots (e.g., humanoid robots) could perform multiple robotic manipulation tasks in unstructured real-world environments. However, most language-conditioned behavior-cloning agents in robots…

Robotics · Computer Science 2025-12-30 Wenqi Liang , Gan Sun , Yao He , Yu Ren , Jiahua Dong , Yang Cong

Recent advances in robotic manipulation have integrated low-level robotic control into Vision-Language Models (VLMs), extending them into Vision-Language-Action (VLA) models. Although state-of-the-art VLAs achieve strong performance in…

Robotics · Computer Science 2025-10-28 Zijun Lin , Jiafei Duan , Haoquan Fang , Dieter Fox , Ranjay Krishna , Cheston Tan , Bihan Wen

While vision-language-action (VLA) models have shown great promise for robot manipulation, their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness. Standard…

Robotics · Computer Science 2026-03-18 Johannes Hechtl , Philipp Schmitt , Georg von Wichert , Wolfram Burgard

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

With the development of Embodied Artificial intelligence, the end-to-end control policy such as Vision-Language-Action (VLA) model has become the mainstream. Existing VLA models faces expensive computing/storage cost, which need to be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Feng Jiang , Zihao Zheng , Xiuping Cui , Maoliang Li , JIayu Chen , Xiang Chen

Imitation learning suffers from causal confusion. This phenomenon occurs when learned policies attend to features that do not causally influence the expert actions but are instead spuriously correlated. Causally confused agents produce low…

Machine Learning · Computer Science 2023-08-14 Samuel Pfrommer , Yatong Bai , Hyunin Lee , Somayeh Sojoudi

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

Machine Learning · Computer Science 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

The performance of learned robot visuomotor policies is heavily dependent on the size and quality of the training dataset. Although large-scale robot and human datasets are increasingly available, embodiment gaps and mismatched action…

Robotics · Computer Science 2026-03-24 Yiqi Wang , Mrinal Verghese , Jeff Schneider

General-purpose robots coexisting with humans in their environment must learn to relate human language to their perceptions and actions to be useful in a range of daily tasks. Moreover, they need to acquire a diverse repertoire of…

Robotics · Computer Science 2022-07-14 Oier Mees , Lukas Hermann , Erick Rosete-Beas , Wolfram Burgard

Teleoperation of high-precision manipulation is con-strained by tight success tolerances and complex contact dy-namics, which make impending failures difficult for human operators to anticipate under partial observability. This paper…

Vision-Language-Action (VLA) models have become a cornerstone in robotic policy learning, leveraging large-scale multimodal data for robust and scalable control. However, existing VLA frameworks primarily address short-horizon tasks, and…