English
Related papers

Related papers: Reactive Long Horizon Task Execution via Visual Sk…

200 papers

Efficient control in long-horizon robotic manipulation is challenging due to complex representation and policy learning requirements. Model-based visual reinforcement learning (RL) has shown great potential in addressing these challenges…

Robotics · Computer Science 2025-01-27 Zixuan Chen , Jing Huo , Yangtao Chen , Yang Gao

Modern reinforcement learning (RL) systems capture deep truths about general, human problem-solving. In domains where new data can be simulated cheaply, these systems uncover sequential decision-making policies that far exceed the ability…

Machine Learning · Computer Science 2025-10-07 Scott Jeen

Zero-shot sim-to-real transfer of tasks with complex dynamics is a highly challenging and unsolved problem. A number of solutions have been proposed in recent years, but we have found that many works do not present a thorough evaluation in…

Robotics · Computer Science 2020-08-18 Eugene Valassakis , Zihan Ding , Edward Johns

Visual imitation learning enables robotic agents to acquire skills by observing expert demonstration videos. In the one-shot setting, the agent generates a policy after observing a single expert demonstration without additional fine-tuning.…

Robotics · Computer Science 2026-01-01 Raktim Gautam Goswami , Prashanth Krishnamurthy , Yann LeCun , Farshad Khorrami

Can we learn robot manipulation for everyday tasks, only by watching videos of humans doing arbitrary tasks in different unstructured settings? Unlike widely adopted strategies of learning task-specific behaviors or direct imitation of a…

Robotics · Computer Science 2023-02-07 Homanga Bharadhwaj , Abhinav Gupta , Shubham Tulsiani , Vikash Kumar

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

Machine Learning · Computer Science 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

Imitation learning has been commonly applied to solve different tasks in isolation. This usually requires either careful feature engineering, or a significant number of samples. This is far from what we desire: ideally, robots should be…

Artificial Intelligence · Computer Science 2017-12-06 Yan Duan , Marcin Andrychowicz , Bradly C. Stadie , Jonathan Ho , Jonas Schneider , Ilya Sutskever , Pieter Abbeel , Wojciech Zaremba

Modern paradigms for robot imitation train expressive policy architectures on large amounts of human demonstration data. Yet performance on contact-rich, deformable-object, and long-horizon tasks plateau far below perfect execution, even…

Robotics · Computer Science 2025-09-10 Zheyuan Hu , Robyn Wu , Naveen Enock , Jasmine Li , Riya Kadakia , Zackory Erickson , Aviral Kumar

General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured environments. While Vision-Language-Action (VLA) models…

Robotics · Computer Science 2026-02-26 Yue Yang , Shuo Cheng , Yu Fang , Homanga Bharadhwaj , Mingyu Ding , Gedas Bertasius , Daniel Szafir

Imitation learning enables intelligent systems to acquire complex behaviors with minimal supervision. However, existing methods often focus on short-horizon skills, require large datasets, and struggle to solve long-horizon tasks or…

Robotics · Computer Science 2025-09-01 Pierrick Lorang , Hong Lu , Johannes Huemer , Patrik Zips , Matthias Scheutz

Long-horizon tasks, usually characterized by complex subtask dependencies, present a significant challenge in manipulation planning. Skill chaining is a practical approach to solving unseen tasks by combining learned skill priors. However,…

Robotics · Computer Science 2024-01-09 Utkarsh A. Mishra , Shangjie Xue , Yongxin Chen , Danfei Xu

The growing interest in language-conditioned robot manipulation aims to develop robots capable of understanding and executing complex tasks, with the objective of enabling robots to interpret language commands and manipulate objects…

Robotics · Computer Science 2024-09-13 Hongkuan Zhou , Zhenshan Bing , Xiangtong Yao , Xiaojie Su , Chenguang Yang , Kai Huang , Alois Knoll

Robotic manipulation policies often degrade over extended horizons, yet existing benchmarks provide limited insight into why such failures occur. Most prior benchmarks are either simulation-based or report aggregate success, making it…

Robotics · Computer Science 2026-04-21 Xueyao Chen , Jingkai Jia , Tong Yang , Yibo Fu , Wei Li , Wenqiang Zhang

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

A generalist robot must be able to complete a variety of tasks in its environment. One appealing way to specify each task is in terms of a goal observation. However, learning goal-reaching policies with reinforcement learning remains a…

Machine Learning · Computer Science 2021-01-01 Stephen Tian , Suraj Nair , Frederik Ebert , Sudeep Dasari , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Through many recent successes in simulation, model-free reinforcement learning has emerged as a promising approach to solving continuous control robotic tasks. The research community is now able to reproduce, analyze and build quickly on…

Machine Learning · Computer Science 2018-09-21 A. Rupam Mahmood , Dmytro Korenkevych , Gautham Vasan , William Ma , James Bergstra

Imitation learning from human demonstrations is a promising paradigm for teaching robots manipulation skills in the real world. However, learning complex long-horizon tasks often requires an unattainable amount of demonstrations. To reduce…

Robotics · Computer Science 2023-10-16 Chen Wang , Linxi Fan , Jiankai Sun , Ruohan Zhang , Li Fei-Fei , Danfei Xu , Yuke Zhu , Anima Anandkumar

Execution monitor of high-level robot actions can be effectively improved by visual monitoring the state of the world in terms of preconditions and postconditions that hold before and after the execution of an action. Furthermore a policy…

Artificial Intelligence · Computer Science 2017-10-02 Francesco Puja , Simone Grazioso , Antonio Tammaro , Valsmis Ntouskos , Marta Sanzari , Fiora Pirri

Large real-world robot datasets hold great potential to train generalist robot models, but scaling real-world human data collection is time-consuming and resource-intensive. Simulation has great potential in supplementing large-scale data,…

One-shot imitation is to learn a new task from a single demonstration, yet it is a challenging problem to adopt it for complex tasks with the high domain diversity inherent in a non-stationary environment. To tackle the problem, we explore…

Artificial Intelligence · Computer Science 2024-02-14 Sangwoo Shin , Daehee Lee , Minjong Yoo , Woo Kyung Kim , Honguk Woo