English
Related papers

Related papers: History-Aware Visuomotor Policy Learning via Point…

200 papers

Visual attention, derived from cognitive neuroscience, facilitates human perception on the most pertinent subset of the sensory data. Recently, significant efforts have been made to exploit attention schemes to advance computer vision…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Shi Pu , Yibing Song , Chao Ma , Honggang Zhang , Ming-Hsuan Yang

Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Tianyu Yang , Antoni B. Chan

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) methods scale to long…

Robotics · Computer Science 2021-12-08 Michael James McDonald , Dylan Hadfield-Menell

In everyday life collaboration tasks between human operators and robots, the former necessitate simple ways for programming new skills, the latter have to show adaptive capabilities to cope with environmental changes. The joint use of…

Robotics · Computer Science 2023-09-15 Rocco Felici , Matteo Saveriano , Loris Roveda , Antonio Paolillo

This paper proposes a life-long adaptive path tracking policy learning method for autonomous vehicles that can self-evolve and self-adapt with multi-task knowledge. Firstly, the proposed method can learn a model-free control policy for path…

Robotics · Computer Science 2021-09-16 Cheng Gong , Jianwei Gong , Chao Lu , Zhe Liu , Zirui Li

This paper is on long-term video understanding where the goal is to recognise human actions over long temporal windows (up to minutes long). In prior work, long temporal context is captured by constructing a long-term memory bank consisting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Ioanna Ntinou , Enrique Sanchez , Georgios Tzimiropoulos

Search missions require motion planning and navigation methods for information gathering that continuously replan based on new observations of the robot's surroundings. Current methods for information gathering, such as Monte Carlo Tree…

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

We propose a new visual hierarchical representation paradigm for multi-object tracking. It is more effective to discriminate between objects by attending to objects' compositional visual regions and contrasting with the background…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jinkun Cao , Jiangmiao Pang , Kris Kitani

Image-goal navigation is a challenging task that requires an agent to navigate to a goal indicated by an image in unfamiliar environments. Existing methods utilizing diverse scene memories suffer from inefficient exploration since they use…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hongxin Li , Zeyu Wang , Xu Yang , Yuran Yang , Shuqi Mei , Zhaoxiang Zhang

Long-horizon planning for robot manipulation is a challenging problem that requires reasoning about the effects of a sequence of actions on a physical 3D scene. While traditional task planning methods are shown to be effective for…

Robotics · Computer Science 2025-09-08 Kallol Saha , Amber Li , Angela Rodriguez-Izquierdo , Lifan Yu , Ben Eisner , Maxim Likhachev , David Held

Humans routinely rely on memory to perform tasks, yet most robot policies lack this capability; our goal is to endow robot policies with the same ability. Naively conditioning on long observation histories is computationally expensive and…

Robotics · Computer Science 2025-10-24 Ajay Sridhar , Jennifer Pan , Satvik Sharma , Chelsea Finn

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional,…

Machine Learning · Computer Science 2015-09-24 Marvin Zhang , Zoe McCarthy , Chelsea Finn , Sergey Levine , Pieter Abbeel

Memory is critical for long-horizon and history-dependent robotic manipulation. Such tasks often involve counting repeated actions or manipulating objects that become temporarily occluded. Recent vision-language-action (VLA) models have…

Robotics · Computer Science 2026-05-27 Yinpei Dai , Hongze Fu , Jayjun Lee , Yuejiang Liu , Haoran Zhang , Jianing Yang , Chelsea Finn , Nima Fazeli , Joyce Chai

Imitation learning is a widely used policy learning method that enables intelligent agents to acquire complex skills from expert demonstrations. The input to the imitation learning algorithm is usually composed of both the current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chia-Chi Chuang , Donglin Yang , Chuan Wen , Yang Gao

This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person. The sub-tasks…

Robotics · Computer Science 2022-03-09 Junchi Liang , Bowen Wen , Kostas Bekris , Abdeslam Boularias

Reinforcementlearning(RL)folkloresuggeststhathistory-basedfunctionapproximationmethods,suchas recurrent neural nets or history-based state abstraction, perform better than their memory-less counterparts, due to the fact that function…

Machine Learning · Computer Science 2022-11-08 Gandharv Patil , Aditya Mahajan , Doina Precup

Visual place recognition needs to be robust against appearance variability due to natural and man-made causes. Training data collection should thus be an ongoing process to allow continuous appearance changes to be recorded. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Anh-Dzung Doan , Yasir Latif , Tat-Jun Chin , Ian Reid

Conventional visuomotor imitation learning usually predicts future robot actions directly in the time domain. Such formulations often have limited physical scene awareness and weak long-horizon memory. In contrast, world-model-based…

Robotics · Computer Science 2026-05-12 Changchuan Yang , Yuhang Dong , Guanzhong Tian , Haizhou Ge , Hongrui Zhu

A robot operating in a household makes observations of multiple objects as it moves around over the course of days or weeks. The objects may be moved by inhabitants, but not completely at random. The robot may be called upon later to…

Machine Learning · Computer Science 2022-08-02 Yilun Du , Tomas Lozano-Perez , Leslie Kaelbling