English
Related papers

Related papers: History-Aware Visuomotor Policy Learning via Point…

200 papers

In the face of difficult exploration problems in reinforcement learning, we study whether giving an agent an object-centric mapping (describing a set of items and their attributes) allow for more efficient learning. We found this problem is…

Machine Learning · Computer Science 2025-04-15 Anthony GX-Chen , Kenneth Marino , Rob Fergus

Sample-efficient generalisation of reinforcement learning approaches have always been a challenge, especially, for complex scenes with many components. In this work, we introduce Plug and Play Markov Decision Processes, an object-based…

Machine Learning · Computer Science 2021-08-23 Majid Abdolshah , Hung Le , Thommen Karimpanal George , Sunil Gupta , Santu Rana , Svetha Venkatesh

This paper addresses a fundamental problem of visuomotor policy learning for robotic manipulation: how to enhance robustness in out-of-distribution execution errors or dynamically re-routing trajectories, where the model relies solely on…

Robotics · Computer Science 2026-04-08 Jiahua Ma , Yiran Qin , Xin Wen , Yixiong Li , Yuyu Sun , Yulan Guo , Liang Lin , Ruimao Zhang

In reinforcement learning, abstraction methods that remove unnecessary information from the observation are commonly used to learn policies which generalize better to unseen tasks. However, these methods often overlook a crucial weakness:…

Machine Learning · Computer Science 2026-02-24 Caroline Horsch , Laurens Engwegen , Max Weltevrede , Matthijs T. J. Spaan , Wendelin Böhmer

This paper introduces a new lifelong learning solution where a single model is trained for a sequence of tasks. The main challenge that vision systems face in this context is catastrophic forgetting: as they tend to adapt to the most…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Amal Rannen Triki , Rahaf Aljundi , Mathew B. Blaschko , Tinne Tuytelaars

This paper proposes a method for learning continuous control policies for active landmark localization and exploration using an information-theoretic cost. We consider a mobile robot detecting landmarks within a limited sensing range, and…

Robotics · Computer Science 2023-05-18 Pengzhi Yang , Yuhan Liu , Shumon Koga , Arash Asgharivaskasi , Nikolay Atanasov

Perceiving the world in terms of objects and tracking them through time is a crucial prerequisite for reasoning and scene understanding. Recently, several methods have been proposed for unsupervised learning of object-centric…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Marissa A. Weis , Kashyap Chitta , Yash Sharma , Wieland Brendel , Matthias Bethge , Andreas Geiger , Alexander S. Ecker

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zikai Song , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

We introduce multi-task Visuo-Tactile World Models (VT-WM), which capture the physics of contact through touch reasoning. By complementing vision with tactile sensing, VT-WM better understands robot-object interactions in contact-rich…

This paper presents a data-efficient approach to learning transferable forward models for robotic push manipulation. Our approach extends our previous work on contact-based predictors by leveraging information on the pushed object's local…

Robotics · Computer Science 2019-05-10 Jochen Stüber , Marek Kopicki , Claudio Zito

Partially observable environments present an important open challenge in the domain of sequential control learning with delayed rewards. Despite numerous attempts during the two last decades, the majority of reinforcement learning…

Machine Learning · Statistics 2017-06-01 Julien Perez , Tomi Silander

To perform manipulation tasks in the real world, robots need to operate on objects with various shapes, sizes and without access to geometric models. It is often unfeasible to train monolithic neural network policies across such large…

Robotics · Computer Science 2021-03-22 Mohit Sharma , Oliver Kroemer

We present a follow-up study on our unified visuomotor neural model for the robotic tasks of identifying, localizing, and grasping a target object in a scene with multiple objects. Our Retinanet-based model enables end-to-end training of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Matthias Kerzel , Fares Abawi , Manfred Eppe , Stefan Wermter

We introduce VIOLA, an object-centric imitation learning approach to learning closed-loop visuomotor policies for robot manipulation. Our approach constructs object-centric representations based on general object proposals from a…

Robotics · Computer Science 2023-03-09 Yifeng Zhu , Abhishek Joshi , Peter Stone , Yuke Zhu

Visual exploration and smart data collection via autonomous vehicles is an attractive topic in various disciplines. Disturbances like wind significantly influence both the power consumption of the flying robots and the performance of the…

Signal Processing · Electrical Eng. & Systems 2021-01-27 Amir Niaraki , Jeremy Roghair , Ali Jannesari

The study of object representations in computer vision has primarily focused on developing representations that are useful for image classification, object detection, or semantic segmentation as downstream tasks. In this work we aim to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Tejas Kulkarni , Ankush Gupta , Catalin Ionescu , Sebastian Borgeaud , Malcolm Reynolds , Andrew Zisserman , Volodymyr Mnih

Object Navigation (ObjectNav) has made great progress with large language models (LLMs), but still faces challenges in memory management, especially in long-horizon tasks and dynamic scenes. To address this, we propose TopoNav, a new…

Robotics · Computer Science 2025-09-03 Peiran Liu , Qiang Zhang , Daojie Peng , Lingfeng Zhang , Yihao Qin , Hang Zhou , Jun Ma , Renjing Xu , Yiding Ji

Weakly supervised learning has emerged as a compelling tool for object detection by reducing the need for strong supervision during training. However, major challenges remain: (1) differentiation of object instances can be ambiguous; (2)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Zhongzheng Ren , Zhiding Yu , Xiaodong Yang , Ming-Yu Liu , Yong Jae Lee , Alexander G. Schwing , Jan Kautz

Learned visuomotor policies are capable of performing increasingly complex manipulation tasks. However, most of these policies are trained on data collected from limited robot positions and camera viewpoints. This leads to poor…

Robotics · Computer Science 2025-09-29 Jingyun Yang , Isabella Huang , Brandon Vu , Max Bajracharya , Rika Antonova , Jeannette Bohg

Planning contact interactions is one of the core challenges of many robotic tasks. Optimizing contact locations while taking dynamics into account is computationally costly and, in environments that are only partially observable, executing…

Robotics · Computer Science 2020-04-20 Alina Kloss , Maria Bauza , Jiajun Wu , Joshua B. Tenenbaum , Alberto Rodriguez , Jeannette Bohg