English
Related papers

Related papers: Closed-Loop Learning of Visual Control Policies

200 papers

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

One of the major challenges of model-free visual tracking problem has been the difficulty originating from the unpredictable and drastic changes in the appearance of objects we target to track. Existing methods tackle this problem by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Janghoon Choi , Junseok Kwon , Kyoung Mu Lee

The Simultaneous Localization and Mapping (SLAM) problem addresses the possibility of a robot to localize itself in an unknown environment and simultaneously build a consistent map of this environment. Recently, cameras have been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hudson M. S. Bruno , Esther L. Colombini

Reinforcement learning (RL) can refine Vision-Language-Action (VLA) policies beyond behavior cloning, but real-world RL remains expensive due to extensive rollouts, resets, supervision, and safety risks. Action-conditioned video world…

Robotics · Computer Science 2026-05-26 Xiaokang Liu , Zechen Bai , Hai Ci , Kevin Yuchen Ma , Mike Zheng Shou

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

Building deep reinforcement learning agents that can generalize and adapt to unseen environments remains a fundamental challenge for AI. This paper describes progresses on this challenge in the context of man-made environments, which are…

Machine Learning · Computer Science 2018-10-01 Yi Wu , Yuxin Wu , Aviv Tamar , Stuart Russell , Georgia Gkioxari , Yuandong Tian

This paper shows that self-supervised visual pre-training from real-world images is effective for learning motor control tasks from pixels. We first train the visual representations by masked modeling of natural images. We then freeze the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Tete Xiao , Ilija Radosavovic , Trevor Darrell , Jitendra Malik

Deep Learning has become interestingly popular in computer vision, mostly attaining near or above human-level performance in various vision tasks. But recent work has also demonstrated that these deep neural networks are very vulnerable to…

Machine Learning · Computer Science 2020-12-09 Shashi Kant Gupta

Existing machine learning models demonstrate excellent performance in image object recognition after training on a large-scale dataset under full supervision. However, these models only learn to map an image to a predefined class index,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Kai Han , Xiaohu Huang , Yandong Li , Sagar Vaze , Jie Li , Xuhui Jia

Intelligent agent naturally learns from motion. Various self-supervised algorithms have leveraged motion cues to learn effective visual representations. The hurdle here is that motion is both ambiguous and complex, rendering previous works…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Xiaohang Zhan , Xingang Pan , Ziwei Liu , Dahua Lin , Chen Change Loy

Recognizing the activities causing distraction in real-world driving scenarios is critical for ensuring the safety and reliability of both drivers and pedestrians on the roadways. Conventional computer vision techniques are typically…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Md Zahid Hasan , Jiajing Chen , Jiyang Wang , Mohammed Shaiqur Rahman , Ameya Joshi , Senem Velipasalar , Chinmay Hegde , Anuj Sharma , Soumik Sarkar

Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new target goals, and (2) data inefficiency i.e., the model requires several (and often costly) episodes of trial and error to converge,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-19 Yuke Zhu , Roozbeh Mottaghi , Eric Kolve , Joseph J. Lim , Abhinav Gupta , Li Fei-Fei , Ali Farhadi

Embodied visual tracking is to follow a target object in dynamic 3D environments using an agent's egocentric vision. This is a vital and challenging skill for embodied agents. However, existing methods suffer from inefficient training and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fangwei Zhong , Kui Wu , Hai Ci , Churan Wang , Hao Chen

In reinforcement learning algorithms, leveraging multiple views of the environment can improve the learning of complicated policies. In multi-view environments, due to the fact that the views may frequently suffer from partial…

Machine Learning · Computer Science 2019-07-24 Elaheh Barati , Xuewen Chen

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

Artificial Intelligence · Computer Science 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

In this paper, we introduce an attribute-based interactive image search which can leverage human-in-the-loop feedback to iteratively refine image search results. We study active image search where human feedback is solicited exclusively in…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Bryan A. Plummer , M. Hadi Kiapour , Shuai Zheng , Robinson Piramuthu

Combinatorial methods for learning general policies that solve large collections of planning problems have been recently developed. One of their strengths, in relation to deep learning approaches, is that the resulting policies can be…

Artificial Intelligence · Computer Science 2025-09-04 Blai Bonet , Hector Geffner

Our understanding of the visual world is centered around various concept axes, characterizing different aspects of visual entities. While different concept axes can be easily specified by language, e.g. color, the exact visual nuances along…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Sharon Lee , Yunzhi Zhang , Shangzhe Wu , Jiajun Wu

In the last few years we have seen a growing interest in machine learning approaches to computer vision and, especially, to semantic labeling. Nowadays state of the art systems use deep learning on millions of labeled images with very…

Computer Vision and Pattern Recognition · Computer Science 2014-08-12 Marco Gori , Marco Lippi , Marco Maggini , Stefano Melacci