English
Related papers

Related papers: Towards Vision-Based Deep Reinforcement Learning f…

200 papers

Object transportation could be a challenging problem for a single robot due to the oversize and/or overweight issues. A multi-robot system can take the advantage of increased driving power and more flexible configuration to solve such a…

Robotics · Computer Science 2020-07-21 Lin Zhang , Hao Xiong , Ou Ma , Zhaokui Wang

In this paper, we study the problem of learning vision-based dynamic manipulation skills using a scalable reinforcement learning approach. We study this problem in the context of grasping, a longstanding challenge in robotic manipulation.…

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

Learning to control complex systems using non-traditional feedback, e.g., in the form of snapshot images, is an important task encountered in diverse domains such as robotics, neuroscience, and biology (cellular systems). In this paper, we…

Machine Learning · Computer Science 2021-10-29 Krishnan Raghavan , Vignesh Narayanan , Jagannathan Saraangapani

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

The advances in deep reinforcement learning recently revived interest in data-driven learning based approaches to navigation. In this paper we propose to learn viewpoint invariant and target invariant visual servoing for local mobile robot…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Yimeng Li , Jana Kosecka

We develop a deep reinforcement learning method for training a jellyfish-like swimmer to effectively track a moving target in a two-dimensional flow. This swimmer is a flexible object equipped with a muscle model based on torsional springs.…

Fluid Dynamics · Physics 2025-08-20 Yihao Chen , Yue Yang

In the field of Autonomous Driving, the system controlling the vehicle can be seen as an agent acting in a complex environment and thus naturally fits into the modern framework of Reinforcement Learning. However, learning to drive can be a…

Artificial Intelligence · Computer Science 2018-11-26 Patrick Klose , Rudolf Mester

Combination of machine learning (for generating machine intelligence), computer vision (for better environment perception), and robotic systems (for controlled environment interaction) motivates this work toward proposing a vision-based…

Robotics · Computer Science 2021-05-31 Aras Dargazany

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

The autonomous control of flippers plays an important role in enhancing the intelligent operation of tracked robots within complex environments. While existing methods mainly rely on hand-crafted control models, in this paper, we introduce…

Robotics · Computer Science 2023-06-21 Hainan Pan , Bailiang Chen , Kaihong Huang , Junkai Ren , Xieyuanli Chen , Huimin Lu

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

Vision-based control provides a significant potential for the end-point positioning of continuum robots under physical sensing limitations. Traditional visual servoing requires feature extraction and tracking followed by full or partial…

Mirroring the complex structures and diverse functions of natural organisms is a long-standing challenge in robotics. Modern fabrication techniques have greatly expanded the feasible hardware, but using these systems requires control…

Robotics · Computer Science 2025-08-01 Sizhe Lester Li , Annan Zhang , Boyuan Chen , Hanna Matusik , Chao Liu , Daniela Rus , Vincent Sitzmann

Robotic manipulation in complex open-world scenarios requires both reliable physical manipulation skills and effective and generalizable perception. In this paper, we propose a method where general purpose pretrained visual models serve as…

Robotics · Computer Science 2017-09-27 Coline Devin , Pieter Abbeel , Trevor Darrell , Sergey Levine

This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person. The sub-tasks…

Robotics · Computer Science 2022-03-09 Junchi Liang , Bowen Wen , Kostas Bekris , Abdeslam Boularias

The use of Reinforcement Learning (RL) is still restricted to simulation or to enhance human-operated systems through recommendations. Real-world environments (e.g. industrial robots or power grids) are generally designed with safety…

Machine Learning · Computer Science 2020-08-14 Mathieu Seurin , Philippe Preux , Olivier Pietquin

Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous…

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daiki Kimura