中文
相关论文

相关论文: Visual Reinforcement Learning with Self-Supervised…

200 篇论文

Precise shape control of Deformable Linear Objects (DLOs) is crucial in robotic applications such as industrial and medical fields. However, existing methods face challenges in handling complex large deformation tasks, especially those…

机器人学 · 计算机科学 2026-02-26 Zhaowei Liang , Song Wang , Zhao Jin , Shirui Wu , Dan Wu

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

机器学习 · 计算机科学 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

Learning to solve precision-based manipulation tasks from visual feedback using Reinforcement Learning (RL) could drastically reduce the engineering efforts required by traditional robot systems. However, performing fine-grained motor…

机器人学 · 计算机科学 2022-01-21 Rishabh Jangir , Nicklas Hansen , Sambaran Ghosal , Mohit Jain , Xiaolong Wang

Emerging vehicular systems with increasing proportions of automated components present opportunities for optimal control to mitigate congestion and increase efficiency. There has been a recent interest in applying deep reinforcement…

人工智能 · 计算机科学 2022-08-02 Zhongxia Yan , Abdul Rahman Kreidieh , Eugene Vinitsky , Alexandre M. Bayen , Cathy Wu

When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alone can achieve. However, vision-enabled policies tend to…

机器人学 · 计算机科学 2026-05-29 Victor Kowalski , Chengxi Li , Dongheui Lee

In the past few years supervised and adversarial learning have been widely adopted in various complex computer vision tasks. It seems natural to wonder whether another branch of artificial intelligence, commonly known as Reinforcement…

计算机视觉与模式识别 · 计算机科学 2020-04-09 Litu Rout , Saumyaa Shah , S Manthira Moorthi , Debajyoti Dhar

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

机器人学 · 计算机科学 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

机器人学 · 计算机科学 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement learning is a promising…

机器学习 · 计算机科学 2022-11-30 Jingda Wu , Zhiyu Huang , Wenhui Huang , Chen Lv

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

计算与语言 · 计算机科学 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Jumping poses a significant challenge for quadruped robots, despite being crucial for many operational scenarios. While optimisation methods exist for controlling such motions, they are often time-consuming and demand extensive knowledge of…

机器人学 · 计算机科学 2026-05-19 Riccardo Bussola , Michele Focchi , Giulio Turrisi , Claudio Semini , Luigi Palopoli

Many real-world applications require an agent to make robust and deliberate decisions with multimodal information (e.g., robots with multi-sensory inputs). However, it is very challenging to train the agent via reinforcement learning (RL)…

机器学习 · 计算机科学 2023-02-21 Jinming Ma , Feng Wu , Yingfeng Chen , Xianpeng Ji , Yu Ding

Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and…

机器学习 · 计算机科学 2019-10-15 Xinle Liang , Yang Liu , Tianjian Chen , Ming Liu , Qiang Yang

Most of the existing video self-supervised methods mainly leverage temporal signals of videos, ignoring that the semantics of moving objects and environmental information are all critical for video-related tasks. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-07-09 Wei Li , Dezhao Luo , Bo Fang , Yu Zhou , Weiping Wang

This demo abstract presents the visualization of deep reinforcement learning (DRL)-based autonomous aerial mobility simulations. In order to implement the software, Unity-RL is used and additional buildings are introduced for urban…

机器人学 · 计算机科学 2021-02-18 Gusang Lee , Won Joon Yun , Soyi Jung , Joongheon Kim , Jae-Hyun Kim

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

机器学习 · 计算机科学 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. However, it is non-trivial to manually design a robot controller that combines modalities with very different characteristics. While…

As surgical robots become more common, automating away some of the burden of complex direct human operation becomes ever more feasible. Model-free reinforcement learning (RL) is a promising direction toward generalizable automated surgical…

机器人学 · 计算机科学 2021-05-04 Yotam Barnoy , Molly O'Brien , Will Wang , Gregory Hager

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

Offline reinforcement learning (RL) enables policy optimization using static datasets, avoiding the risks and costs of extensive real-world exploration. However, it struggles with suboptimal offline behaviors and inaccurate value estimation…

机器学习 · 计算机科学 2025-05-20 Minting Pan , Yitao Zheng , Jiajian Li , Yunbo Wang , Xiaokang Yang