中文
相关论文

相关论文: Pretrained Visual Representations in Reinforcement…

200 篇论文

Virtual character animation control is a problem for which Reinforcement Learning (RL) is a viable approach. While current work have applied RL effectively to portray physics-based skills, social behaviours are challenging to design reward…

机器学习 · 计算机科学 2021-04-14 Vihanga Gamage , Cathy Ennis , Robert Ross

Visual Place Recognition (VPR) is a critical task for performing global re-localization in visual perception systems. It requires the ability to accurately recognize a previously visited location under variations such as illumination,…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Oliver Grainge , Michael Milford , Indu Bodala , Sarvapali D. Ramchurn , Shoaib Ehsan

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

机器人学 · 计算机科学 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

The primary focus of Neural Representation for Videos (NeRV) is to effectively model its spatiotemporal consistency. However, current NeRV systems often face a significant issue of spatial inconsistency, leading to decreased perceptual…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Qi Zhao , M. Salman Asif , Zhan Ma

Federated Reinforcement Learning (FRL) offers a promising solution to various practical challenges in resource allocation for vehicle-to-everything (V2X) networks. However, the data discrepancy among individual agents can significantly…

信号处理 · 电气工程与系统科学 2024-05-06 Kaidi Xu , Shenglong Zhou , Geoffrey Ye Li

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer

Video super-resolution (VSR) techniques, especially deep-learning-based algorithms, have drastically improved over the last few years and shown impressive performance on synthetic data. However, their performance on real-world video data…

图像与视频处理 · 电气工程与系统科学 2023-05-05 Mehran Jeelani , Sadbhawna , Noshaba Cheema , Klaus Illgner-Fehns , Philipp Slusallek , Sunil Jaiswal

In this paper we introduce a fully end-to-end approach for visual tracking in videos that learns to predict the bounding box locations of a target object at every frame. An important insight is that the tracking problem can be considered as…

计算机视觉与模式识别 · 计算机科学 2017-04-12 Da Zhang , Hamid Maei , Xin Wang , Yuan-Fang Wang

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Yuhan Zhang , Guoqing Ma , Guangfu Hao , Liangxuan Guo , Yang Chen , Shan Yu

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

机器学习 · 计算机科学 2026-04-07 Yaoze Guo , Shana Moothedath

Visual error metrics play a fundamental role in the quantification of perceived image similarity. Most recently, use cases for them in real-time applications have emerged, such as content-adaptive shading and shading reuse to increase…

图形学 · 计算机科学 2023-10-16 João Libório Cardoso , Bernhard Kerbl , Lei Yang , Yury Uralsky , Michael Wimmer

Reinforcement learning with verifiable rewards (RLVR) is central to training modern reasoning models, but the undisclosed training data raises concerns about benchmark contamination. Unlike pretraining methods, which optimize models using…

人工智能 · 计算机科学 2026-02-13 Hongbo Zhang , Yue Yang , Jianhao Yan , Guangsheng Bao , Yue Zhang , Yue Zhang

Reinforcement Fine-Tuning (RFT) with verifiable rewards has advanced large language models but remains underexplored for Vision-Language (VL) models. The Vision-Language Reward Model (VL-RM) is key to aligning VL models by providing…

计算与语言 · 计算机科学 2025-06-18 Jipeng Zhang , Kehao Miao , Renjie Pi , Zhaowei Wang , Runtao Liu , Rui Pan , Tong Zhang

Visual reinforcement learning (RL) suffers from poor sample efficiency due to high-dimensional observations in complex tasks. While existing works have shown that vision-language models (VLMs) can assist RL, they often focus on knowledge…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Canming Xia , Peixi Peng , Guang Tan , Zhan Su , Haoran Xu , Zhenxian Liu , Luntong Li

The stability of visual odometry (VO) systems is undermined by degraded image quality, especially in environments with significant illumination changes. This study employs a deep reinforcement learning (DRL) framework to train agents for…

机器人学 · 计算机科学 2024-12-24 Shuyang Zhang , Jinhao He , Yilong Zhu , Jin Wu , Jie Yuan

We study risk-sensitive Reinforcement Learning (RL), where we aim to maximize the Conditional Value at Risk (CVaR) with a fixed risk tolerance $\tau$. Prior theoretical work studying risk-sensitive RL focuses on the tabular Markov Decision…

机器学习 · 计算机科学 2023-11-21 Yulai Zhao , Wenhao Zhan , Xiaoyan Hu , Ho-fung Leung , Farzan Farnia , Wen Sun , Jason D. Lee

In this paper, we examine the effectiveness of pre-training for visuo-motor control tasks. We revisit a simple Learning-from-Scratch (LfS) baseline that incorporates data augmentation and a shallow ConvNet, and find that this baseline is…

机器学习 · 计算机科学 2023-06-16 Nicklas Hansen , Zhecheng Yuan , Yanjie Ze , Tongzhou Mu , Aravind Rajeswaran , Hao Su , Huazhe Xu , Xiaolong Wang

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing LLMs' reasoning abilities, yet its data inefficiency remains a major bottleneck. To address this critical yet challenging issue, we present a…

机器学习 · 计算机科学 2026-04-28 Shipeng Li , Zhiqin Yang , Shikun Li , Xiaobo Xia , Hengyu Liu , Xinghua Zhang , Gaode Chen , Dong Fang , Ying Tai , Zhe Peng