中文
相关论文

相关论文: Stop Regressing: Training Value Functions via Clas…

200 篇论文

Software testing activities scrutinize the artifacts and the behavior of a software product to find possible defects and ensure that the product meets its expected requirements. Recently, Deep Reinforcement Learning (DRL) has been…

软件工程 · 计算机科学 2023-06-30 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh

The top-k error is a common measure of performance in machine learning and computer vision. In practice, top-k classification is typically performed with deep neural networks trained with the cross-entropy loss. Theoretical results indeed…

机器学习 · 计算机科学 2018-02-22 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Reinforcement Learning with Rubric Rewards (RLRR) is a framework that extends conventional reinforcement learning from human feedback (RLHF) and verifiable rewards (RLVR) by replacing scalar preference signals with structured,…

机器学习 · 计算机科学 2026-05-08 Guangchen Lan , Lian Xiong , Xin Zhou , Hejie Cui , Yuwei Zhang , Mao Li , Zhenyu Shi , Besnik Fetahu , Lihong Li , Xian Li

Reinforcement Learning (RL) has the potential to enable robots to learn from their own actions in the real world. Unfortunately, RL can be prohibitively expensive, in terms of on-robot runtime, due to inefficient exploration when learning…

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

机器学习 · 计算机科学 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

In this paper, we investigate the problem of how to effectively master tool-use to solve complex visual reasoning tasks for Multimodal Large Language Models. To achieve that, we propose a novel Tool-supervised Reinforcement Learning…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Qihua Dong , Gozde Sahin , Pei Wang , Zhaowei Cai , Robik Shrestha , Hao Yang , Davide Modolo

Many modern robotic systems such as multi-robot systems and manipulators exhibit redundancy, a property owing to which they are capable of executing multiple tasks. This work proposes a novel method, based on the Reinforcement Learning (RL)…

机器人学 · 计算机科学 2025-04-03 Sheikh A. Tahmid , Gennaro Notomista

Recently deep reinforcement learning (DRL) has achieved outstanding success on solving many difficult and large-scale RL problems. However the high sample cost required for effective learning often makes DRL unaffordable in resource-limited…

机器学习 · 计算机科学 2018-09-06 Gang Chen , Yiming Peng , Mengjie Zhang

Perceptive deep reinforcement learning (DRL) has lead to many recent breakthroughs for complex AI systems leveraging image-based input data. Applications of these results range from super-human level video game agents to dexterous,…

机器人学 · 计算机科学 2023-10-04 Lev Grossman , Brian Plancher

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

机器学习 · 统计学 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Despite overparameterization, deep networks trained via supervised learning are easy to optimize and exhibit excellent generalization. One hypothesis to explain this is that overparameterized deep networks enjoy the benefits of implicit…

机器学习 · 计算机科学 2021-12-10 Aviral Kumar , Rishabh Agarwal , Tengyu Ma , Aaron Courville , George Tucker , Sergey Levine

Current reinforcement learning (RL) in robotics often experiences difficulty in generalizing to new downstream tasks due to the innate task-specific training paradigm. To alleviate it, unsupervised RL, a framework that pre-trains the agent…

机器人学 · 计算机科学 2022-10-13 Daesol Cho , Jigang Kim , H. Jin Kim

Off-policy sampling and experience replay are key for improving sample efficiency and scaling model-free temporal difference learning methods. When combined with function approximation, such as neural networks, this combination is known as…

机器学习 · 计算机科学 2021-07-13 Ray Jiang , Shangtong Zhang , Veronica Chelu , Adam White , Hado van Hasselt

We show that deep reinforcement learning algorithms can retain their ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples by combatting…

机器学习 · 计算机科学 2024-08-06 Marcel Hussing , Claas Voelcker , Igor Gilitschenski , Amir-massoud Farahmand , Eric Eaton

Reinforcement learning (RL) promises a framework for near-universal problem-solving. In practice however, RL algorithms are often tailored to specific benchmarks, relying on carefully tuned hyperparameters and algorithmic choices. Recently,…

机器学习 · 计算机科学 2025-01-28 Scott Fujimoto , Pierluca D'Oro , Amy Zhang , Yuandong Tian , Michael Rabbat

Recent advancements in reinforcement learning (RL) have shown promise for optimizing virtual machine scheduling (VMS) in small-scale clusters. The utilization of RL to large-scale cloud computing scenarios remains notably constrained. This…

机器学习 · 计算机科学 2025-03-04 Junjie Sheng , Jiehao Wu , Haochuan Cui , Yiqiu Hu , Wenli Zhou , Lei Zhu , Qian Peng , Wenhao Li , Xiangfeng Wang

While Reinforcement Learning for Verifiable Rewards (RLVR) is powerful for training large reasoning models, its training dynamics harbor a critical challenge: RL overfitting, where models gain training rewards but lose generalization. Our…

人工智能 · 计算机科学 2025-11-07 Zeng Zhiyuan , Jiashuo Liu , Zhangyue Yin , Ge Zhang , Wenhao Huang , Xipeng Qiu

Envisioned application areas for reinforcement learning (RL) include autonomous driving, precision agriculture, and finance, which all require RL agents to make decisions in the real world. A significant challenge hindering the adoption of…

机器学习 · 计算机科学 2025-01-20 Dominik Baumann , Erfaun Noorani , James Price , Ole Peters , Colm Connaughton , Thomas B. Schön

Designing a competent meta-reinforcement learning (meta-RL) algorithm in terms of data usage remains a central challenge to be tackled for its successful real-world applications. In this paper, we propose a sample-efficient meta-RL…

机器学习 · 计算机科学 2023-12-12 Jaeuk Shin , Giho Kim , Howon Lee , Joonho Han , Insoon Yang