中文
相关论文

相关论文: Don't Forget the Critic: Value-Based Data Rehearsa…

200 篇论文

Plasticity, the ability of a neural network to evolve with new data, is crucial for high-performance and sample-efficient visual reinforcement learning (VRL). Although methods like resetting and regularization can potentially mitigate…

机器学习 · 计算机科学 2024-05-21 Guozheng Ma , Lu Li , Sen Zhang , Zixuan Liu , Zhen Wang , Yixin Chen , Li Shen , Xueqian Wang , Dacheng Tao

Deep reinforcement learning continues to show tremendous potential in achieving task-level autonomy, however, its computational and energy demands remain prohibitively high. In this paper, we tackle this problem by applying quantization to…

Catastrophic forgetting has remained a critical challenge for deep neural networks in Continual Learning (CL) as it undermines consolidated knowledge when learning new tasks. Parameter efficient fine tuning CL techniques are gaining…

机器学习 · 计算机科学 2026-01-27 Prashant Shivaram Bhat , Shakib Yazdani , Elahe Arani , Bahram Zonooz

Continual learning (CL) remains one of the long-standing challenges for deep neural networks due to catastrophic forgetting of previously acquired knowledge. Although rehearsal-based approaches have been fairly successful in mitigating…

机器学习 · 计算机科学 2024-04-30 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

In this paper, we build upon the weakly-supervised generation mechanism of intermediate attention maps in any convolutional neural networks and disclose the effectiveness of attention modules more straightforwardly to fully exploit their…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Duo Li , Qifeng Chen

Deep Reinforcement Learning (DRL) has shown outstanding performance on inducing effective action policies that maximize expected long-term return on many complex tasks. Much of DRL work has been focused on sequences of events with discrete…

机器学习 · 计算机科学 2021-05-07 Yeo Jin Kim , Min Chi

Reinforcement learning (RL) has emerged as a powerful paradigm for improving large language models beyond supervised fine-tuning, yet sustaining performance gains at scale remains an open challenge, as data diversity and structure, rather…

机器学习 · 计算机科学 2026-03-26 Cansu Sancaktar , David Zhang , Gabriel Synnaeve , Taco Cohen

Residual reinforcement learning (RL) enables stable online refinement of expressive pretrained policies by freezing the base and learning only bounded corrections. However, value learning in residual RL poses unique challenges that remain…

机器学习 · 计算机科学 2026-02-12 Guozheng Ma , Lu Li , Haoyu Wang , Zixuan Liu , Pierre-Luc Bacon , Dacheng Tao

Reinforcement Learning (RL) consists of designing agents that make intelligent decisions without human supervision. When used alongside function approximators such as Neural Networks (NNs), RL is capable of solving extremely complex…

量子物理 · 物理学 2024-11-13 Rodrigo Coelho , André Sequeira , Luís Paulo Santos

Reinforcement Learning enables agents to learn optimal behaviors through interactions with environments. However, real-world environments are typically non-stationary, requiring agents to continuously adapt to new tasks and changing…

人工智能 · 计算机科学 2026-01-21 Jinwu Hu , Zihao Lian , Zhiquan Wen , Chenghao Li , Guohao Chen , Xutao Wen , Bin Xiao , Mingkui Tan

Deep reinforcement learning (RL) has shown great empirical successes, but suffers from brittleness and sample inefficiency. A potential remedy is to use a previously-trained policy as a source of supervision. In this work, we refer to these…

机器学习 · 计算机科学 2021-09-16 Daniel Seita , Abhinav Gopal , Zhao Mandi , John Canny

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

人工智能 · 计算机科学 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Adaptive Mixed-Criticality (AMC) is a fixed-priority preemptive scheduling algorithm for mixed-criticality hard real-time systems. It dominates many other scheduling algorithms for mixed-criticality systems, but does so at the cost of…

操作系统 · 计算机科学 2024-11-04 Bruno Mendes , Pedro F. Souto , Pedro C. Diniz

Deep reinforcement learning (DRL) is one of the most powerful tools for synthesizing complex robotic behaviors. But training DRL models is incredibly compute and memory intensive, requiring large training datasets and replay buffers to…

机器人学 · 计算机科学 2023-04-25 Lev Grossman , Brian Plancher

We address the issue of estimation bias in deep reinforcement learning (DRL) by introducing solution mechanisms that include a new, twin TD-regularized actor-critic (TDR) method. It aims at reducing both over and under-estimation errors.…

机器学习 · 计算机科学 2023-11-08 Junmin Zhong , Ruofan Wu , Jennie Si

Value-based algorithms are a cornerstone of off-policy reinforcement learning due to their simplicity and training stability. However, their use has traditionally been restricted to discrete action spaces, as they rely on estimating…

机器学习 · 计算机科学 2025-10-23 Yigit Korkmaz , Urvi Bhuwania , Ayush Jain , Erdem Bıyık

Buildings with Heating, Ventilation, and Air Conditioning (HVAC) systems play a crucial role in ensuring indoor comfort and efficiency. While traditionally governed by physics-based models, the emergence of big data has enabled data-driven…

机器学习 · 计算机科学 2025-03-26 Gautham Udayakumar Bekal , Ahmed Ghareeb , Ashish Pujari

Continuous control Deep Reinforcement Learning (RL) approaches are known to suffer from estimation biases, leading to suboptimal policies. This paper introduces innovative methods in RL, focusing on addressing and exploiting estimation…

机器学习 · 计算机科学 2024-10-14 Niccolò Turcato , Alberto Sinigaglia , Alberto Dalla Libera , Ruggero Carli , Gian Antonio Susto

Reinforcement Learning (RL) has empowered Large Language Models (LLMs) with strong reasoning capabilities, but vanilla RL mainly focuses on generation capability improvement by training with only first-order rollout (generating multiple…

计算与语言 · 计算机科学 2026-02-27 Zhe Yang , Yudong Wang , Rang Li , Zhifang Sui

Catastrophic forgetting has a serious impact in reinforcement learning, as the data distribution is generally sparse and non-stationary over time. The purpose of this study is to investigate whether pseudorehearsal can increase performance…

人工智能 · 计算机科学 2017-04-18 Marochko Vladimir , Leonard Johard , Manuel Mazzara