中文
相关论文

相关论文: Towards Characterizing Divergence in Deep Q-Learni…

200 篇论文

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

机器学习 · 计算机科学 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

Deep reinforcement learning (RL) has achieved several high profile successes in difficult decision-making problems. However, these algorithms typically require a huge amount of data before they reach reasonable performance. In fact, their…

The field of quickest change detection (QCD) focuses on the design and analysis of online algorithms that estimate the time at which a significant event occurs. In this paper, design and analysis are cast in a Bayesian framework, where QCD…

最优化与控制 · 数学 2025-12-30 Austin Cooper , Sean Meyn

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications. State-Of-The-Art algorithms usually leverage powerful function…

机器学习 · 计算机科学 2022-11-28 Ming Yin , Mengdi Wang , Yu-Xiang Wang

Deep Reinforcement Learning (DRL) has shown outstanding performance on inducing effective action policies that maximize expected long-term return on many complex tasks. Much of DRL work has been focused on sequences of events with discrete…

机器学习 · 计算机科学 2021-05-07 Yeo Jin Kim , Min Chi

The goal of this manuscript is to conduct a controltheoretic analysis of Temporal Difference (TD) learning algorithms. TD-learning serves as a cornerstone in the realm of reinforcement learning, offering a methodology for approximating the…

人工智能 · 计算机科学 2023-09-12 Donghwan Lee , Do Wan Kim

This paper introduces Q-learning with gradient target tracking, a novel reinforcement learning framework that provides a learned continuous target update mechanism as an alternative to the conventional hard update paradigm. In the standard…

机器学习 · 计算机科学 2025-07-21 Bum Geun Park , Taeho Lee , Donghwan Lee

Offline Reinforcement Learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods…

机器学习 · 计算机科学 2025-03-18 Kun Wu , Yinuo Zhao , Zhiyuan Xu , Zhengping Che , Chengxiang Yin , Chi Harold Liu , Feiferi Feng , Jian Tang

Deep reinforcement learning (DRL) often requires a large number of data and environment interactions, making the training process time-consuming. This challenge is further exacerbated in the case of batch RL, where the agent is trained…

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

机器学习 · 计算机科学 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

We study a classification problem where each feature can be acquired for a cost and the goal is to optimize a trade-off between the expected classification error and the feature cost. We revisit a former approach that has framed the problem…

人工智能 · 计算机科学 2018-11-13 Jaromír Janisch , Tomáš Pevný , Viliam Lisý

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

计算机视觉与模式识别 · 计算机科学 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

Delusional bias is a fundamental source of error in approximate Q-learning. To date, the only techniques that explicitly address delusion require comprehensive search using tabular value estimates. In this paper, we develop efficient…

机器学习 · 计算机科学 2020-03-02 Andy Su , Jayden Ooi , Tyler Lu , Dale Schuurmans , Craig Boutilier

We show that deep reinforcement learning algorithms can retain their ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples by combatting…

机器学习 · 计算机科学 2024-08-06 Marcel Hussing , Claas Voelcker , Igor Gilitschenski , Amir-massoud Farahmand , Eric Eaton

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

人工智能 · 计算机科学 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Reinforcement learning (RL) often exhibits high variance across training runs, leading to unreliable performance and posing a major challenge to deployment in real-world domains. In this work, we address the challenge of cross-run policy…

机器学习 · 计算机科学 2026-05-22 Marcel Hussing , Liv G. d'Aliberti , Claas Voelcker , Benjamin Eysenbach , Eric Eaton

A primary requirement for any reinforcement learning method is that it should produce policies that improve upon the initial guess. In this work, we show that the widely used Deep Q-Network (DQN) fails to satisfy this minimal criterion --…

机器学习 · 计算机科学 2025-06-18 Aditya Gopalan , Gugan Thoppe

Effectively leveraging large, previously collected datasets in reinforcement learning (RL) is a key challenge for large-scale real-world applications. Offline RL algorithms promise to learn effective policies from previously-collected,…

机器学习 · 计算机科学 2020-08-20 Aviral Kumar , Aurick Zhou , George Tucker , Sergey Levine

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

信息论 · 计算机科学 2018-12-10 Fan Meng , Peng Chen , Lenan Wu

Reinforcement learning has been widely used in many problems, including quantum control of qubits. However, such problems can, at the same time, be solved by traditional, non-machine-learning methods, such as stochastic gradient descent and…

量子物理 · 物理学 2021-05-06 Xiao-Ming Zhang , Zezhu Wei , Raza Asad , Xu-Chen Yang , Xin Wang