中文
相关论文

相关论文: Iterated $Q$-Network: Beyond One-Step Bellman Upda…

200 篇论文

This project addresses the challenge of automated stock trading, where traditional methods and direct reinforcement learning (RL) struggle with market noise, complexity, and generalization. Our proposed solution is an integrated deep…

机器学习 · 计算机科学 2025-05-08 John Christopher Tidwell , John Storm Tidwell

We consider a dynamic multichannel access problem, where multiple correlated channels follow an unknown joint Markov model. A user at each time slot selects a channel to transmit data and receives a reward based on the success or failure of…

网络与互联网体系结构 · 计算机科学 2018-02-21 Shangxing Wang , Hanpeng Liu , Pedro Henrique Gomes , Bhaskar Krishnamachari

We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained…

机器学习 · 计算机科学 2015-10-16 Hao Yi Ong , Kevin Chavez , Augustus Hong

In this paper, we propose a Deep Reinforcement Learning (RL) framework for task arrangement, which is a critical problem for the success of crowdsourcing platforms. Previous works conduct the personalized recommendation of tasks to workers…

机器学习 · 计算机科学 2019-11-05 Caihua Shan , Nikos Mamoulis , Reynold Cheng , Guoliang Li , Xiang Li , Yuqiu Qian

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

机器学习 · 计算机科学 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu

Reinforcement learning is a popular machine learning paradigm which can find near optimal solutions to complex problems. Most often, these procedures involve function approximation using neural networks with gradient based updates to…

神经与进化计算 · 计算机科学 2020-06-05 Callum Wilson , Annalisa Riccardi , Edmondo Minisci

Q-learning (QL), a common reinforcement learning algorithm, suffers from over-estimation bias due to the maximization term in the optimal Bellman operator. This bias may lead to sub-optimal behavior. Double-Q-learning tackles this issue by…

机器学习 · 计算机科学 2021-04-21 Oren Peer , Chen Tessler , Nadav Merlis , Ron Meir

Being able to reach any desired location in the environment can be a valuable asset for an agent. Learning a policy to navigate between all pairs of states individually is often not feasible. An all-goals updating algorithm uses each…

机器学习 · 计算机科学 2020-02-06 Fabio Pardo , Vitaly Levdik , Petar Kormushev

Reinforcement learning agents in complex game environments often suffer from sparse rewards, training instability, and poor sample efficiency. This paper presents a hybrid training approach that combines offline imitation learning with…

机器学习 · 计算机科学 2025-09-19 Thomas Ackermann , Moritz Spang , Hamza A. A. Gardi

In this work, we propose a novel cross Q-learning algorithm, aim at alleviating the well-known overestimation problem in value-based reinforcement learning methods, particularly in the deep Q-networks where the overestimation is exaggerated…

人工智能 · 计算机科学 2020-09-30 Xing Wang , Alexander Vinel

At present, designing convolutional neural network (CNN) architectures requires both human expertise and labor. New architectures are handcrafted by careful experimentation or modified from a handful of existing networks. We introduce…

机器学习 · 计算机科学 2017-03-24 Bowen Baker , Otkrist Gupta , Nikhil Naik , Ramesh Raskar

We introduce a novel Deep Reinforcement Learning (DRL) algorithm called Deep Quality-Value (DQV) Learning. DQV uses temporal-difference learning to train a Value neural network and uses this network for training a second Quality-value…

机器学习 · 统计学 2018-10-11 Matthia Sabatelli , Gilles Louppe , Pierre Geurts , Marco A. Wiering

In deep reinforcement learning, estimating the value function to evaluate the quality of states and actions is essential. The value function is often trained using the least squares method, which implicitly assumes a Gaussian error…

机器学习 · 计算机科学 2024-03-28 Motoki Omura , Takayuki Osa , Yusuke Mukuta , Tatsuya Harada

Deep reinforcement learning algorithms often use two networks for value function optimization: an online network, and a target network that tracks the online network with some delay. Using two separate networks enables the agent to hedge…

机器学习 · 计算机科学 2023-04-19 Kavosh Asadi , Rasool Fakoor , Omer Gottesman , Taesup Kim , Michael L. Littman , Alexander J. Smola

One of the most natural approaches to reinforcement learning (RL) with function approximation is value iteration, which inductively generates approximations to the optimal value function by solving a sequence of regression problems. To…

机器学习 · 计算机科学 2024-06-19 Noah Golowich , Ankur Moitra

We adapt the optimization's concept of momentum to reinforcement learning. Seeing the state-action value functions as an analog to the gradients in optimization, we interpret momentum as an average of consecutive $q$-functions. We derive…

机器学习 · 计算机科学 2020-04-01 Nino Vieillard , Bruno Scherrer , Olivier Pietquin , Matthieu Geist

Reinforcement learning has achieved remarkable success in perfect information games such as Go and Atari, enabling agents to compete at the highest levels against human players. However, research in reinforcement learning for imperfect…

机器学习 · 计算机科学 2024-10-24 Jiamian Li

In this paper we consider reinforcement learning tasks with progressive rewards; that is, tasks where the rewards tend to increase in magnitude over time. We hypothesise that this property may be problematic for value-based deep…

机器学习 · 计算机科学 2021-04-30 Michael Dann , John Thangarajah

Recent research has shown that although Reinforcement Learning (RL) can benefit from expert demonstration, it usually takes considerable efforts to obtain enough demonstration. The efforts prevent training decent RL agents with expert…

机器学习 · 计算机科学 2021-07-09 Si-An Chen , Voot Tangkaratt , Hsuan-Tien Lin , Masashi Sugiyama

An effective way to achieve intelligence is to simulate various intelligent behaviors in the human brain. In recent years, bio-inspired learning methods have emerged, and they are different from the classical mathematical programming…

人工智能 · 计算机科学 2019-04-01 Jieneng Chen , Jingye Chen , Ruiming Zhang , Xiaobin Hu