English
Related papers

Related papers: Efficient Exploration through Bayesian Deep Q-Netw…

200 papers

In this study, we present two distinct approaches within the realm of Deep Reinforcement Learning (Deep-RL) aimed at enhancing mapless navigation for a ground-based mobile robot. The research methodology primarily involves a comparative…

Bottom-Up (BU) saliency models do not perform well in complex interactive environments where humans are actively engaged in tasks (e.g., sandwich making and playing the video games). In this paper, we leverage Reinforcement Learning (RL) to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Sajad Mousavi , Michael Schukat , Enda Howley , Ali Borji , Nasser Mozayani

Reinforcement learning (RL) for exponential-utility optimization in discounted Markov decision processes (MDPs) lacks principled value-based algorithms. We address this gap in the fixed risk-aversion setting. Building on the Bellman-type…

Machine Learning · Computer Science 2026-05-11 Gugan Thoppe , L. A. Prashanth , Ankur Naskar , Sanjay Bhat

Algorithms that tackle deep exploration -- an important challenge in reinforcement learning -- have relied on epistemic uncertainty representation through ensembles or other hypermodels, exploration bonuses, or visitation count…

Machine Learning · Computer Science 2021-02-24 Vikranth Dwaracherla , Benjamin Van Roy

Offline reinforcement learning (RL) aims to learn optimal policies from offline datasets, where the parameterization of policies is crucial but often overlooked. Recently, Diffsuion-QL significantly boosts the performance of offline RL by…

Machine Learning · Computer Science 2023-10-27 Bingyi Kang , Xiao Ma , Chao Du , Tianyu Pang , Shuicheng Yan

Offline reinforcement learning (RL) has received increasing attention for learning policies from previously collected data without interaction with the real environment, which is particularly important in high-stakes applications. While a…

Machine Learning · Computer Science 2026-04-03 Qing Zhu , Xian Yu

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

Systems and Control · Electrical Eng. & Systems 2022-05-19 Shambhuraj Sawant , Sebastien Gros

This paper studies the transfer reinforcement learning (RL) problem where multiple RL problems have different reward functions but share the same underlying transition dynamics. In this setting, the Q-function of each RL problem (task) can…

Machine Learning · Computer Science 2024-09-24 Shuai Zhang , Heshan Devaka Fernando , Miao Liu , Keerthiram Murugesan , Songtao Lu , Pin-Yu Chen , Tianyi Chen , Meng Wang

The recently introduced Deep Q-Networks (DQN) algorithm has gained attention as one of the first successful combinations of deep neural networks and reinforcement learning. Its promise was demonstrated in the Arcade Learning Environment…

Machine Learning · Computer Science 2016-04-25 Yitao Liang , Marlos C. Machado , Erik Talvitie , Michael Bowling

Optimal trade execution is an important problem faced by essentially all traders. Much research into optimal execution uses stringent model assumptions and applies continuous time stochastic control to solve them. Here, we instead take a…

Trading and Market Microstructure · Quantitative Finance 2020-06-09 Brian Ning , Franco Ho Ting Lin , Sebastian Jaimungal

Applications of reinforcement learning (RL) to stabilization problems of real systems are restricted since an agent needs many experiences to learn an optimal policy and may determine dangerous actions during its exploration. If we know a…

Machine Learning · Computer Science 2021-04-20 Junya Ikemoto , Toshimitsu Ushio

In dynamic spectrum access (DSA) networks, secondary users (SUs) need to opportunistically access primary users' (PUs) radio spectrum without causing significant interference. Since the interaction between the SU and the PU systems are…

Signal Processing · Electrical Eng. & Systems 2023-05-22 Ramin Safavinejad , Hao-Hsuan Chang , Lingjia Liu

Efficient exploration in deep reinforcement learning remains a fundamental challenge, especially in environments characterized by high-dimensional states and sparse rewards. Traditional exploration strategies that rely on random local…

Machine Learning · Computer Science 2025-11-24 Stergios Plataniotis , Charilaos Akasiadis , Georgios Chalkiadakis

In this paper, we propose a federated deep reinforcement learning framework to solve a multi-objective optimization problem, where we consider minimizing the expected long-term task completion delay and energy consumption of IoT devices.…

Networking and Internet Architecture · Computer Science 2021-04-26 Sheyda Zarandi , Hina Tabassum

Reinforcement learning (RL) theory has largely focused on proving minimax sample complexity bounds. These require strategic exploration algorithms that use relatively limited function classes for representing the policy or value function.…

Machine Learning · Statistics 2024-04-16 Cassidy Laidlaw , Banghua Zhu , Stuart Russell , Anca Dragan

This paper presents a comparison between two well-known deep Reinforcement Learning (RL) algorithms: Deep Q-Learning (DQN) and Proximal Policy Optimization (PPO) in a simulated production system. We utilize a Petri Net (PN)-based simulation…

Artificial Intelligence · Computer Science 2023-06-05 Reuf Kozlica , Stefan Wegenkittl , Simon Hirländer

Bayesian Reinforcement Learning (RL) is capable of not only incorporating domain knowledge, but also solving the exploration-exploitation dilemma in a natural way. As Bayesian RL is intractable except for special cases, previous work has…

Artificial Intelligence · Computer Science 2013-06-14 Kenji Kawaguchi , Mauricio Araya

While contemporary reinforcement learning research and applications have embraced policy gradient methods as the panacea of solving learning problems, value-based methods can still be useful in many domains as long as we can wrangle with…

Machine Learning · Computer Science 2024-07-16 Ashwin Ramaswamy , Ransalu Senanayake

Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads,…

Artificial Intelligence · Computer Science 2025-12-08 Truong Thanh Hung Nguyen , Truong Thinh Nguyen , Hung Cao

Deep neural networks (DNN) can approximate value functions or policies for reinforcement learning, which makes the reinforcement learning algorithms more powerful. However, some DNNs, such as convolutional neural networks (CNN), cannot…

Machine Learning · Computer Science 2022-04-26 Yizhan Niu , Jinglong Liu , Yuhao Shi , Jiren Zhu