English
Related papers

Related papers: Action Candidate Driven Clipped Double Q-learning …

200 papers

It is vital to accurately estimate the value function in Deep Reinforcement Learning (DRL) such that the agent could execute proper actions instead of suboptimal ones. However, existing actor-critic methods suffer more or less from…

Machine Learning · Computer Science 2021-12-22 Jiafei Lyu , Yu Yang , Jiangpeng Yan , Xiu Li

Deep learning has shown successful application in visual recognition and certain artificial intelligence tasks. Deep learning is also considered as a powerful tool with high flexibility to approximate functions. In the present work,…

Machine Learning · Computer Science 2021-12-23 Ayan Chakraborty , Thomas Wick , Xiaoying Zhuang , Timon Rabczuk

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

Q-learning can be described as an all-purpose automaton that provides estimates (Q-values) of the continuation values associated with each available action and follows the naive policy of almost always choosing the action with highest…

Theoretical Economics · Economics 2025-05-29 Olivier Compte

Deep Q-Networks algorithm (DQN) was the first reinforcement learning algorithm using deep neural network to successfully surpass human level performance in a number of Atari learning environments. However, divergent and unstable behaviour…

Machine Learning · Computer Science 2022-10-10 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal

Constraint handling plays a key role in solving realistic complex optimization problems. Though intensively discussed in the last few decades, existing constraint handling techniques predominantly rely on human experts' designs, which more…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Qianhao Zhu , Sijie Ma , Zeyuan Ma , Hongshu Guo , Yue-Jiao Gong

In a discounted reward Markov Decision Process (MDP), the objective is to find the optimal value function, i.e., the value function corresponding to an optimal policy. This problem reduces to solving a functional equation known as the…

Machine Learning · Computer Science 2019-06-17 Chandramouli Kamanchi , Raghuram Bharadwaj Diddigi , Shalabh Bhatnagar

Numerous offline and model-based reinforcement learning systems incorporate world models to emulate the inherent environments. A world model is particularly important in scenarios where direct interactions with the real environment is…

Machine Learning · Computer Science 2026-01-19 Rajat Ghosh , Debojyoti Dutta

In this paper, we formulate the adaptive learning problem---the problem of how to find an individualized learning plan (called policy) that chooses the most appropriate learning materials based on learner's latent traits---faced in adaptive…

Machine Learning · Computer Science 2020-04-21 Xiao Li , Hanchen Xu , Jinming Zhang , Hua-hua Chang

Reinforcement learning techniques achieved human-level performance in several tasks in the last decade. However, in recent years, the need for interpretability emerged: we want to be able to understand how a system works and the reasons…

Machine Learning · Computer Science 2023-01-13 Leonardo Lucio Custode , Giovanni Iacca

Delusional bias is a fundamental source of error in approximate Q-learning. To date, the only techniques that explicitly address delusion require comprehensive search using tabular value estimates. In this paper, we develop efficient…

Machine Learning · Computer Science 2020-03-02 Andy Su , Jayden Ooi , Tyler Lu , Dale Schuurmans , Craig Boutilier

Pretraining reinforcement learning methods with demonstrations has been an important concept in the study of reinforcement learning since a large amount of computing power is spent on online simulations with existing reinforcement learning…

Machine Learning · Computer Science 2019-05-10 Xiaoqin Zhang , Yunfei Li , Huimin Ma , Xiong Luo

Robots find extensive applications in industry. In recent years, the influence of robots has also increased rapidly in domestic scenarios. The Q-learning algorithm aims to maximise the reward for reaching the goal. This paper proposes a…

Robotics · Computer Science 2024-09-04 Varun Prakash Rajamohan , Senthil Kumar Jagatheesaperumal

With the rapid development of e-commerce, auto-bidding has become a key asset in optimizing advertising performance under diverse advertiser environments. The current approaches focus on reinforcement learning (RL) and generative models.…

Discrete-action reinforcement learning algorithms often falter in tasks with high-dimensional discrete action spaces due to the vast number of possible actions. A recent advancement leverages value-decomposition, a concept from multi-agent…

Machine Learning · Computer Science 2024-03-11 David Ireland , Giovanni Montana

Tennis strategy optimization is a challenging sequential decision-making problem involving hierarchical scoring, stochastic outcomes, long-horizon credit assignment, physical fatigue, and adaptation to opponent skill. I present a…

Machine Learning · Computer Science 2025-12-30 Vishnu Mohan

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

Optimization and Control · Mathematics 2019-12-09 Ather Gattami

Dynamic treatment regimes (DTRs) formalize medical decision-making as a sequence of rules for different stages, mapping patient-level information to recommended treatments. In practice, estimating an optimal DTR using observational data…

Methodology · Statistics 2024-12-11 Jian Sun , Bo Fu , Li Su

In recent years, long-term evolution (LTE) and 5G NR (5th Generation New Radio) technologies have showed great potential to utilize Machine Learning (ML) algorithms in optimizing their operations, both thanks to the availability of…

Networking and Internet Architecture · Computer Science 2021-10-18 Pedro Enrique Iturria Rivera , Melike Erol-Kantarci

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva