English
Related papers

Related papers: Evolution of Q Values for Deep Q Learning in Stabl…

200 papers

A goal of cloud service management is to design self-adaptable auto-scaler to react to workload fluctuations and changing the resources assigned. The key problem is how and when to add/remove resources in order to meet agreed service-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-22 Hamid Arabnejad , Claus Pahl , Pooyan Jamshidi , Giovani Estrada

There is increasing interest in data-driven approaches for recommending optimal treatment strategies in many chronic disease management and critical care applications. Reinforcement learning methods are well-suited to this sequential…

Machine Learning · Computer Science 2023-06-14 Milashini Nambiar , Supriyo Ghosh , Priscilla Ong , Yu En Chan , Yong Mong Bee , Pavitra Krishnaswamy

As the number of devices getting connected to the vehicular network grows exponentially, addressing the numerous challenges of effectively allocating spectrum in dynamic vehicular environment becomes increasingly difficult. Traditional…

Signal Processing · Electrical Eng. & Systems 2024-10-17 Riya Dinesh Deshpande , Faheem A. Khan , Qasim Zeeshan Ahmed

Since the publication of the original Transformer architecture (Vaswani et al. 2017), Transformers revolutionized the field of Natural Language Processing. This, mainly due to their ability to understand timely dependencies better than…

Machine Learning · Computer Science 2020-12-21 Gideon Stein , Andrey Filchenkov , Arip Asadulaev

Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural…

Machine Learning · Computer Science 2023-06-22 Yang Ni , Danny Abraham , Mariam Issa , Yeseong Kim , Pietro Mercati , Mohsen Imani

In this paper, we provide the details of implementing various reinforcement learning (RL) algorithms for controlling a Cart-Pole system. In particular, we describe various RL concepts such as Q-learning, Deep Q Networks (DQN), Double DQN,…

Robotics · Computer Science 2020-06-15 Swagat Kumar

Owing to the openness of wireless channels, wireless communication systems are highly susceptible to malicious jamming. Most existing anti-jamming methods rely on the assumption of accurate sensing and optimize parameters on a single…

Information Theory · Computer Science 2025-11-06 Haoqin Zhao , Zan Li , Jiangbo Si , Rui Huang , Hang Hu , Tony Q. S. Quek , Naofal Al-Dhahir

Deep Q-learning Network (DQN) is a successful way which combines reinforcement learning with deep neural networks and leads to a widespread application of reinforcement learning. One challenging problem when applying DQN or other…

Machine Learning · Computer Science 2022-09-19 Zhe Zhang , Yukun Zou , Junjie Lai , Qing Xu

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

Machine Learning · Computer Science 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

Deep Reinforcement Learning (deep RL) has made several breakthroughs in recent years in applications ranging from complex control tasks in unmanned vehicles to game playing. Despite their success, deep RL still lacks several important…

Machine Learning · Computer Science 2018-04-24 Artur d'Avila Garcez , Aimore Resende Riquetti Dutra , Eduardo Alonso

While many sophisticated exploration methods have been proposed, their lack of generality and high computational cost often lead researchers to favor simpler methods like $\epsilon$-greedy. Motivated by this, we introduce $\beta$-DQN, a…

Machine Learning · Computer Science 2025-10-29 Hongming Zhang , Fengshuo Bai , Chenjun Xiao , Chao Gao , Bo Xu , Martin Müller

Despite scale driving substantial recent advancements in machine learning, reinforcement learning (RL) methods still primarily use small value functions. Naively scaling value functions -- including with a transformer architecture, which is…

Machine Learning · Computer Science 2026-02-03 Perry Dong , Kuo-Han Hung , Alexander Swerdlow , Dorsa Sadigh , Chelsea Finn

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

Machine Learning · Computer Science 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

Offline reinforcement learning (RL) enables training from fixed data without online interaction, but policies learned offline often struggle when deployed in dynamic environments due to distributional shift and unreliable value estimates on…

Machine Learning · Computer Science 2025-11-06 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

Recent advancements in offline reinforcement learning (RL) have underscored the capabilities of Conditional Sequence Modeling (CSM), a paradigm that learns the action distribution based on history trajectory and target returns for each…

Machine Learning · Computer Science 2024-05-28 Shengchao Hu , Ziqing Fan , Chaoqin Huang , Li Shen , Ya Zhang , Yanfeng Wang , Dacheng Tao

Large Language Models (LLMs) have demonstrated impressive performance on a range of Natural Language Processing (NLP) tasks. Unfortunately, the immense amount of computations and memory accesses required for LLM training makes them…

Machine Learning · Computer Science 2023-03-10 Guo Yang , Daniel Lo , Robert Mullins , Yiren Zhao

In recent years, a variety of tasks have been accomplished by deep reinforcement learning (DRL). However, when applying DRL to tasks in a real-world environment, designing an appropriate reward is difficult. Rewards obtained via actual…

Machine Learning · Computer Science 2023-10-04 Kanata Suzuki , Tetsuya Ogata

Reinforcement learning (RL) often exhibits high variance across training runs, leading to unreliable performance and posing a major challenge to deployment in real-world domains. In this work, we address the challenge of cross-run policy…

Machine Learning · Computer Science 2026-05-22 Marcel Hussing , Liv G. d'Aliberti , Claas Voelcker , Benjamin Eysenbach , Eric Eaton

Consider the problem of training robustly capable agents. One approach is to generate a diverse collection of agent polices. Training can then be viewed as a quality diversity (QD) optimization problem, where we search for a collection of…

Machine Learning · Computer Science 2022-04-18 Bryon Tjanaka , Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis

Model-free learning for multi-agent stochastic games is an active area of research. Existing reinforcement learning algorithms, however, are often restricted to zero-sum games, and are applicable only in small state-action spaces or other…

Machine Learning · Computer Science 2022-10-25 Philippe Casgrain , Brian Ning , Sebastian Jaimungal