English
Related papers

Related papers: Weakly Coupled Deep Q-Networks

200 papers

The Deep Q-Network proposed by Mnih et al. [2015] has become a benchmark and building point for much deep reinforcement learning research. However, replicating results for complex systems is often challenging since original scientific…

Machine Learning · Computer Science 2017-11-22 Melrose Roderick , James MacGlashan , Stefanie Tellex

The behavior decision-making subsystem is a key component of the autonomous driving system, which reflects the decision-making ability of the vehicle and the driver, and is an important symbol of the high-level intelligence of the vehicle.…

Machine Learning · Computer Science 2024-12-31 Zixiang Wang , Hao Yan , Changsong Wei , Junyu Wang , Minheng Xiao

In this article, we present an efficient deep learning method called coupled deep neural networks (CDNNs) for coupled physical problems. Our method compiles the interface conditions of the coupled PDEs into the networks properly and can be…

Numerical Analysis · Mathematics 2023-01-18 Jing Yue , Jian Li , Wen Zhang

In this paper, a Deep Q-Network (DQN) based multi-agent multi-user power allocation algorithm is proposed for hybrid networks composed of radio frequency (RF) and visible light communication (VLC) access points (APs). The users are capable…

Networking and Internet Architecture · Computer Science 2021-02-04 Bekir Sait Ciftler , Abdulmalik Alwarafy , Mohamed Abdallah , Mounir Hamdi

We consider multiple parallel Markov decision processes (MDPs) coupled by global constraints, where the time varying objective and constraint functions can only be observed after the decision is made. Special attention is given to how well…

Optimization and Control · Mathematics 2017-09-12 Xiaohan Wei , Hao Yu , Michael J. Neely

Q-learning is a powerful tool for network control and policy optimization in wireless networks, but it struggles with large state spaces. Recent advancements, like multi-environment mixed Q-learning (MEMQ), improves performance and reduces…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Talha Bozkus , Urbashi Mitra

Machine Learning algorithms and Neural Networks are widely applied to many different areas such as stock market prediction, face recognition and population analysis. This paper will introduce a strategy based on the classic Deep…

Portfolio Management · Quantitative Finance 2020-03-16 Ziming Gao , Yuan Gao , Yi Hu , Zhengyong Jiang , Jionglong Su

NarrowBand-Internet of Things (NB-IoT) is an emerging cellular-based technology that offers a range of flexible configurations for massive IoT radio access from groups of devices with heterogeneous requirements. A configuration specifies…

Networking and Internet Architecture · Computer Science 2018-12-24 Nan Jiang , Yansha Deng , Arumugam Nallanathan , Jonathon A. Chambers

We study a system with finitely many groups of multi-action bandit processes, each of which is a Markov decision process (MDP) with finite state and action spaces and potentially different transition matrices when taking different actions.…

Optimization and Control · Mathematics 2024-12-05 Jing Fu , Bill Moran , José Niño-Mora

In Markov decision processes (MDPs), quantile risk measures such as Value-at-Risk are a standard metric for modeling RL agents' preferences for certain outcomes. This paper proposes a new Q-learning algorithm for quantile optimization in…

Machine Learning · Computer Science 2024-11-01 Jia Lin Hau , Erick Delage , Esther Derman , Mohammad Ghavamzadeh , Marek Petrik

DQN (Deep Q-Network) is a method to perform Q-learning for reinforcement learning using deep neural networks. DQNs require a large buffer and batch processing for an experience replay and rely on a backpropagation based iterative…

Machine Learning · Computer Science 2023-03-14 Hirohisa Watanabe , Mineto Tsukada , Hiroki Matsutani

In smart manufacturing, scheduling autonomous internal logistic vehicles is crucial for optimizing operational efficiency. This paper proposes a multi-agent deep Q-network (MADQN) with a layer-based communication channel (LBCC) to address…

Multiagent Systems · Computer Science 2024-11-04 Mohammad Feizabadi , Arman Hosseini , Zakaria Yahouni

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

This paper proposes the MT-DQN model, which integrates a Transformer, Temporal Graph Neural Network (TGNN), and Deep Q-Network (DQN) to address the challenges of predicting user behavior and optimizing recommendation strategies in…

Machine Learning · Computer Science 2025-09-17 Jinmeiyang Wang , Jing Dong , Li Zhou

The rise of the new generation of cyber threats demands more sophisticated and intelligent cyber defense solutions equipped with autonomous agents capable of learning to make decisions without the knowledge of human experts. Several…

Cryptography and Security · Computer Science 2021-11-30 Hooman Alavizadeh , Julian Jang-Jaccard , Hootan Alavizadeh

Image based Deep Feature Quality Metrics (DFQMs) have been shown to better correlate with subjective perceptual scores over traditional metrics. The fundamental focus of these DFQMs is to exploit internal representations from a large scale…

Image and Video Processing · Electrical Eng. & Systems 2023-03-01 Darren Ramsook , Anil Kokaram

In many operations management problems, we need to make decisions sequentially to minimize the cost while satisfying certain constraints. One modeling approach to study such problems is constrained Markov decision process (CMDP). When…

Optimization and Control · Mathematics 2021-01-27 Yi Chen , Jing Dong , Zhaoran Wang

Over the past decade, remarkable progress has been made in adopting deep neural networks to enhance the performance of conventional reinforcement learning. A notable milestone was the development of Deep Q-Networks (DQN), which achieved…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Klinsmann Agyei , Pouria Sarhadi , Daniel Polani

This paper explores a deep reinforcement learning approach applied to the packet routing problem with high-dimensional constraints instigated by dynamic and autonomous communication networks. Our approach is motivated by the fact that…

Networking and Internet Architecture · Computer Science 2020-03-05 Ramy E. Ali , Bilgehan Erman , Ejder Baştuğ , Bruce Cilli

We present Q-Cogni, an algorithmically integrated causal reinforcement learning framework that redesigns Q-Learning with an autonomous causal structure discovery method to improve the learning process with causal inference. Q-Cogni achieves…

Machine Learning · Computer Science 2023-02-28 Cris Cunha , Wei Liu , Tim French , Ajmal Mian