English
Related papers

Related papers: Weakly Coupled Deep Q-Networks

200 papers

In this paper we combine one method for hierarchical reinforcement learning - the options framework - with deep Q-networks (DQNs) through the use of different "option heads" on the policy network, and a supervisory network for choosing…

Machine Learning · Computer Science 2017-06-20 Kai Arulkumaran , Nat Dilokthanakul , Murray Shanahan , Anil Anthony Bharath

Several real-world scenarios, such as remote control and sensing, are comprised of action and observation delays. The presence of delays degrades the performance of reinforcement learning (RL) algorithms, often to such an extent that…

Machine Learning · Computer Science 2021-08-18 Somjit Nath , Mayank Baranwal , Harshad Khadilkar

The quantum internet holds transformative potential for global communication by harnessing the principles of quantum information processing. Despite significant advancements in quantum communication technologies, the efficient distribution…

Quantum Physics · Physics 2025-03-06 Lamarana Jallow , Majid Iqbal Khan

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

Machine Learning · Computer Science 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

We propose Tabular Q-Learning (TabQL), a reinforcement learning framework that replaces the conventional parametric Q-network in Deep Q-Learning (DQN) with a tabular foundation model endowed with in-context learning capabilities. The key…

Machine Learning · Computer Science 2026-05-20 Qisai Liu , Zhanhong Jiang , Timilehin Ayanlade , Ashutosh Kumar Nirala , Yang Li , Aditya Balu , Soumik Sarkar

We study the problem of estimating the optimal Q-function of $\gamma$-discounted Markov decision processes (MDPs) under the synchronous setting, where independent samples for all state-action pairs are drawn from a generative model at each…

Machine Learning · Statistics 2025-05-27 Mohammad Boveiri , Peyman Mohajerin Esfahani

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

Machine Learning · Computer Science 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu

Q-learning is a widely used reinforcement learning (RL) algorithm for optimizing wireless networks, but faces challenges with large state-spaces. Recently proposed multi-environment mixed Q-learning (MEMQ) algorithm addresses these…

Machine Learning · Computer Science 2025-08-25 Talha Bozkus , Urbashi Mitra

Deep reinforcement learning has successfully been applied for molecular discovery as shown by the Molecule Deep Q-network (MolDQN) algorithm. This algorithm has challenges when applied to optimizing new molecules: training such a model is…

Machine Learning · Computer Science 2023-12-05 Huanyi Qin , Denis Akhiyarov , Sophie Loehle , Kenneth Chiu , Mauricio Araya-Polo

We present a novel algorithm to train a deep Q-learning agent using natural-gradient techniques. We compare the original deep Q-network (DQN) algorithm to its natural-gradient counterpart, which we refer to as NGDQN, on a collection of…

Machine Learning · Computer Science 2018-11-15 Ethan Knight , Osher Lerner

This paper introduces the QMDP-net, a neural network architecture for planning under partial observability. The QMDP-net combines the strengths of model-free learning and model-based planning. It is a recurrent policy network, but it…

Artificial Intelligence · Computer Science 2017-11-06 Peter Karkus , David Hsu , Wee Sun Lee

Weakly supervised referring expression comprehension(WREC) and segmentation(WRES) aim to learn object grounding based on a given expression using weak supervision signals like image-text pairs. While these tasks have traditionally been…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Liu , Silin Cheng , Xinwei He , Sebastien Ourselin , Lei Tan , Gen Luo

This paper provides a theoretical understanding of Deep Q-Network (DQN) with the $\varepsilon$-greedy exploration in deep reinforcement learning. Despite the tremendous empirical achievement of the DQN, its theoretical characterization…

Machine Learning · Computer Science 2023-10-26 Shuai Zhang , Hongkang Li , Meng Wang , Miao Liu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Keerthiram Murugesan , Subhajit Chaudhury

Deep Q-Network (DQN) based multi-agent systems (MAS) for reinforcement learning (RL) use various schemes where in the agents have to learn and communicate. The learning is however specific to each agent and communication may be…

Machine Learning · Computer Science 2020-08-11 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

In many real world applications, reinforcement learning agents have to optimize multiple objectives while following certain rules or satisfying a list of constraints. Classical methods based on reward shaping, i.e. a weighted combination of…

Machine Learning · Computer Science 2020-09-15 Gabriel Kalweit , Maria Huegle , Moritz Werling , Joschka Boedecker

In reinforcement learning, it is often difficult to automate high-dimensional, rapid decision-making in dynamic environments, especially when domains require real-time online interaction and adaptive strategies such as web-based games. This…

Machine Learning · Computer Science 2024-05-30 Prabhath Reddy Gujavarthy

Heterogeneity poses a fundamental challenge for many real-world large-scale decision-making problems but remains largely understudied. In this paper, we study the fully heterogeneous setting of a prominent class of such problems, known as…

Machine Learning · Computer Science 2026-01-16 Xiangcheng Zhang , Yige Hong , Weina Wang

With the development of experimental quantum technology, quantum control has attracted increasing attention due to the realization of controllable artificial quantum systems. However, because quantum-mechanical systems are often too…

Quantum Physics · Physics 2022-12-22 Zhikang Wang