English
Related papers

Related papers: Graph Backup: Data Efficient Backup Exploiting Mar…

200 papers

Reinforcement learning is an emerging approaches to facilitate multi-stage sequential decision-making problems. This paper studies a real-time multi-stage stochastic power dispatch considering multivariate uncertainties. Current researches…

Machine Learning · Computer Science 2024-01-24 Bairong Deng , Tao Yu , Zhenning Pan , Xuehan Zhang , Yufeng Wu , Qiaoyi Ding

We present a scalable and effective exploration strategy based on Thompson sampling for reinforcement learning (RL). One of the key shortcomings of existing Thompson sampling algorithms is the need to perform a Gaussian approximation of the…

Machine Learning · Computer Science 2024-03-19 Haque Ishfaq , Qingfeng Lan , Pan Xu , A. Rupam Mahmood , Doina Precup , Anima Anandkumar , Kamyar Azizzadenesheli

This paper studies Reinforcement Learning (RL) techniques to enable team coordination behaviors in graph environments with support actions among teammates to reduce the costs of traversing certain risky edges in a centralized manner. While…

Robotics · Computer Science 2024-03-12 Manshi Limbu , Zechen Hu , Xuan Wang , Daigo Shishika , Xuesu Xiao

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Reinforcement learning (RL) tasks are challenging to implement, execute and test due to algorithmic instability, hyper-parameter sensitivity, and heterogeneous distributed communication patterns. We argue for the separation of logical…

Machine Learning · Computer Science 2019-03-04 Michael Schaarschmidt , Sven Mika , Kai Fricke , Eiko Yoneki

Dynamic grasping of moving objects in complex, continuous motion scenarios remains challenging. Reinforcement Learning (RL) has been applied in various robotic manipulation tasks, benefiting from its closed-loop property. However, existing…

Robotics · Computer Science 2024-10-07 Pengwei Xie , Siang Chen , Qianrun Chen , Wei Tang , Dingchang Hu , Yixiang Dai , Rui Chen , Guijin Wang

Value functions are a central component of deep reinforcement learning (RL). These functions, parameterized by neural networks, are trained using a mean squared error regression objective to match bootstrapped target values. However,…

Graph data structures offer a versatile and powerful means to model relationships and interconnections in various domains, promising substantial advantages in data representation, analysis, and visualization. In games, graph-based data…

Machine Learning · Computer Science 2024-09-10 Florian Rupp , Kai Eckert

Reinforcement Learning (RL) methods used for solving real-world optimization problems often involve dynamic state-action spaces, larger scale, and sparse rewards, leading to significant challenges in convergence, scalability, and efficient…

Machine Learning · Computer Science 2025-09-29 Stavros Orfanoudakis , Nanda Kishor Panda , Peter Palensky , Pedro P. Vergara

In dynamic programming (DP) and reinforcement learning (RL), an agent learns to act optimally in terms of expected long-term return by sequentially interacting with its environment modeled by a Markov decision process (MDP). More generally…

Machine Learning · Computer Science 2022-01-03 Mastane Achab , Gergely Neu

As cyber threats grow increasingly sophisticated, reinforcement learning (RL) is emerging as a promising technique to create intelligent and adaptive cyber defense systems. However, most existing autonomous defensive agents have overlooked…

Machine Learning · Computer Science 2025-04-17 Ilya Orson Sandoval , Isaac Symes Thompson , Vasilios Mavroudis , Chris Hicks

Efficient data transfers over high-speed, long-distance shared networks require proper utilization of available network bandwidth. Using parallel TCP streams enables an application to utilize network parallelism and can improve transfer…

Networking and Internet Architecture · Computer Science 2022-12-02 Hasibul Jamil , Elvis Rodrigues , Jacob Goldverg , Tevfik Kosar

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We consider online reinforcement learning (RL) in episodic Markov decision processes (MDPs) under the linear $q^\pi$-realizability assumption, where it is assumed that the action-values of all policies can be expressed as linear functions…

Machine Learning · Computer Science 2023-12-21 Gellért Weisz , András György , Csaba Szepesvári

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with…

Systems and Control · Computer Science 2018-02-23 Sanket Kamthe , Marc Peter Deisenroth

Deep reinforcement learning (DRL) has been widely used in many important tasks of communication networks. In order to improve the perception ability of DRL on the network, some studies have combined graph neural networks (GNNs) with DRL,…

Cryptography and Security · Computer Science 2025-01-22 Xuzeng Li , Tao Zhang , Jian Wang , Zhen Han , Jiqiang Liu , Jiawen Kang , Dusit Niyato , Abbas Jamalipour

Graph neural networks (GNNs) offer promising learning methods for graph-related tasks. However, GNNs are at risk of adversarial attacks. Two primary limitations of the current evasion attack methods are highlighted: (1) The current…

Machine Learning · Computer Science 2023-02-08 He Zhang , Xingliang Yuan , Chuan Zhou , Shirui Pan

Deep reinforcement learning (deep RL) has been successful in learning sophisticated behaviors automatically; however, the learning process requires a huge number of trials. In contrast, animals can learn new tasks in just a few trials,…

Artificial Intelligence · Computer Science 2016-11-11 Yan Duan , John Schulman , Xi Chen , Peter L. Bartlett , Ilya Sutskever , Pieter Abbeel

The Aircraft Landing Problem (ALP) is one of the challenging problems in aircraft transportation and management. The challenge is to schedule the arriving aircraft in a sequence so that the cost and delays are optimized. There are various…

Machine Learning · Computer Science 2025-03-19 Vatsal Maru

In recent years, data-driven reinforcement learning (RL), also known as offline RL, have gained significant attention. However, the role of data sampling techniques in offline RL has been overlooked despite its potential to enhance online…

Machine Learning · Computer Science 2025-03-24 Jinyi Liu , Yi Ma , Jianye Hao , Yujing Hu , Yan Zheng , Tangjie Lv , Changjie Fan