English
Related papers

Related papers: Visualizing Dynamics: from t-SNE to SEMI-MDPs

200 papers

Deep Reinforcement Learning (DRL) is emerging as a promising approach to generate adaptive behaviors for robotic platforms. However, a major drawback of using DRL is the data-hungry training regime that requires millions of trial and error…

The Fleet Size and Mix Vehicle Routing Problem (FSMVRP) is a prominent variant of the Vehicle Routing Problem (VRP), extensively studied in operations research and computational science. FSMVRP requires simultaneous decisions on fleet…

Artificial Intelligence · Computer Science 2026-01-01 Pengfu Wan , Jiawei Chen , Gangyan Xu

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of…

Machine Learning · Computer Science 2018-05-22 Zichuan Lin , Tianqi Zhao , Guangwen Yang , Lintao Zhang

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Neural networks are effective function approximators, but hard to train in the reinforcement learning (RL) context mainly because samples are correlated. For years, scholars have got around this by employing experience replay or an…

Machine Learning · Computer Science 2020-05-06 Budi Kurniawan , Peter Vamplew , Michael Papasimeon , Richard Dazeley , Cameron Foale

Deep reinforcement learning (DRL) brings the power of deep neural networks to bear on the generic task of trial-and-error learning, and its effectiveness has been convincingly demonstrated on tasks such as Atari video games and the game of…

Artificial Intelligence · Computer Science 2016-10-04 Marta Garnelo , Kai Arulkumaran , Murray Shanahan

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

Machine Learning · Computer Science 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu

Deep reinforcement learning is a technique for solving problems in a variety of environments, ranging from Atari video games to stock trading. This method leverages deep neural network models to make decisions based on observations of a…

Machine Learning · Computer Science 2022-09-13 Anthony Dowling

While reinforcement learning has been increasingly applied to stochastic control, few studies have systematically examined policy-based methods in queuing environments modeled as a semi-Markov decision process (SMDP). To address this gap,…

Optimization and Control · Mathematics 2026-04-28 Joseph Walton , Gabriel Nicolosi

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement learning (RL) in…

Machine Learning · Computer Science 2022-12-08 Chao Li

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

Machine Learning · Computer Science 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

Recent work applying deep reinforcement learning (DRL) to solve traveling salesman problems (TSP) has shown that DRL-based solvers can be fast and competitive with TSP heuristics for small instances, but do not generalize well to larger…

Machine Learning · Computer Science 2021-10-07 Wenbin Ouyang , Yisen Wang , Shaochen Han , Zhejian Jin , Paul Weng

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

Systems and Control · Electrical Eng. & Systems 2022-05-19 Shambhuraj Sawant , Sebastien Gros

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

Artificial Intelligence · Computer Science 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

Despite of achieving great success in real-world applications, Deep Reinforcement Learning (DRL) is still suffering from three critical issues, i.e., data efficiency, lack of the interpretability and transferability. Recent research shows…

Artificial Intelligence · Computer Science 2023-07-10 Hankz Hankui Zhuo , Shuting Deng , Mu Jin , Zhihao Ma , Kebing Jin , Chen Chen , Chao Yu

Efficient planning of activities is essential for modern industrial assembly lines to uphold manufacturing standards, prevent project constraint violations, and achieve cost-effective operations. While exact solutions to such challenges can…

Artificial Intelligence · Computer Science 2025-07-23 Ali Mohamed Ali , Luca Tirel , Hashim A. Hashim

Representations are at the core of all deep reinforcement learning (RL) methods for both Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs). Many representation learning methods and theoretical…

Machine Learning · Computer Science 2024-04-23 Tianwei Ni , Benjamin Eysenbach , Erfan Seyedsalehi , Michel Ma , Clement Gehring , Aditya Mahajan , Pierre-Luc Bacon

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

Machine Learning · Computer Science 2023-11-21 Ukjo Hwang , Songnam Hong