English
Related papers

Related papers: Asynchronous Episodic Deep Deterministic Policy Gr…

200 papers

Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.…

Robotics · Computer Science 2018-11-28 Linhai Xie , Yishu Miao , Sen Wang , Phil Blunsom , Zhihua Wang , Changhao Chen , Andrew Markham , Niki Trigoni

In continuous action domains, standard deep reinforcement learning algorithms like DDPG suffer from inefficient exploration when facing sparse or deceptive reward problems. Conversely, evolutionary and developmental methods focusing on…

Machine Learning · Computer Science 2018-09-21 Cédric Colas , Olivier Sigaud , Pierre-Yves Oudeyer

This paper tackles the challenge of learning non-Markovian optimal execution strategies in dynamic financial markets. We introduce a novel actor-critic algorithm based on Deep Deterministic Policy Gradient (DDPG) to address this issue, with…

Machine Learning · Computer Science 2024-10-18 Alessandro Micheli , Mélodie Monod

Episodic control enables sample efficiency in reinforcement learning by recalling past experiences from an episodic memory. We propose a new model-based episodic memory of trajectories addressing current limitations of episodic control. Our…

Machine Learning · Computer Science 2021-11-09 Hung Le , Thommen Karimpanal George , Majid Abdolshah , Truyen Tran , Svetha Venkatesh

We present a novel technique called Dynamic Experience Replay (DER) that allows Reinforcement Learning (RL) algorithms to use experience replay samples not only from human demonstrations but also successful transitions generated by RL…

Artificial Intelligence · Computer Science 2020-10-19 Jieliang Luo , Hui Li

Quantum reinforcement learning (QRL) is a promising paradigm for near-term quantum devices. While existing QRL methods have shown success in discrete action spaces, extending these techniques to continuous domains is challenging due to the…

Quantum Physics · Physics 2025-03-19 Shaojun Wu , Shan Jin , Dingding Wen , Donghong Han , Xiaoting Wang

Recently, neuro-inspired episodic control (EC) methods have been developed to overcome the data-inefficiency of standard deep reinforcement learning approaches. Using non-/semi-parametric models to estimate the value function, they learn…

Machine Learning · Computer Science 2019-11-22 Andrea Agostinelli , Kai Arulkumaran , Marta Sarrico , Pierre Richemond , Anil Anthony Bharath

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

Reach-Avoid-Stay (RAS) optimal control enables systems such as robots and air taxis to reach their targets, avoid obstacles, and stay near the target. However, current methods for RAS often struggle with handling complex, dynamic…

Systems and Control · Electrical Eng. & Systems 2024-10-10 Gabriel Chenevert , Jingqi Li , Achyuta kannan , Sangjae Bae , Donggun Lee

The growth of deep reinforcement learning (RL) has brought multiple exciting tools and methods to the field. This rapid expansion makes it important to understand the interplay between individual elements of the RL toolbox. We approach this…

A fascinating aspect of nature lies in its ability to produce a large and diverse collection of organisms that are all high-performing in their niche. By contrast, most AI algorithms focus on finding a single efficient solution to a given…

Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be copied to autonomous driving because the state spaces in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Sen Wang , Daoyuan Jia , Xinshuo Weng

In reinforcement learning, reward shaping is an efficient way to guide the learning process of an agent, as the reward can indicate the optimal policy of the task. The potential-based reward shaping framework was proposed to guarantee…

Robotics · Computer Science 2024-02-08 Yifei Chen , Lambert Schomaker , Francisco Cruz

Model-free reinforcement learning algorithms such as Deep Deterministic Policy Gradient (DDPG) often require additional exploration strategies, especially if the actor is of deterministic nature. This work evaluates the use of model-based…

Machine Learning · Computer Science 2019-11-19 Kevin Sebastian Luck , Mel Vecerik , Simon Stepputtis , Heni Ben Amor , Jonathan Scholz

Unmanned aerial vehicles (UAVs) have been widely used in military warfare. In this paper, we formulate the autonomous motion control (AMC) problem as a Markov decision process (MDP) and propose an advanced deep reinforcement learning (DRL)…

Artificial Intelligence · Computer Science 2022-07-05 Zijian Hu , Xiaoguang Gao , Kaifang Wan , Qianglong Wang , Yiwei Zhai

This study focuses on the development of a simulation-driven reinforcement learning (RL) framework for optimizing routing decisions in complex queueing network systems, with a particular emphasis on manufacturing and communication…

Artificial Intelligence · Computer Science 2025-07-28 Fatima Al-Ani , Molly Wang , Jevon Charles , Aaron Ong , Joshua Forday , Vinayak Modi

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

Many cooperative multi-agent problems require agents to learn individual tasks while contributing to the collective success of the group. This is a challenging task for current state-of-the-art multi-agent reinforcement algorithms that are…

Multiagent Systems · Computer Science 2020-03-25 Hassam Ullah Sheikh , Ladislau Bölöni

Federated learning (FL) is a viable technique to train a shared machine learning model without sharing data. Hierarchical FL (HFL) system has yet to be studied regrading its multiple levels of energy, computation, communication, and client…

Machine Learning · Computer Science 2024-06-24 Xiaojing Chen , Zhenyuan Li , Wei Ni , Xin Wang , Shunqing Zhang , Yanzan Sun , Shugong Xu , Qingqi Pei

We propose a metalearning approach for learning gradient-based reinforcement learning (RL) algorithms. The idea is to evolve a differentiable loss function, such that an agent, which optimizes its policy to minimize this loss, will achieve…

Machine Learning · Computer Science 2018-05-01 Rein Houthooft , Richard Y. Chen , Phillip Isola , Bradly C. Stadie , Filip Wolski , Jonathan Ho , Pieter Abbeel