English
Related papers

Related papers: Optimizing the Long-Term Behaviour of Deep Reinfor…

200 papers

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained…

Machine Learning · Computer Science 2015-10-16 Hao Yi Ong , Kevin Chavez , Augustus Hong

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

General-purpose trajectory planning algorithms for automated driving utilize complex reward functions to perform a combined optimization of strategic, behavioral, and kinematic features. The specification and tuning of a single reward…

Robotics · Computer Science 2021-05-04 Sascha Rosbach , Xing Li , Simon Großjohann , Silviu Homoceanu , Stefan Roth

Pretraining with expert demonstrations have been found useful in speeding up the training process of deep reinforcement learning algorithms since less online simulation data is required. Some people use supervised learning to speed up the…

Artificial Intelligence · Computer Science 2018-02-12 Xiaoqin Zhang , Huimin Ma

We adopt Deep Reinforcement Learning algorithms to design trading strategies for continuous futures contracts. Both discrete and continuous action spaces are considered and volatility scaling is incorporated to create reward functions which…

Computational Finance · Quantitative Finance 2019-11-25 Zihao Zhang , Stefan Zohren , Stephen Roberts

Self-supervised grasp learning, i.e., learning to grasp by trial and error, has made great progress. However, it is still time-consuming to train such a model and also a challenge to apply it in practice. This work presents an accelerating…

Robotics · Computer Science 2022-05-16 Yanxu Hou , Jun Li

The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve complex tasks effectively. However, learning the models for both low and high-level planning from demonstrations has proven challenging,…

Artificial Intelligence · Computer Science 2023-05-30 Kalle Kujanpää , Joni Pajarinen , Alexander Ilin

Deep reinforcement learning can learn effective policies for a wide range of tasks, but is notoriously difficult to use due to instability and sensitivity to hyperparameters. The reasons for this remain unclear. When using standard…

Machine Learning · Computer Science 2020-03-17 Aviral Kumar , Abhishek Gupta , Sergey Levine

In state of the art model-free off-policy deep reinforcement learning, a replay memory is used to store past experience and derive all network updates. Even if both state and action spaces are continuous, the replay memory only holds a…

Machine Learning · Computer Science 2020-07-16 Sabrina Hoppe , Marc Toussaint

Reinforcement learning (RL) enables agents to take decision based on a reward function. However, in the process of learning, the choice of values for learning algorithm parameters can significantly impact the overall learning process. In…

Neural and Evolutionary Computing · Computer Science 2019-05-13 Adarsh Sehgal , Hung Manh La , Sushil J. Louis , Hai Nguyen

In this paper, we propose a simple and efficient method for value model training on long-context reasoning traces. Compared to existing process reward models (PRMs), our method does not require a fine-grained notion of "step," which is…

Machine Learning · Computer Science 2025-10-01 Kaiwen Wang , Jin Peng Zhou , Jonathan Chang , Zhaolin Gao , Nathan Kallus , Kianté Brantley , Wen Sun

In this paper, we tackle the challenging problem of delayed rewards in reinforcement learning (RL). While Proximal Policy Optimization (PPO) has emerged as a leading Policy Gradient method, its performance can degrade under delayed rewards.…

This paper presents a novel neural network training approach for faster convergence and better generalization abilities in deep reinforcement learning. Particularly, we focus on the enhancement of training and evaluation performance in…

Machine Learning · Computer Science 2020-05-26 Mohammed Sharafath Abdul Hameed , Gavneet Singh Chadha , Andreas Schwung , Steven X. Ding

Visual-inertial systems rely on precise calibrations of both camera intrinsics and inter-sensor extrinsics, which typically require manually performing complex motions in front of a calibration target. In this work we present a novel…

Learning-based methods have been used to pro-gram robotic tasks in recent years. However, extensive training is usually required not only for the initial task learning but also for generalizing the learned model to the same task but in…

Robotics · Computer Science 2019-12-12 Tianying Wang , Hao Zhang , Wei Qi Toh , Hongyuan Zhu , Cheston Tan , Yan Wu , Yong Liu , Wei Jing

Quantifying uncertainty about a policy's long-term performance is important to solve sequential decision-making tasks. We study the problem from a model-based Bayesian reinforcement learning perspective, where the goal is to learn the…

Machine Learning · Computer Science 2024-09-04 Carlos E. Luis , Alessandro G. Bottero , Julia Vinogradska , Felix Berkenkamp , Jan Peters

In many real world applications, reinforcement learning agents have to optimize multiple objectives while following certain rules or satisfying a list of constraints. Classical methods based on reward shaping, i.e. a weighted combination of…

Machine Learning · Computer Science 2020-09-15 Gabriel Kalweit , Maria Huegle , Moritz Werling , Joschka Boedecker

Millions of battery-powered sensors deployed for monitoring purposes in a multitude of scenarios, e.g., agriculture, smart cities, industry, etc., require energy-efficient solutions to prolong their lifetime. When these sensors observe a…

Machine Learning · Computer Science 2021-09-30 Jernej Hribar , Andrei Marinescu , Alessandro Chiumento , Luiz A. DaSilva

With the development of artificial intelligence,more and more financial practitioners apply deep reinforcement learning to financial trading strategies.However,It is difficult to extract accurate features due to the characteristics of…

Trading and Market Microstructure · Quantitative Finance 2022-07-21 Jun-Cheng Chen , Cong-Xiao Chen , Li-Juan Duan , Zhi Cai