English
Related papers

Related papers: Investigating Recurrence and Eligibility Traces in…

200 papers

Intelligent systems have the ability to improve their behaviour over time taking observations, experiences or explicit feedback into account. Traditional approaches separate the learning problem and make isolated use of techniques from…

Machine Learning · Computer Science 2022-01-12 Simon Reichhuber , Sven Tomforde

Machine learning with artificial neural networks is revolutionizing science. The most advanced challenges require discovering answers autonomously. This is the domain of reinforcement learning, where control strategies are improved…

Quantum Physics · Physics 2018-10-03 Thomas Fösel , Petru Tighineanu , Talitha Weiss , Florian Marquardt

Reinforcement learning aims to learn optimal policies from interaction with environments whose dynamics are unknown. Many methods rely on the approximation of a value function to derive near-optimal policies. In partially observable…

Machine Learning · Computer Science 2022-09-13 Gaspard Lambrechts , Adrien Bolland , Damien Ernst

The vast majority of Reinforcement Learning methods is largely impacted by the computation effort and data requirements needed to obtain effective estimates of action-value functions, which in turn determine the quality of the overall…

Machine Learning · Computer Science 2025-04-04 Théo Vincent , Daniel Palenicek , Boris Belousov , Jan Peters , Carlo D'Eramo

In reinforcement learning, the advantage function is critical for policy improvement, but is often extracted from a learned Q-function. A natural question is: Why not learn the advantage function directly? In this work, we introduce…

Machine Learning · Computer Science 2024-09-04 Yunhao Tang , Rémi Munos , Mark Rowland , Michal Valko

The recent breakthroughs of deep reinforcement learning (DRL) technique in Alpha Go and playing Atari have set a good example in handling large state and actions spaces of complicated control problems. The DRL technique is comprised of (i)…

Artificial Intelligence · Computer Science 2017-10-12 Hongjia Li , Tianshu Wei , Ao Ren , Qi Zhu , Yanzhi Wang

Experience replay is a key component in reinforcement learning for stabilizing learning and improving sample efficiency. Its typical implementation samples transitions with replacement from a replay buffer. In contrast, in supervised…

Machine Learning · Computer Science 2025-12-05 Yasuhiro Fujita

Deep neural networks are revolutionizing the way complex systems are developed. However, these automatically-generated networks are opaque to humans, making it difficult to reason about them and guarantee their correctness. Here, we propose…

Artificial Intelligence · Computer Science 2020-08-11 Yuval Jacoby , Clark Barrett , Guy Katz

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive…

Artificial Intelligence · Computer Science 2018-02-12 Daniel J. Mankowitz , Timothy A. Mann , Pierre-Luc Bacon , Doina Precup , Shie Mannor

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Building upon the recent success of deep reinforcement learning methods, we investigate the possibility of on-policy reinforcement learning improvement by reusing the data from several consecutive policies. On-policy methods bring many…

Machine Learning · Computer Science 2019-01-21 Dmitry Kangin , Nicolas Pugeault

Random access (RA) schemes are a topic of high interest in machine-type communication (MTC). In RA protocols, backoff techniques such as exponential backoff (EB) are used to stabilize the system to avoid low throughput and excessive delays.…

Information Theory · Computer Science 2022-01-25 Muhammad Awais Jadoon , Adriano Pastore , Monica Navarro , Fernando Perez-Cruz

Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning…

Computation and Language · Computer Science 2016-07-15 Giulio Petrucci , Chiara Ghidini , Marco Rospocher

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Deep Generative AI has been a long-standing essential topic in the machine learning community, which can impact a number of application areas like text generation and computer vision. The major paradigm to train a generative model is…

Machine Learning · Computer Science 2025-02-25 Yuanjiang Cao , Quan Z. Sheng , Julian McAuley , Lina Yao

The options framework is a popular approach for building temporally extended actions in reinforcement learning. In particular, the option-critic architecture provides general purpose policy gradient theorems for learning actions from…

Machine Learning · Computer Science 2020-02-07 Matthew Riemer , Ignacio Cases , Clemens Rosenbaum , Miao Liu , Gerald Tesauro

This paper introduces a method for constructing an upper bound for exploration policy using either the weighted variance of return sequences or the weighted temporal difference (TD) error. We demonstrate that the variance of the return…

Machine Learning · Computer Science 2020-11-18 Zerong Xi , Gita Sukthankar

Imitation Learning is a promising area of active research. Over the last 30 years, Imitation Learning has advanced significantly and been used to solve difficult tasks ranging from Autonomous Driving to playing Atari games. In the course of…

Machine Learning · Computer Science 2020-01-09 Nishanth Kumar

Course enrollment recommendation is a relevant task that helps university students decide what is the best combination of courses to enroll in the next term. In particular, recommender system techniques like matrix factorization and…

Computers and Society · Computer Science 2020-11-26 Nicolas Araque , Germano Rojas , Maria Vitali

In light of the emergence of deep reinforcement learning (DRL) in recommender systems research and several fruitful results in recent years, this survey aims to provide a timely and comprehensive overview of the recent trends of deep…

Information Retrieval · Computer Science 2021-09-10 Xiaocong Chen , Lina Yao , Julian McAuley , Guanglin Zhou , Xianzhi Wang