English
Related papers

Related papers: Dyna-T: Dyna-Q and Upper Confidence Bounds Applied…

200 papers

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

Real-world applications require RL algorithms to act safely. During learning process, it is likely that the agent executes sub-optimal actions that may lead to unsafe/poor states of the system. Exploration is particularly brittle in…

Machine Learning · Statistics 2019-06-17 Elena Smirnova , Elvis Dohmatob , Jérémie Mary

We begin with the hypothesis that a model-free agent whose representations are predictive of properties of future states (beyond expected rewards) will be more capable of solving and adapting to new RL problems. To test that hypothesis, we…

Machine Learning · Computer Science 2020-11-17 Bogdan Mazoure , Remi Tachet des Combes , Thang Doan , Philip Bachman , R Devon Hjelm

Adversarial methods for imitation learning have been shown to perform well on various control tasks. However, they require a large number of environment interactions for convergence. In this paper, we propose an end-to-end differentiable…

Machine Learning · Computer Science 2019-03-11 Vaibhav Saxena , Srinivasan Sivanandan , Pulkit Mathur

In reinforcement learning, an agent interacts sequentially with an environment to maximize a reward, receiving only partial, probabilistic feedback. This creates a fundamental exploration-exploitation trade-off: the agent must explore to…

Quantum Physics · Physics 2026-03-27 Josep Lumbreras , Ruo Cheng Huang , Yanglin Hu , Marco Fanizza , Mile Gu

We propose the Thinker algorithm, a novel approach that enables reinforcement learning agents to autonomously interact with and utilize a learned world model. The Thinker algorithm wraps the environment with a world model and introduces new…

Artificial Intelligence · Computer Science 2023-10-30 Stephen Chung , Ivan Anokhin , David Krueger

Model-Free Reinforcement Learning (RL) algorithms either learn how to map states to expected rewards or search for policies that can maximize a certain performance function. Model-Based algorithms instead, aim to learn an approximation of…

Machine Learning · Computer Science 2024-11-19 Juan Cardenas-Cartagena , Massimiliano Falzari , Marco Zullich , Matthia Sabatelli

Dynamic portfolio optimization is the process of sequentially allocating wealth to a collection of assets in some consecutive trading periods, based on investors' return-risk profile. Automating this process with machine learning remains a…

Machine Learning · Computer Science 2019-01-28 Pengqian Yu , Joon Sern Lee , Ilya Kulyatin , Zekun Shi , Sakyasingha Dasgupta

This study focuses on the development of a simulation-driven reinforcement learning (RL) framework for optimizing routing decisions in complex queueing network systems, with a particular emphasis on manufacturing and communication…

Artificial Intelligence · Computer Science 2025-07-28 Fatima Al-Ani , Molly Wang , Jevon Charles , Aaron Ong , Joshua Forday , Vinayak Modi

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li

The decision and planning system for autonomous driving in urban environments is hard to design. Most current methods manually design the driving policy, which can be expensive to develop and maintain at scale. Instead, with imitation…

Robotics · Computer Science 2019-10-15 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

Rather than learning new control policies for each new task, it is possible, when tasks share some structure, to compose a "meta-policy" from previously learned policies. This paper reports results from experiments using Deep Reinforcement…

Artificial Intelligence · Computer Science 2017-11-07 Richard Liaw , Sanjay Krishnan , Animesh Garg , Daniel Crankshaw , Joseph E. Gonzalez , Ken Goldberg

When function approximation is deployed in reinforcement learning (RL), the same problem may be formulated in different ways, often by treating a pre-processing step as a part of the environment or as part of the agent. As a consequence,…

Machine Learning · Computer Science 2020-06-02 Nan Jiang

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Transformer models have achieved remarkable empirical successes, largely due to their in-context learning capabilities. Inspired by this, we explore training an autoregressive transformer for in-context reinforcement learning (ICRL). In…

Machine Learning · Computer Science 2026-01-29 Juncheng Dong , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

Training generally capable agents that thoroughly explore their environment and learn new and diverse skills is a long-term goal of robot learning. Quality Diversity Reinforcement Learning (QD-RL) is an emerging research area that blends…

Machine Learning · Computer Science 2024-01-31 Sumeet Batra , Bryon Tjanaka , Matthew C. Fontaine , Aleksei Petrenko , Stefanos Nikolaidis , Gaurav Sukhatme

Expert Iteration (ExIt) is an effective framework for learning game-playing policies from self-play. ExIt involves training a policy to mimic the search behaviour of a tree search algorithm - such as Monte-Carlo tree search - and using the…

Machine Learning · Computer Science 2020-06-02 Dennis J. N. J. Soemers , Éric Piette , Matthew Stephenson , Cameron Browne

When the agent's observations or interactions are delayed, classic reinforcement learning tools usually fail. In this paper, we propose a simple yet new and efficient solution to this problem. We assume that, in the undelayed environment,…

Machine Learning · Computer Science 2022-05-12 Pierre Liotet , Davide Maran , Lorenzo Bisi , Marcello Restelli

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-09-10 Mingxuan Li , Junzhe Zhang , Elias Bareinboim