English
Related papers

Related papers: Combining Model-Free Q-Ensembles and Model-Based A…

200 papers

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

Machine Learning · Computer Science 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

We study the use of hypermodels to represent epistemic uncertainty and guide exploration. This generalizes and extends the use of ensembles to approximate Thompson sampling. The computational cost of training an ensemble grows with its…

Machine Learning · Computer Science 2020-06-16 Vikranth Dwaracherla , Xiuyuan Lu , Morteza Ibrahimi , Ian Osband , Zheng Wen , Benjamin Van Roy

We study the problem of exploration in Reinforcement Learning and present a novel model-free solution. We adopt an information-theoretical viewpoint and start from the instance-specific lower bound of the number of samples that have to be…

Machine Learning · Computer Science 2024-07-02 Alessio Russo , Alexandre Proutiere

Reinforcement learning holds tremendous promise in accelerator controls. The primary goal of this paper is to show how this approach can be utilised on an operational level on accelerator physics problems. Despite the success of model-free…

Machine Learning · Computer Science 2022-01-27 Simon Hirlaender , Niky Bruchon

The development of machine learning algorithms has been gathering relevance to address the increasing modelling complexity of manufacturing decision-making problems. Reinforcement learning is a methodology with great potential due to the…

Machine Learning · Computer Science 2023-04-18 Miguel Neves , Miguel Vieira , Pedro Neto

Model-based representations recently stand out as a promising framework that embeds latent dynamics information into the representations for downstream off-policy actor-critic learning. It implicitly combines the advantages of both…

Machine Learning · Computer Science 2026-05-13 Jiafei Lyu , Zichuan Lin , Scott Fujimoto , Kai Yang , Yangkun Chen , Saiyong Yang , Zongqing Lu , Deheng Ye

Recent advances in model-free deep reinforcement learning (DRL) show that simple model-free methods can be highly effective in challenging high-dimensional continuous control tasks. In particular, Truncated Quantile Critics (TQC) achieves…

Machine Learning · Computer Science 2022-11-18 Yanqiu Wu , Xinyue Chen , Che Wang , Yiming Zhang , Keith W. Ross

Exploration is a key challenge in Reinforcement Learning, especially in long-horizon, deceptive and sparse-reward environments. For such applications, population-based approaches have proven effective. Methods such as Quality-Diversity…

Neural and Evolutionary Computing · Computer Science 2022-11-24 Bryan Lim , Manon Flageat , Antoine Cully

An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets.…

Materials Science · Physics 2025-05-02 Daniel Schwalbe-Koda , Sebastien Hamel , Babak Sadigh , Fei Zhou , Vincenzo Lordi

Deep reinforcement learning techniques have demonstrated superior performance in a wide variety of environments. As improvements in training algorithms continue at a brisk pace, theoretical or empirical studies on understanding what these…

Machine Learning · Computer Science 2018-11-16 Raghuram Mandyam Annasamy , Katia Sycara

When applying Dynamic Power Management (DPM) technique to pervasively deployed embedded systems, the technique needs to be very efficient so that it is feasible to implement the technique on low end processor and tight-budget memory.…

Other Computer Science · Computer Science 2011-11-09 Min Li , Xiaobo Wu , Richard Yao , Xiaolang Yan

Model-based reinforcement learning uses models to plan, where the predictions and policies of an agent can be improved by using more computation without additional data from the environment, thereby improving sample efficiency. However,…

Machine Learning · Computer Science 2023-02-22 Animesh Kumar Paul , Videh Raj Nema

Reinforcement learning has witnessed significant advancements, particularly with the emergence of model-based approaches. Among these, $Q$-learning has proven to be a powerful algorithm in model-free settings. However, the extension of…

Machine Learning · Computer Science 2026-03-31 Han-Dong Lim , HyeAnn Lee , Donghwan Lee

With the recent growth in data availability and complexity, and the associated outburst of elaborate modelling approaches, model selection tools have become a lifeline, providing objective criteria to deal with this increasingly challenging…

Methodology · Statistics 2020-10-08 Alessandro Casa , Luca Scrucca , Giovanna Menardi

Guided exploration with expert demonstrations improves data efficiency for reinforcement learning, but current algorithms often overuse expert information. We propose a novel algorithm to speed up Q-learning with the help of a limited…

Machine Learning · Computer Science 2022-10-06 Fengdi Che , Xiru Zhu , Doina Precup , David Meger , Gregory Dudek

Our work aimed at experimentally assessing the benefits of model ensembling within the context of neural methods for passage reranking. Starting from relatively standard neural models, we use a previous technique named Fast Geometric…

Information Retrieval · Computer Science 2021-01-22 Luís Borges , Bruno Martins , Jamie Callan

A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular examples are…

Machine Learning · Statistics 2022-02-25 Maksim Velikanov , Roman Kail , Ivan Anokhin , Roman Vashurin , Maxim Panov , Alexey Zaytsev , Dmitry Yarotsky

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

Machine Learning · Computer Science 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius

Recent success in deep reinforcement learning for continuous control has been dominated by model-free approaches which, unlike model-based approaches, do not suffer from representational limitations in making assumptions about the world…

Machine Learning · Computer Science 2019-05-07 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter
‹ Prev 1 2 3 10 Next ›