English
Related papers

Related papers: A Monte Carlo AIXI Approximation

200 papers

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Bayesian approaches provide a principled solution to the exploration-exploitation trade-off in Reinforcement Learning. Typical approaches, however, either assume a fully observable environment or scale poorly. This work introduces the…

Artificial Intelligence · Computer Science 2018-11-15 Sammie Katt , Frans Oliehoek , Christopher Amato

Tactical decision making for autonomous driving is challenging due to the diversity of environments, the uncertainty in the sensor information, and the complex interaction with other road users. This paper introduces a general framework for…

In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to…

Machine Learning · Computer Science 2024-12-20 Amber Cassimon , Siegfried Mercelis , Kevin Mets

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an…

Machine Learning · Statistics 2022-06-02 Eric Han , Ishank Arora , Jonathan Scarlett

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from the single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For…

Machine Learning · Computer Science 2021-02-03 Conor F. Hayes , Mathieu Reymond , Diederik M. Roijers , Enda Howley , Patrick Mannion

Following a recent surge in using history-based methods for resolving perceptual aliasing in reinforcement learning, we introduce an algorithm based on the feature reinforcement learning framework called PhiMDP. To create a practical…

Artificial Intelligence · Computer Science 2011-08-19 Phuong Nguyen , Peter Sunehag , Marcus Hutter

We propose a reinforcement-learning algorithm to tackle the challenge of reconstructing phylogenetic trees. The search for the tree that best describes the data is algorithmically challenging, thus all current algorithms for phylogeny…

Populations and Evolution · Quantitative Biology 2023-03-14 Dana Azouri , Oz Granit , Michael Alburquerque , Yishay Mansour , Tal Pupko , Itay Mayrose

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

Machine Learning · Computer Science 2021-03-15 Alex J. Chan , Mihaela van der Schaar

Approximate inference in probability models is a fundamental task in machine learning. Approximate inference provides powerful tools to Bayesian reasoning, decision making, and Bayesian deep learning. The main goal is to estimate the…

Machine Learning · Computer Science 2020-03-10 Jun Han

Active inference is a Bayesian framework for understanding biological intelligence. The underlying theory brings together perception and action under one single imperative: minimizing free energy. However, despite its theoretical utility in…

Neurons and Cognition · Quantitative Biology 2020-10-23 Zafeirios Fountas , Noor Sajid , Pedro A. M. Mediano , Karl Friston

We consider a simple approach to solving assortment optimization under the random utility maximization model. The approach uses Monte-Carlo simulation to construct a ranking-based choice model that serves as a proxy for the true choice…

Optimization and Control · Mathematics 2025-10-02 Hassaan Khalid , Bradley Sturt

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

Machine Learning · Computer Science 2020-05-08 Don M. Dini

Adaptive sampling and planning in robotic environmental monitoring are challenging when the target environmental process varies over space and time. The underlying environmental dynamics require the planning module to integrate future…

Robotics · Computer Science 2023-06-19 Weizhe Chen , Lantao Liu

Monte Carlo tree search (MCTS) has received considerable interest due to its spectacular success in the difficult problem of computer Go and also proved beneficial in a range of other domains. A major issue that has received little…

Machine Learning · Computer Science 2019-05-10 Aurelien Pelissier , Atsuyoshi Nakamura , Koji Tabata

Purpose: In recent years Monte-Carlo sampling methods, such as Monte Carlo tree search, have achieved tremendous success in model free reinforcement learning. A combination of the so called upper confidence bounds policy to preserve the…

Artificial Intelligence · Computer Science 2011-10-24 Boris Mitavskiy , Jonathan Rowe , Chris Cannings

Cooperative trajectory planning methods for automated vehicles can solve traffic scenarios that require a high degree of cooperation between traffic participants. However, for cooperative systems to integrate into human-centered traffic,…

Machine Learning · Computer Science 2022-11-15 Karl Kurzer , Matthias Bitzer , J. Marius Zöllner

Finite-horizon lookahead policies are abundantly used in Reinforcement Learning and demonstrate impressive empirical success. Usually, the lookahead policies are implemented with specific planning methods such as Monte Carlo Tree Search…

Machine Learning · Computer Science 2019-02-19 Yonathan Efroni , Gal Dalal , Bruno Scherrer , Shie Mannor

We introduce a theorem proving algorithm that uses practically no domain heuristics for guiding its connection-style proof search. Instead, it runs many Monte-Carlo simulations guided by reinforcement learning from previous proof attempts.…

Artificial Intelligence · Computer Science 2018-05-22 Cezary Kaliszyk , Josef Urban , Henryk Michalewski , Mirek Olšák