English
Related papers

Related papers: Measurable Monte Carlo Search Error Bounds

200 papers

Online reinforcement learning in infinite-horizon Markov decision processes (MDPs) remains less theoretically and algorithmically developed than its episodic counterpart, with many algorithms suffering from high ``burn-in'' costs and…

Machine Learning · Computer Science 2026-03-26 Guy Zamir , Matthew Zurek , Yudong Chen

Standard approaches for global optimization of non-convex functions, such as branch-and-bound, maintain partition trees to systematically prune the domain. The tree size grows exponentially in the number of dimensions. We propose new…

Artificial Intelligence · Computer Science 2024-02-21 Yaoguang Zhai , Zhizhen Qin , Sicun Gao

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

We study nonparametric contextual bandits under batch constraints, where the expected reward for each action is modeled as a smooth function of covariates, and the policy updates are made at the end of each batch of observations. We…

Statistics Theory · Mathematics 2025-10-06 Rong Jiang , Cong Ma

We study the logistic bandit, in which rewards are binary with success probability $\exp(\beta a^\top \theta) / (1 + \exp(\beta a^\top \theta))$ and actions $a$ and coefficients $\theta$ are within the $d$-dimensional unit ball. While prior…

Machine Learning · Statistics 2019-05-14 Shi Dong , Tengyu Ma , Benjamin Van Roy

We consider multi-dimensional Markov decision processes and formulate a long term discounted reward optimization problem. Two simulation based algorithms---Monte Carlo rollout policy and parallel rollout policy are studied, and various…

Systems and Control · Electrical Eng. & Systems 2020-07-28 Rahul Meshram , Kesav Kaza

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

Artificial Intelligence · Computer Science 2012-07-25 David Tolpin , Solomon Eyal Shimony

MCMC methods are used in Bayesian statistics not only to sample from posterior distributions but also to estimate expectations. Underlying functions are most often defined on a continuous state space and can be unbounded. We consider a…

Methodology · Statistics 2009-07-29 Krzysztof Latuszynski , Blazej Miasojedow , Wojciech Niemiro

Thompson Sampling is one of the oldest heuristics for multi-armed bandit problems. It is a randomized algorithm based on Bayesian ideas, and has recently generated significant interest after several studies demonstrated it to have better…

Machine Learning · Computer Science 2012-09-18 Shipra Agrawal , Navin Goyal

For real symmetric matrices that are accessible only through matrix vector products, we present Monte Carlo estimators for computing the diagonal elements. Our probabilistic bounds for normwise absolute and relative errors apply to Monte…

Numerical Analysis · Mathematics 2022-03-18 Eric Hallman , Ilse C. F. Ipsen , Arvind Saibaba

In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose $p$-th moment is bounded by a constant $\nu_{p}$ for $1<p\leq2$. First, we propose a novel robust estimator which does not require $\nu_{p}$…

Machine Learning · Computer Science 2021-10-28 Kyungjae Lee , Hongjun Yang , Sungbin Lim , Songhwai Oh

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

Approximate Bayesian computation allows for inference of complicated probabilistic models with intractable likelihoods using model simulations. The Markov chain Monte Carlo implementation of approximate Bayesian computation is often…

Computation · Statistics 2019-05-17 Matti Vihola , Jordan Franks

Monte Carlo Tree Search (MCTS) is an immensely popular search-based framework used for decision making. It is traditionally applied to domains where a perfect simulation model of the environment is available. We study and improve MCTS in…

Artificial Intelligence · Computer Science 2024-05-24 Farnaz Kohankhaki , Kiarash Aghakasiri , Hongming Zhang , Ting-Han Wei , Chao Gao , Martin Müller

The optimized certainty equivalent (OCE) is a family of risk measures that cover important examples such as entropic risk, conditional value-at-risk and mean-variance models. In this paper, we propose a new episodic risk-sensitive…

Machine Learning · Computer Science 2023-06-09 Wenhao Xu , Xuefeng Gao , Xuedong He

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

Machine Learning · Computer Science 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

We study how to make decisions that minimize Bayesian regret in offline linear bandits. Prior work suggests that one must take actions with maximum lower confidence bound (LCB) on their reward. We argue that the reliance on LCB is…

Machine Learning · Computer Science 2024-07-04 Marek Petrik , Guy Tennenholtz , Mohammad Ghavamzadeh

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

Machine Learning · Statistics 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier