English
Related papers

Related papers: Dealing with Unknown Variances in Best-Arm Identif…

200 papers

Decision-making under uncertainty is a fundamental problem encountered frequently and can be formulated as a stochastic multi-armed bandit problem. In the problem, the learner interacts with an environment by choosing an action at each…

Machine Learning · Statistics 2024-05-24 Jonathan Gornet , Bruno Sinopoli

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

Machine Learning · Computer Science 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

We propose a general framework for studying optimal impulse control problem in the presence of uncertainty on the parameters. Given a prior on the distribution of the unknown parameters, we explain how it should evolve according to the…

Probability · Mathematics 2017-12-06 N. Baradel , B. Bouchard , Ngoc Minh Dang

In the best choice problem with random arrivals, an unknown number $n$ of rankable items arrive at times sampled from the uniform distribution. As is well known, a real-time player can ensure stopping at the overall best item with…

Probability · Mathematics 2021-03-09 Alexander Gnedin

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

Machine Learning · Computer Science 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

We introduce the safe best-arm identification framework with linear feedback, where the agent is subject to some stage-wise safety constraint that linearly depends on an unknown parameter vector. The agent must take actions in a…

Machine Learning · Statistics 2023-09-19 Xuedong Shang , Igor Colin , Merwan Barlier , Hamza Cherkaoui

Uncertainty quantification is a critical aspect of machine learning models, providing important insights into the reliability of predictions and aiding the decision-making process in real-world applications. This paper proposes a novel way…

Machine Learning · Computer Science 2024-01-02 Yusuf Sale , Paul Hofman , Lisa Wimmer , Eyke Hüllermeier , Thomas Nagler

We study the recovering bandits problem, a variant of the stochastic multi-armed bandit problem where the expected reward of each arm varies according to some unknown function of the time since the arm was last played. While being a natural…

Machine Learning · Statistics 2019-11-01 Ciara Pike-Burke , Steffen Grünewälder

We propose the first fully-adaptive algorithm for pure exploration in linear bandits---the task to find the arm with the largest expected reward, which depends on an unknown parameter linearly. While existing methods partially or entirely…

Machine Learning · Statistics 2017-10-17 Liyuan Xu , Junya Honda , Masashi Sugiyama

We propose a new problem setting to study the sequential interactions between a recommender system and a user. Instead of assuming the user is omniscient, static, and explicit, as the classical practice does, we sketch a more realistic user…

Machine Learning · Computer Science 2021-10-08 Fan Yao , Chuanhao Li , Denis Nekipelov , Hongning Wang , Haifeng Xu

We propose an open loop methodology based on sample statistics to solve chance constrained stochastic optimal control problems with probabilistic safety guarantees for linear systems where the additive Gaussian noise has unknown mean and…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Shawn Priore , Meeko Oishi

This paper targets a variant of the stochastic multi-armed bandit problem called good arm identification (GAI). GAI is a pure-exploration bandit problem with the goal to output as many good arms using as few samples as possible, where a…

Machine Learning · Computer Science 2024-02-19 Yun-Da Tsai , Tzu-Hsien Tsai , Shou-De Lin

We study best-arm identification (BAI) in the fixed-budget setting. Adaptive allocations based on upper confidence bounds (UCBs), such as UCBE, are known to work well in BAI. However, it is well-known that its optimal regret is…

Machine Learning · Computer Science 2024-10-24 Rong J. B. Zhu , Yanqi Qiu

Bayesian optimisation requires fitting a Gaussian process model, which in turn requires specifying prior on the unknown black-box function -- most of the theoretical literature assumes this prior is known. However, it is common to have more…

Machine Learning · Computer Science 2025-02-25 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset $S \subseteq \R^d$. This core problem in truncated statistics has long history going back to…

Statistics Theory · Mathematics 2019-08-06 Vasilis Kontonis , Christos Tzamos , Manolis Zampetakis

We consider a non-stationary formulation of the stochastic multi-armed bandit where the rewards are no longer assumed to be identically distributed. For the best-arm identification task, we introduce a version of Successive Elimination…

Artificial Intelligence · Computer Science 2016-09-09 Robin Allesiardo , Raphaël Féraud , Odalric-Ambrym Maillard

We study the problem of minimising regret in two-armed bandit problems with Gaussian rewards. Our objective is to use this simple setting to illustrate that strategies based on an exploration phase (up to a stopping time) followed by…

Statistics Theory · Mathematics 2016-11-15 Aurélien Garivier , Emilie Kaufmann , Tor Lattimore

Agent behavior is arguably the greatest source of uncertainty in trajectory planning for autonomous vehicles. This problem has motivated significant amounts of work in the behavior prediction community on learning rich distributions of the…

Robotics · Computer Science 2020-07-16 Allen Wang , Ashkan Jasour , Brian Williams

State of the art online learning procedures focus either on selecting the best alternative ("best arm identification") or on minimizing the cost (the "regret"). We merge these two objectives by providing the theoretical analysis of cost…

Machine Learning · Computer Science 2019-02-27 Rémy Degenne , Thomas Nedelec , Clément Calauzènes , Vianney Perchet

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability…

Machine Learning · Computer Science 2017-05-30 Chao Qin , Diego Klabjan , Daniel Russo