English
Related papers

Related papers: Quantum spatial best-arm identification via quantu…

200 papers

We propose a new strategy for best-arm identification with fixed confidence of Gaussian variables with bounded means and unit variance. This strategy, called Exploration-Biased Sampling, is not only asymptotically optimal: it is to the best…

Statistics Theory · Mathematics 2022-03-08 Antoine Barrier , Aurélien Garivier , Tomáš Kocák

This paper studies a class of constrained restless multi-armed bandits (CRMAB). The constraints are in the form of time varying set of actions (set of available arms). This variation can be either stochastic or semi-deterministic. Given a…

Systems and Control · Computer Science 2021-09-07 Kesav Kaza , Rahul Meshram , Varun Mehta , S. N. Merchant

In this paper, we solve the arms exponential exploding issue in multivariate Multi-Armed Bandit (Multivariate-MAB) problem when the arm dimension hierarchy is considered. We propose a framework called path planning (TS-PP) which utilizes…

Machine Learning · Computer Science 2022-08-19 Keyu Nie , Zezhong Zhang , Ted Tao Yuan , Rong Song , Pauline Berry Burke

This paper studies the problem of adaptively sampling from K distributions (arms) in order to identify the largest gap between any two adjacent means. We call this the MaxGap-bandit problem. This problem arises naturally in approximate…

Machine Learning · Statistics 2019-06-04 Sumeet Katariya , Ardhendu Tripathy , Robert Nowak

The Maximum Matching problem has a quantum query complexity lower bound of $\Omega(n^{3/2})$ for graphs on $n$ vertices represented by an adjacency matrix. The current best quantum algorithm has the query complexity $O(n^{7/4})$, which is…

Quantum Physics · Physics 2025-10-31 Alcides Gomes Andrade Júnior , Akira Matsubayashi

Pure exploration in multi-armed bandits has emerged as an important framework for modeling decision-making and search under uncertainty. In modern applications, however, one is often faced with a tremendously large number of options. Even…

Machine Learning · Computer Science 2022-11-22 Parth K. Thaker , Mohit Malu , Nikhil Rao , Gautam Dasarathy

In this work, we unify several quantum algorithmic frameworks for boolean functions that are based on the quantum adversary bound. First, we show that the $st$-connectivity framework subsumes the (adaptive/extended) learning graph…

Quantum Physics · Physics 2026-02-10 Arjan Cornelissen

Spatial search is an important problem in quantum computation, which aims to find a marked vertex on a graph. We propose a novel approach for designing deterministic quantum search algorithms on a variety of graphs via alternating quantum…

Quantum Physics · Physics 2023-08-25 Qingwen Wang , Ying Jiang , Shiguang Feng , Lvzhou Li

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

Machine Learning · Computer Science 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

This paper investigates the performance of the emerging non-variational Quantum Walk-based Optimisation Algorithm (NV-QWOA) for solving small instances of the Quadratic Assignment Problem (QAP). NV-QWOA is benchmarked against classical…

Quantum Physics · Physics 2026-01-06 Andrew Freeland , Jingbo Wang

Quantum walks have emerged as a transformative paradigm in quantum information processing and can be applied to various graph problems. This study explores discrete-time quantum walks on simplicial complexes, a higher-order generalization…

Quantum Physics · Physics 2024-05-24 Euijun Song

We investigate the sample complexity of learning the optimal arm for multi-task bandit problems. Arms consist of two components: one that is shared across tasks (that we call representation) and one that is task-specific (that we call…

Machine Learning · Statistics 2022-11-29 Alessio Russo , Alexandre Proutiere

We consider the problem of best arm identification in the multi-armed bandit model, under fixed confidence. Given a confidence input $\delta$, the goal is to identify the arm with the highest mean reward with a probability of at least 1 --…

Machine Learning · Statistics 2023-12-21 El Mehdi Saad , Gilles Blanchard , Nicolas Verzelen

In this paper, we introduce a new online decision making paradigm that we call Thresholding Graph Bandits. The main goal is to efficiently identify a subset of arms in a multi-armed bandit problem whose means are above a specified…

Machine Learning · Computer Science 2020-03-26 Daniel LeJeune , Gautam Dasarathy , Richard G. Baraniuk

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

Machine Learning · Computer Science 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

We study the fixed-confidence best-arm identification problem in unimodal bandits, in which the means of the arms increase with the index of the arm up to their maximum, then decrease. We derive two lower bounds on the stopping time of any…

Machine Learning · Computer Science 2025-05-27 Riccardo Poiani , Marc Jourdan , Emilie Kaufmann , Rémy Degenne

Quantum optics utilizes the unique properties of light for computation or communication. In this work, we explore its ability to solve certain reinforcement learning tasks, with a particular view towards the scalability of the approach. Our…

Quantum Physics · Physics 2025-04-14 Kohei Konaka , André Röhm , Takatomo Mihana , Ryoichi Horisaki

We study the multi-armed bandit problem with arms which are Markov chains with rewards. In the finite-horizon setting, the celebrated Gittins indices do not apply, and the exact solution is intractable. We provide approximation algorithms…

Data Structures and Algorithms · Computer Science 2016-09-14 Will Ma

We address the problem of best arm identification (BAI) with a fixed budget for two-armed Gaussian bandits. In BAI, given multiple arms, we aim to find the best arm, an arm with the highest expected reward, through an adaptive experiment.…

Machine Learning · Computer Science 2024-03-19 Masahiro Kato