English
Related papers

Related papers: Risk-Aware Multi-Armed Bandit Problem with Applica…

200 papers

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

Neural and Evolutionary Computing · Computer Science 2023-02-16 Deniz Preil , Michael Krapp

We consider the scheduling problem concerning N projects. Each project evolves as a multi-state Markov process. At each time instant, one project is scheduled to work, and some reward depending on the state of the chosen project is…

Optimization and Control · Mathematics 2016-02-02 Kehao Wang

Recommendation systems when employed in markets play a dual role: they assist users in selecting their most desired items from a large pool and they help in allocating a limited number of items to the users who desire them the most. Despite…

Machine Learning · Computer Science 2022-08-01 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran

Decision trees, without appropriate constraints, can easily become overly complex and prone to overfit, capturing noise rather than generalizable patterns. To resolve this problem,pruning operation is a crucial part in optimizing decision…

Machine Learning · Computer Science 2025-08-11 Hasibul Karim Shanto , Umme Ayman Koana , Shadikur Rahman

We define and analyze a multi-agent multi-armed bandit problem in which decision-making agents can observe the choices and rewards of their neighbors. Neighbors are defined by a network graph with heterogeneous and stochastic…

Optimization and Control · Mathematics 2019-05-22 Udari Madhushani , Naomi Ehrich Leonard

In many real-world applications, multiple agents seek to learn how to perform highly related yet slightly different tasks in an online bandit learning protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed bandit…

Machine Learning · Computer Science 2021-07-21 Zhi Wang , Chicheng Zhang , Manish Kumar Singh , Laurel D. Riek , Kamalika Chaudhuri

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

Machine Learning · Computer Science 2024-05-29 Marco Mussi , Alessandro Montenegro , Francesco Trovó , Marcello Restelli , Alberto Maria Metelli

We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms…

Machine Learning · Computer Science 2020-10-27 Rahul Singh , Fang Liu , Yin Sun , Ness Shroff

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

Machine Learning · Computer Science 2015-03-23 Shaojie Tang , Yaqin Zhou

We consider a multi-hypothesis testing problem involving a K-armed bandit. Each arm's signal follows a distribution from a vector exponential family. The actual parameters of the arms are unknown to the decision maker. The decision maker…

Information Theory · Computer Science 2022-06-13 Gayathri R Prabhu , Srikrishna Bhashyam , Aditya Gopalan , Rajesh Sundaresan

Recent work has considered natural variations of the multi-armed bandit problem, where the reward distribution of each arm is a special function of the time passed since its last pulling. In this direction, a simple (yet widely applicable)…

Machine Learning · Computer Science 2021-05-25 Alexia Atsidakou , Orestis Papadigenopoulos , Soumya Basu , Constantine Caramanis , Sanjay Shakkottai

We study a sequential resource allocation problem involving a fixed number of recurring jobs. At each time-step the manager should distribute available resources among the jobs in order to maximise the expected number of completed jobs.…

Machine Learning · Computer Science 2014-06-17 Tor Lattimore , Koby Crammer , Csaba Szepesvári

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

Machine Learning · Computer Science 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

The safe linear bandit problem is a version of the classical stochastic linear bandit problem where the learner's actions must satisfy an uncertain constraint at all rounds. Due its applicability to many real-world settings, this problem…

Machine Learning · Computer Science 2024-03-13 Spencer Hutchinson , Berkay Turan , Mahnoosh Alizadeh

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

Machine Learning · Statistics 2015-08-25 Yahel David , Nahum Shimkin

Reinforcement learning generalizes multi-armed bandit problems with additional difficulties of a longer planning horizon and unknown transition kernel. We explore a black-box reduction from discounted infinite-horizon tabular reinforcement…

Machine Learning · Computer Science 2024-03-12 Ian A. Kash , Lev Reyzin , Zishun Yu

Batch policy optimization considers leveraging existing data for policy construction before interacting with an environment. Although interest in this problem has grown significantly in recent years, its theoretical foundations remain…

Machine Learning · Computer Science 2021-04-07 Chenjun Xiao , Yifan Wu , Tor Lattimore , Bo Dai , Jincheng Mei , Lihong Li , Csaba Szepesvari , Dale Schuurmans

This paper explores the mean-variance portfolio selection problem in a multi-period financial market characterized by regime-switching dynamics and uncontrollable liabilities. To address the uncertainty in the decision-making process within…

Optimization and Control · Mathematics 2025-09-04 Zhongqin Gao , Ping Chen , Xun Li , Yan Lv , Wenhao Zhang

We consider the problem of minimizing the regret in stochastic multi-armed bandit, when the measure of goodness of an arm is not the mean return, but some general function of the mean and the variance.We characterize the conditions under…

Machine Learning · Computer Science 2014-05-06 Alexander Zimin , Rasmus Ibsen-Jensen , Krishnendu Chatterjee

Multi-armed bandits (MAB) provide a principled online learning approach to attain the balance between exploration and exploitation. Due to the superior performance and low feedback learning without the learning to act in multiple…

Information Retrieval · Computer Science 2022-10-25 Shenghao Xu
‹ Prev 1 8 9 10 Next ›