中文
相关论文

相关论文: Softmax gradient policy for variance minimization …

200 篇论文

This paper proposes a novel policy for a group of agents to, individually as well as collectively, solve a multi armed bandit (MAB) problem. The policy relies solely on the information that an agent has obtained through sampling of the…

机器学习 · 计算机科学 2020-02-24 Pathmanathan Pankayaraj , D. H. S. Maithripala

Sequential experiments are often characterized by an exploration-exploitation tradeoff that is captured by the multi-armed bandit (MAB) framework. This framework has been studied and applied, typically when at each time period feedback is…

机器学习 · 计算机科学 2020-12-22 Yonatan Gur , Ahmadreza Momeni

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

神经与进化计算 · 计算机科学 2023-02-16 Deniz Preil , Michael Krapp

This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized…

机器学习 · 计算机科学 2020-04-01 Pathmanathan Pankayaraj , D. H. S. Maithripala , J. M. Berg

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

A survey is performed of various Multi-Armed Bandit (MAB) strategies in order to examine their performance in circumstances exhibiting non-stationary stochastic reward functions in conjunction with delayed feedback. We run several MAB…

机器学习 · 计算机科学 2019-07-31 Larkin Liu , Richard Downe , Joshua Reid

The Rising Multi-Armed Bandit (RMAB) framework models environments where expected rewards of arms increase with plays, which models practical scenarios where performance of each option improves with the repeated usage, such as in robotics…

机器学习 · 计算机科学 2026-02-16 Seockbean Song , Chenyu Gan , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

We consider the problem of best arm identification in the multi-armed bandit model, under fixed confidence. Given a confidence input $\delta$, the goal is to identify the arm with the highest mean reward with a probability of at least 1 --…

机器学习 · 统计学 2023-12-21 El Mehdi Saad , Gilles Blanchard , Nicolas Verzelen

The Multiarmed Bandits (MAB) problem has been extensively studied and has seen many practical applications in a variety of fields. The Survival Multiarmed Bandits (S-MAB) open problem is an extension which constrains an agent to a budget…

机器学习 · 计算机科学 2024-11-06 Peter Veroutis , Frédéric Godin

Sharpe Ratio (SR) is a critical parameter in characterizing financial time series as it jointly considers the reward and the volatility of any stock/portfolio through its variance. Deriving online algorithms for optimizing the SR is…

投资组合管理 · 定量金融 2024-06-12 Sabrina Khurshid , Mohammed Shahid Abdulla , Gourab Ghatak

Adversarial attacks against stochastic multi-armed bandit (MAB) algorithms have been extensively studied in the literature. In this work, we focus on reward poisoning attacks and find most existing attacks can be easily detected by our…

机器学习 · 计算机科学 2024-02-22 Zhiwei Wang , Huazheng Wang , Hongning Wang

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

The best arm identification problem in the multi-armed bandit setting is an excellent model of many real-world decision-making problems, yet it fails to capture the fact that in the real-world, safety constraints often must be met while…

机器学习 · 计算机科学 2021-11-25 Zhenlin Wang , Andrew Wagenmaker , Kevin Jamieson

Restless multi-armed bandits (RMABs) are a popular framework for algorithmic decision making in sequential settings with limited resources. RMABs are increasingly being used for sensitive decisions such as in public health, treatment…

机器学习 · 计算机科学 2023-08-22 Jackson A. Killian , Manish Jain , Yugang Jia , Jonathan Amar , Erich Huang , Milind Tambe

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e., those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. arm). We study a particular case of the rested…

机器学习 · 计算机科学 2022-12-08 Alberto Maria Metelli , Francesco Trovò , Matteo Pirola , Marcello Restelli

Active learning methods have shown great promise in reducing the number of samples necessary for learning. As automated learning systems are adopted into real-time, real-world decision-making pipelines, it is increasingly important that…

机器学习 · 计算机科学 2022-06-23 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

机器学习 · 计算机科学 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

机器学习 · 计算机科学 2021-09-14 Nadav Merlis , Shie Mannor

The batched multi-armed bandit (MAB) problem, in which rewards are collected in batches, is crucial for applications such as clinical trials. Existing research predominantly assumes light-tailed reward distributions, yet many real-world…

机器学习 · 计算机科学 2026-03-24 Yunwen Guo , Yunlun Shu , Gongyi Zhuo , Tianyu Wang

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

机器学习 · 计算机科学 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic