中文
相关论文

相关论文: Provably Efficient Multi-Objective Bandit Algorith…

200 篇论文

We study identifying user clusters in contextual multi-armed bandits (MAB). Contextual MAB is an effective tool for many real applications, such as content recommendation and online advertisement. In practice, user dependency plays an…

机器学习 · 计算机科学 2023-03-27 Yikun Ban , Jingrui He

In several applications of the stochastic multi-armed bandit problem, the traditional objective of maximizing the expected total reward can be inappropriate. In this paper, motivated by certain operational concerns in online platforms, we…

机器学习 · 计算机科学 2024-10-16 Eren Ozbay , Vijay Kamble

Multi-armed bandit problems (MABPs) are a special type of optimal control problem well suited to model resource allocation under uncertainty in a wide variety of contexts. Since the first publication of the optimal solution of the classic…

统计方法学 · 统计学 2015-07-30 Sofía S. Villar , Jack Bowden , James Wason

Motivated by applications in energy management, this paper presents the Multi-Armed Risk-Aware Bandit (MARAB) algorithm. With the goal of limiting the exploration of risky arms, MARAB takes as arm quality its conditional value at risk. When…

机器学习 · 计算机科学 2014-01-07 Nicolas Galichet , Michèle Sebag , Olivier Teytaud

We study the Pareto frontier of two archetypal objectives in multi-armed bandits, namely, regret minimization (RM) and best arm identification (BAI) with a fixed horizon. It is folklore that the balance between exploitation and exploration…

机器学习 · 计算机科学 2023-06-12 Zixin Zhong , Wang Chi Cheung , Vincent Y. F. Tan

Personalization is pervasive in the online space as it leads to higher efficiency and revenue by allowing the most relevant content to be served to each user. However, recent studies suggest that personalization methods can propagate…

机器学习 · 计算机科学 2018-02-26 L. Elisa Celis , Sayash Kapoor , Farnood Salehi , Nisheeth K. Vishnoi

The early sections of this paper present an analysis of a Markov decision model that is known as the multi-armed bandit under the assumption that the utility function of the decision maker is either linear or exponential. The analysis…

最优化与控制 · 数学 2012-03-22 Eric V. Denardo , Eugene A. Feinberg , Uriel G. Rothblum

We consider the scheduling problem concerning N projects. Each project evolves as a multi-state Markov process. At each time instant, one project is scheduled to work, and some reward depending on the state of the chosen project is…

最优化与控制 · 数学 2016-02-02 Kehao Wang

Motivated by models of human decision making proposed to explain commonly observed deviations from conventional expected value preferences, we formulate two stochastic multi-armed bandit problems with distorted probabilities on the reward…

机器学习 · 计算机科学 2023-11-01 Ravi Kumar Kolla , Prashanth L. A. , Aditya Gopalan , Krishna Jagannathan , Michael Fu , Steve Marcus

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

机器学习 · 计算机科学 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

We study the stochastic Budgeted Multi-Armed Bandit (MAB) problem, where a player chooses from $K$ arms with unknown expected rewards and costs. The goal is to maximize the total reward under a budget constraint. A player thus seeks to…

机器学习 · 计算机科学 2023-08-16 Marco Heyden , Vadim Arzamasov , Edouard Fouché , Klemens Böhm

Online healthcare communities provide users with various healthcare interventions to promote healthy behavior and improve adherence. When faced with too many intervention choices, however, individuals may find it difficult to decide which…

机器学习 · 计算机科学 2020-09-15 Tongxin Zhou , Yingfei Wang , Lu , Yan , Yong Tan

Inspired by cognitive radio networks, we consider a setting where multiple users share several channels modeled as a multi-user multi-armed bandit (MAB) problem. The characteristics of each channel are unknown and are different for each…

机器学习 · 计算机科学 2015-12-03 Orly Avner , Shie Mannor

When humans collaborate with each other, they often make decisions by observing others and considering the consequences that their actions may have on the entire team, instead of greedily doing what is best for just themselves. We would…

机器学习 · 计算机科学 2021-12-17 Erdem Bıyık , Anusha Lalitha , Rajarshi Saha , Andrea Goldsmith , Dorsa Sadigh

The design of personalized incentives or recommendations to improve user engagement is gaining prominence as digital platform providers continually emerge. We propose a multi-armed bandit framework for matching incentives to users, whose…

机器学习 · 计算机科学 2018-07-09 Tanner Fiez , Shreyas Sekar , Liyuan Zheng , Lillian J. Ratliff

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

信息检索 · 计算机科学 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

Multi-armed bandit (MAB) problems serve as a fundamental building block for more complex reinforcement learning algorithms. However, evaluating and comparing MAB algorithms remains challenging due to the lack of standardized conditions and…

机器学习 · 计算机科学 2025-11-03 Elise Wolf

Contextual multi-armed bandit (MAB) algorithms have been shown promising for maximizing cumulative rewards in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health.…

机器学习 · 统计学 2019-02-01 Gi-Soo Kim , Myunghee Cho Paik

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

计量经济学 · 经济学 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on the acquisition…

机器学习 · 计算机科学 2020-12-16 Abhilash Nandy , Chandan Kumar , Deepak Mewada , Soumya Sharma