中文
相关论文

相关论文: Adaptively Optimize Content Recommendation Using M…

200 篇论文

The multi-armed bandit (MAB) problem is a classical problem that models sequential decision-making under uncertainty in reinforcement learning. In this study, we propose a new generalized upper confidence bound (UCB) algorithm (GWA-UCB1) by…

机器学习 · 计算机科学 2023-08-29 Nobuhito Manome , Shuji Shinohara , Ung-il Chung

The (contextual) multi-armed bandit problem (MAB) provides a formalization of sequential decision-making which has many applications. However, validly evaluating MAB policies is challenging; we either resort to simulations which inherently…

机器学习 · 计算机科学 2019-08-22 Jules Kruijswijk , Petri Parvinen , Maurits Kaptein

Motivated by applications in energy management, this paper presents the Multi-Armed Risk-Aware Bandit (MARAB) algorithm. With the goal of limiting the exploration of risky arms, MARAB takes as arm quality its conditional value at risk. When…

机器学习 · 计算机科学 2014-01-07 Nicolas Galichet , Michèle Sebag , Olivier Teytaud

Algorithms for the Multi-Armed Bandit (MAB) problem play a central role in sequential decision-making and have been extensively explored both theoretically and numerically. While most classical approaches aim to identify the arm with the…

机器学习 · 计算机科学 2026-04-02 Gabriel Turinici

In a multi-armed bandit (MAB) problem a gambler needs to choose at each round of play one of K arms, each characterized by an unknown reward distribution. Reward realizations are only observed when an arm is selected, and the gambler's…

机器学习 · 计算机科学 2019-06-11 Omar Besbes , Yonatan Gur , Assaf Zeevi

The multi-armed bandits (MAB) framework is a widely used approach for sequential decision-making, where a decision-maker selects an arm in each round with the goal of maximizing long-term rewards. In many practical applications, such as…

机器学习 · 统计学 2026-05-21 Sakshi Arya , Hyebin Song

We address multi-armed bandits (MAB) where the objective is to maximize the cumulative reward under a probabilistic linear constraint. For a few real-world instances of this problem, constrained extensions of the well-known Thompson…

机器学习 · 计算机科学 2020-05-14 Vidit Saxena , Joseph E. Gonzalez , Joakim Jaldén

Combinatorial online learning is a fundamental task for selecting the optimal action (or super arm) as a combination of base arms in sequential interactions with systems providing stochastic rewards. It is applicable to diverse domains such…

机器学习 · 计算机科学 2026-03-04 Seockbean Song , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

Multi-armed bandits (MAB) are commonly used in sequential online decision-making when the reward of each decision is an unknown random variable. In practice however, the typical goal of maximizing total reward may be less important than…

机器学习 · 计算机科学 2025-12-22 Ishank Juneja , Carlee Joe-Wong , Osman Yağan

We seek to take a different approach in deriving the optimal search policy for the repeated consumer search model found in Fishman and Rob (1995) with the main motivation of dropping the assumption of prior knowledge of the price…

理论经济学 · 经济学 2020-12-24 Tung Yu Marco Chan

Originally motivated by default risk management applications, this paper investigates a novel problem, referred to as the profitable bandit problem here. At each step, an agent chooses a subset of the K possible actions. For each action…

机器学习 · 统计学 2018-05-09 Mastane Achab , Stephan Clémençon , Aurélien Garivier

We consider a finite-horizon multi-armed bandit (MAB) problem in a Bayesian setting, for which we propose an information relaxation sampling framework. With this framework, we define an intuitive family of control policies that include…

机器学习 · 计算机科学 2021-06-17 Seungki Min , Costis Maglaras , Ciamac C. Moallemi

Although the classical version of the Multi-Armed Bandits (MAB) framework has been applied successfully to several practical problems, in many real-world applications, the possible actions are not presented to the learner simultaneously,…

机器学习 · 计算机科学 2021-10-01 Marco Gabrielli , Francesco Trovò , Manuela Antonelli

Classical collaborative filtering, and content-based filtering methods try to learn a static recommendation model given training data. These approaches are far from ideal in highly dynamic recommendation domains such as news recommendation…

机器学习 · 计算机科学 2016-06-01 Shuai Li , Alexandros Karatzoglou , Claudio Gentile

The combinatorial multi-armed bandit (CMAB) is a fundamental sequential decision-making framework, extensively studied over the past decade. However, existing work primarily focuses on the online setting, overlooking the substantial costs…

机器学习 · 计算机科学 2025-05-30 Xutong Liu , Xiangxiang Dai , Jinhang Zuo , Siwei Wang , Carlee Joe-Wong , John C. S. Lui , Wei Chen

The combinatorial multi-armed bandit model is designed to maximize cumulative rewards in the presence of uncertainty by activating a subset of arms in each round. This paper is inspired by two critical applications in wireless networks,…

机器学习 · 计算机科学 2025-09-17 Xiaoyi Wu , Bin Li

In this paper we investigate the problem of stochastic multi-armed bandits (MAB) in the (local) differential privacy (DP/LDP) model. Unlike previous results that assume bounded/sub-Gaussian reward distributions, we focus on the setting…

机器学习 · 计算机科学 2022-03-25 Youming Tao , Yulian Wu , Peng Zhao , Di Wang

Fast changing states or volatile environments pose a significant challenge to online optimization, which needs to perform rapid adaptation under limited observation. In this paper, we give query and regret optimal bandit algorithms under…

机器学习 · 计算机科学 2024-01-18 Zhou Lu , Qiuyi Zhang , Xinyi Chen , Fred Zhang , David Woodruff , Elad Hazan

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

神经与进化计算 · 计算机科学 2023-02-16 Deniz Preil , Michael Krapp

Scientific experimentation is largely driven by statistical hypothesis testing to determine significant differences in interventions. Traditionally, experimenters allocate samples uniformly between each intervention. However, such an…