中文
相关论文

相关论文: Fast Change Identification in Multi-Play Bandits a…

200 篇论文

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

机器学习 · 计算机科学 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

In the edge computing paradigm, mobile devices offload the computational tasks to an edge server by routing the required data over the wireless network. The full potential of edge computing becomes realized only if a smart device selects…

机器学习 · 计算机科学 2020-08-25 Saeed Ghoorchian , Setareh Maghsudi

We study a variant of the stochastic multi-armed bandit (MAB) problem in which the rewards are corrupted. In this framework, motivated by privacy preservation in online recommender systems, the goal is to maximize the sum of the…

机器学习 · 计算机科学 2017-11-06 Pratik Gajane , Tanguy Urvoy , Emilie Kaufmann

We consider the Scale-Free Adversarial Multi Armed Bandits(MAB) problem. At the beginning of the game, the player only knows the number of arms $n$. It does not know the scale and magnitude of the losses chosen by the adversary or the…

机器学习 · 计算机科学 2021-10-12 Sudeep Raja Putta , Shipra Agrawal

Enterprise Wireless Local Area Networks (WLANs) consist of multiple Access Points (APs) covering a given area. Finding a suitable network configuration able to maximize the performance of enterprise WLANs is a challenging task given the…

机器学习 · 计算机科学 2020-10-12 Álvaro López-Raventós , Boris Bellalta

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

Bandit-style algorithms have been studied extensively in stochastic and adversarial settings. Such algorithms have been shown to be useful in multiplayer settings, e.g. to solve the wireless network selection problem, which can be…

网络与互联网体系结构 · 计算机科学 2019-04-30 Shunhao Oh , Anuja Meetoo Appavoo , Seth Gilbert

Online experimentation with interference is a common challenge in modern applications such as e-commerce and adaptive clinical trials in medicine. For example, in online marketplaces, the revenue of a good depends on discounts applied to…

机器学习 · 计算机科学 2024-05-30 Abhineet Agarwal , Anish Agarwal , Lorenzo Masoero , Justin Whitehouse

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

机器学习 · 计算机科学 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

Online restless multi-armed bandits (RMABs) typically assume that each arm follows a stationary Markov Decision Process (MDP) with fixed state transitions and rewards. However, in real-world applications like healthcare and recommendation…

机器学习 · 计算机科学 2025-08-15 Yu-Heng Hung , Ping-Chun Hsieh , Kai Wang

In many real-world problems of real-time monitoring high-dimensional streaming data, one wants to detect an undesired event or change quickly once it occurs, but under the sampling control constraint in the sense that one might be able to…

统计方法学 · 统计学 2022-04-12 Wanrong Zhang , Yajun Mei

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

机器学习 · 计算机科学 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

Classic no-regret multi-armed bandit algorithms, including the Upper Confidence Bound (UCB), Hedge, and EXP3, are inherently unfair by design. Their unfairness stems from their objective of playing the most rewarding arm as frequently as…

机器学习 · 计算机科学 2024-05-14 Abhishek Sinha

This paper investigates the problem of regret minimization for multi-armed bandit (MAB) problems with local differential privacy (LDP) guarantee. In stochastic bandit systems, the rewards may refer to the users' activities, which may…

机器学习 · 计算机科学 2020-07-08 Wenbo Ren , Xingyu Zhou , Jia Liu , Ness B. Shroff

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

机器学习 · 统计学 2015-11-30 Aristide Tossou , Christos Dimitrakakis

In recommender system or crowdsourcing applications of online learning, a human's preferences or abilities are often a function of the algorithm's recent actions. Motivated by this, a significant line of work has formalized settings where…

机器学习 · 统计学 2023-05-05 Dhruv Malik , Conor Igoe , Yuanzhi Li , Aarti Singh

We consider a variant of the classic multi-armed bandit problem where the expected reward of each arm is a function of an unknown parameter. The arms are divided into different groups, each of which has a common parameter. Therefore, when…

机器学习 · 计算机科学 2018-02-23 Zhiyang Wang , Ruida Zhou , Cong Shen

Multi-armed bandit algorithms have been argued for decades as useful for adaptively randomized experiments. In such experiments, an algorithm varies which arms (e.g. alternative interventions to help students learn) are assigned to…

机器学习 · 计算机科学 2021-03-29 Joseph Jay Williams , Jacob Nogas , Nina Deliu , Hammad Shaikh , Sofia S. Villar , Audrey Durand , Anna Rafferty

We study the multi-armed bandit (MAB) problem with composite and anonymous feedback. In this model, the reward of pulling an arm spreads over a period of time (we call this period as reward interval) and the player receives partial rewards…

机器学习 · 计算机科学 2020-12-16 Siwei Wang , Haoyun Wang , Longbo Huang

The Multi-armed bandit offer the advantage to learn and exploit the already learnt knowledge at the same time. This capability allows this approach to be applied in different domains, going from clinical trials where the goal is…

机器学习 · 计算机科学 2021-01-05 Djallel Bouneffouf