中文
相关论文

相关论文: Reward Teaching for Federated Multi-armed Bandits

200 篇论文

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

机器学习 · 计算机科学 2023-12-14 Han Qi , Fei Guo , Li Zhu

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

机器学习 · 统计学 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

机器学习 · 计算机科学 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

The multi-armed bandit (MAB) model is one of the most classical models to study decision-making in an uncertain environment. In this model, a player chooses one of $K$ possible arms of a bandit machine to play at each time step, where the…

机器学习 · 计算机科学 2023-06-13 Bo Li , Chi Ho Yeung

The multi-armed bandit (MAB) problem is a classic example of the exploration-exploitation dilemma. It is concerned with maximising the total rewards for a gambler by sequentially pulling an arm from a multi-armed slot machine where each arm…

机器学习 · 统计学 2018-05-16 Xue Lu , Niall Adams , Nikolas Kantas

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

机器学习 · 计算机科学 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

Scheduling fast uplink grant transmissions for machine type communications (MTCs) is one of the main challenges of future wireless systems. In this paper, a novel fast uplink grant scheduling method based on the theory of multi-armed…

信息论 · 计算机科学 2018-11-01 Samad Ali , Aidin Ferdowsi , Walid Saad , Nandana Rajatheva , Jussi Haapola

The Combined Algorithm Selection and Hyperparameter optimization (CASH) is a challenging resource allocation problem in the field of AutoML. We propose MaxUCB, a max k-armed bandit method to trade off exploring different model classes and…

机器学习 · 计算机科学 2025-11-20 Amir Rezaei Balef , Claire Vernade , Katharina Eggensperger

Multi-armed bandit (MAB) algorithms have achieved significant success in sequential decision-making applications, under the premise that humans perfectly implement the recommended policy. However, existing methods often overlook the crucial…

机器学习 · 统计学 2024-10-07 Changxiao Cai , Jiacheng Zhang

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

机器学习 · 统计学 2018-12-14 Lai Wei , Vaibhav Srivastava

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Ensemble learning plays a crucial role in practical applications of online learning due to its enhanced classification performance and adaptable adjustment mechanisms. However, most weight allocation strategies in ensemble learning are…

机器学习 · 计算机科学 2025-03-21 Songqiao Hu , Zeyi Liu , Xiao He

Multi-armed bandit (MAB) problems serve as a fundamental building block for more complex reinforcement learning algorithms. However, evaluating and comparing MAB algorithms remains challenging due to the lack of standardized conditions and…

机器学习 · 计算机科学 2025-11-03 Elise Wolf

Thompson sampling (TS) is widely used in sequential decision making due to its ease of use and appealing empirical performance. However, many existing analytical and empirical results for TS rely on restrictive assumptions on reward…

机器学习 · 计算机科学 2023-06-16 Amin Karbasi , Nikki Lijing Kuang , Yi-An Ma , Siddharth Mitra

We study a type of Multi-Armed Bandit (MAB) problems in which arms with a Gaussian reward feedback are clustered. Such an arm setting finds applications in many real-world problems, for example, mmWave communications and portfolio…

机器学习 · 计算机科学 2026-02-19 Tianchi Zhao , He Liu , Hongyin Shi , Jinliang Li

Due to its static protocol design, IEEE 802.11 (aka Wi-Fi) channel access lacks adaptability to address dynamic network conditions, resulting in inefficient spectrum utilization, unnecessary contention, and packet collisions. This paper…

Restless multi-armed bandits (RMAB) has been widely used to model constrained sequential decision making problems, where the state of each restless arm evolves according to a Markov chain and each state transition generates a scalar reward.…

机器学习 · 计算机科学 2025-07-18 Guojun Xiong , Ujwal Dinesha , Debajoy Mukherjee , Jian Li , Srinivas Shakkottai

We consider the problem of distributed online learning with multiple players in multi-armed bandits (MAB) models. Each player can pick among multiple arms. When a player picks an arm, it gets a reward. We consider both i.i.d. reward model…

最优化与控制 · 数学 2016-11-18 Dileep Kalathil , Naumaan Nayyar , Rahul Jain

We introduce a novel framework of combinatorial multi-armed bandits (CMAB) with multivariant and probabilistically triggering arms (CMAB-MT), where the outcome of each arm is a $d$-dimensional multivariant random variable and the feedback…

We study online meta-learning with bandit feedback, with the goal of improving performance across multiple tasks if they are similar according to some natural similarity measure. As the first to target the adversarial online-within-online…