中文
相关论文

相关论文: Multi-task Representation Learning for Pure Explor…

200 篇论文

In a sequential decision-making problem, having a structural dependency amongst the reward distributions associated with the arms makes it challenging to identify a subset of alternatives that guarantees the optimal collective outcome.…

机器学习 · 计算机科学 2022-12-27 Behzad Nourani-Koliji , Saeed Ghoorchian , Setareh Maghsudi

The celebrated multi-armed bandit problem in decision theory models the basic trade-off between exploration, or learning about the state of a system, and exploitation, or utilizing the system. In this paper we study the variant of the…

数据结构与算法 · 计算机科学 2013-06-19 Sudipto Guha , Kamesh Munagala

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

机器学习 · 计算机科学 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

This paper offers a comprehensive analysis of collaborative bandit algorithms and provides a thorough comparison of their performance. Collaborative bandits aim to improve the performance of contextual bandits by introducing relationships…

机器学习 · 计算机科学 2025-10-07 Eren Ozbay , Ashkan Golgoon

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

Multi-task learning (MTL) aims to improve the performance of a primary task by jointly learning with related auxiliary tasks. Traditional MTL methods select tasks randomly during training. However, both previous studies and our results…

计算与语言 · 计算机科学 2024-01-12 Xiangheng He , Junjie Chen , Björn W. Schuller

In multi-objective decision-making with hierarchical preferences, lexicographic bandits provide a natural framework for optimizing multiple objectives in a prioritized order. In this setting, a learner repeatedly selects arms and observes…

机器学习 · 计算机科学 2025-11-11 Bo Xue , Yuanyu Wan , Zhichao Lu , Qingfu Zhang

Although many algorithms for the multi-armed bandit problem are well-understood theoretically, empirical confirmation of their effectiveness is generally scarce. This paper presents a thorough empirical study of the most popular multi-armed…

人工智能 · 计算机科学 2014-02-26 Volodymyr Kuleshov , Doina Precup

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

Metalearning and multitask learning are two frameworks for solving a group of related learning tasks more efficiently than we could hope to solve each of the individual tasks on their own. In multitask learning, we are given a fixed set of…

机器学习 · 计算机科学 2024-04-02 Maryam Aliakbarpour , Konstantina Bairaktari , Gavin Brown , Adam Smith , Nathan Srebro , Jonathan Ullman

In lifelong learning, a learner faces a sequence of tasks with shared structure and aims to identify and leverage it to accelerate learning. We study the setting where such structure is captured by a common representation of data. Unlike…

机器学习 · 计算机科学 2025-11-04 Zhi Wang , Chicheng Zhang , Ramya Korlakai Vinayak

In this paper, we study the pure exploration bandit model on general distribution functions, which means that the reward function of each arm depends on the whole distribution, not only its mean. We adapt the racing framework and LUCB…

机器学习 · 计算机科学 2021-05-11 Siwei Wang , Wei Chen

This paper introduces the framework of multi-armed sampling, which serves as the sampling counterpart to the optimization problem of multi-armed bandits. Our primary motivation is to rigorously examine the exploration-exploitation trade-off…

机器学习 · 计算机科学 2026-05-14 Mohammad Pedramfar , Siamak Ravanbakhsh

In contextual linear bandits, the reward function is assumed to be a linear combination of an unknown reward vector and a given embedding of context-arm pairs. In practice, the embedding is often learned at the same time as the reward…

机器学习 · 计算机科学 2022-12-20 Andrea Tirinzoni , Matteo Pirotta , Alessandro Lazaric

We consider the problem of best arm identification in the multi-armed bandit model, under fixed confidence. Given a confidence input $\delta$, the goal is to identify the arm with the highest mean reward with a probability of at least 1 --…

机器学习 · 统计学 2023-12-21 El Mehdi Saad , Gilles Blanchard , Nicolas Verzelen

The multi-armed bandit (MAB) problem is a classic example of the exploration-exploitation dilemma. It is concerned with maximising the total rewards for a gambler by sequentially pulling an arm from a multi-armed slot machine where each arm…

机器学习 · 统计学 2018-05-16 Xue Lu , Niall Adams , Nikolas Kantas

This paper considers the problem of combinatorial multi-armed bandits with semi-bandit feedback and a cardinality constraint on the super-arm size. Existing algorithms for solving this problem typically involve two key sub-routines: (1) a…

机器学习 · 计算机科学 2025-08-14 Arpan Mukherjee , Shashanka Ubaru , Keerthiram Murugesan , Karthikeyan Shanmugam , Ali Tajer

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

神经与进化计算 · 计算机科学 2023-02-16 Deniz Preil , Michael Krapp

Multi-Armed Bandit (MAB) algorithms are widely used in recommender systems that require continuous, incremental learning. A core aspect of MABs is the exploration-exploitation trade-off: choosing between exploiting items likely to be…

机器学习 · 计算机科学 2026-04-20 Pedro R. Pires , Gregorio F. Azevedo , Pietro L. Campos , Rafael T. Sereicikas , Tiago A. Almeida

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

机器学习 · 计算机科学 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao