中文
相关论文

相关论文: Exploring Offline Policy Evaluation for the Contin…

200 篇论文

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on the acquisition…

机器学习 · 计算机科学 2020-12-16 Abhilash Nandy , Chandan Kumar , Deepak Mewada , Soumya Sharma

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

机器学习 · 计算机科学 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Multi-armed Bandits (MABs) are increasingly employed in online platforms and e-commerce to optimize decision making for personalized user experiences. In this work, we focus on the Contextual Bandit problem with linear rewards, under…

机器学习 · 计算机科学 2024-09-17 Rowan Swiers , Subash Prabanantham , Andrew Maher

We consider the correlated multiarmed bandit (MAB) problem in which the rewards associated with each arm are modeled by a multivariate Gaussian random variable, and we investigate the influence of the assumptions in the Bayesian prior on…

最优化与控制 · 数学 2015-07-09 Vaibhav Srivastava , Paul Reverdy , Naomi Ehrich Leonard

Multi-armed bandit problems (MABPs) are a special type of optimal control problem well suited to model resource allocation under uncertainty in a wide variety of contexts. Since the first publication of the optimal solution of the classic…

统计方法学 · 统计学 2015-07-30 Sofía S. Villar , Jack Bowden , James Wason

We consider the latency minimization problem in a task-offloading scenario, where multiple servers are available to the user equipment for outsourcing computational tasks. To account for the temporally dynamic nature of the wireless links…

信号处理 · 电气工程与系统科学 2020-06-23 Aniq Ur Rahman , Gourab Ghatak , Antonio De Domenico

We study collaborative learning in multi-agent Bayesian bandit problems, where strategic agents collectively solve the same bandit instance. While multiple agents can accelerate learning by sharing information, strategic agents might prefer…

机器学习 · 计算机科学 2026-05-14 Idan Barnea , Ofir Schlisselberg , Yishay Mansour

Multi-armed bandit problems are the most basic examples of sequential decision problems with an exploration-exploitation trade-off. This is the balance between staying with the option that gave highest payoffs in the past and exploring new…

机器学习 · 计算机科学 2012-11-06 Sébastien Bubeck , Nicolò Cesa-Bianchi

Motivated by distributed selection problems, we formulate a new variant of multi-player multi-armed bandit (MAB) model, which captures stochastic arrival of requests to each arm, as well as the policy of allocating requests to players. The…

人工智能 · 计算机科学 2024-08-21 Hong Xie , Jinyu Mo , Defu Lian , Jie Wang , Enhong Chen

While significant progress has been made in designing algorithms that minimize regret in online decision-making, real-world scenarios often introduce additional complexities, perhaps the most challenging of which is missing outcomes.…

机器学习 · 统计学 2024-11-11 Ilia Mahrooghi , Mahshad Moradi , Sina Akbari , Negar Kiyavash

We consider a stochastic multi-armed bandit (MAB) problem with delayed impact of actions. In our setting, actions taken in the past impact the arm rewards in the subsequent future. This delayed impact of actions is prevalent in the real…

机器学习 · 计算机科学 2021-11-02 Wei Tang , Chien-Ju Ho , Yang Liu

In machine learning, the notion of multi-armed bandits refers to a class of online learning problems, in which an agent is supposed to simultaneously explore and exploit a given set of choice alternatives in the course of a sequential…

机器学习 · 计算机科学 2021-07-13 Viktor Bengs , Robert Busa-Fekete , Adil El Mesaoudi-Paul , Eyke Hüllermeier

We investigate the use of a multi-agent multi-armed bandit (MA-MAB) setting for modeling repeated Cournot oligopoly games, where the firms acting as agents choose from the set of arms representing production quantity (a discrete value).…

计算机科学与博弈论 · 计算机科学 2022-01-05 Kshitija Taywade , Brent Harrison , Adib Bagh

The multi-armed bandit (MAB) models have attracted significant research attention due to their applicability and effectiveness in various real-world scenarios such as resource allocation, online advertising, and dynamic pricing. As an…

机器学习 · 计算机科学 2024-02-13 Yandi Li , Jianxiong Guo , Yupeng Li , Tian Wang , Weijia Jia

We consider a rate-constrained contextual multi-armed bandit (RC-CMAB) problem, in which a group of agents are solving the same contextual multi-armed bandit (CMAB) problem. However, the contexts are observed by a remotely connected entity,…

机器学习 · 计算机科学 2022-04-28 Francesco Pase , Deniz Gündüz , Michele Zorzi

We study the multi-fidelity multi-armed bandit (MF-MAB), an extension of the canonical multi-armed bandit (MAB) problem. MF-MAB allows each arm to be pulled with different costs (fidelities) and observation accuracy. We study both the best…

机器学习 · 计算机科学 2023-06-14 Xuchuang Wang , Qingyun Wu , Wei Chen , John C. S. Lui

The Multi-Armed Bandit (MAB) problem, foundational to reinforcement learning-based decision-making, addresses the challenge of maximizing rewards amidst multiple uncertain choices. While algorithmic solutions are effective, their…

光学 · 物理学 2025-06-10 Jonathan Cuevas , Ryugo Iwami , Atsushi Uchida , Kaoru Minoshima , Naoya Kuse

Experimentation with interference poses a significant challenge in contemporary online platforms. Prior research on experimentation with interference has concentrated on the final output of a policy. The cumulative performance, while…

机器学习 · 计算机科学 2024-07-17 Su Jia , Peter Frazier , Nathan Kallus

A matching platform is a system that matches different types of participants, such as companies and job-seekers. In such a platform, merely maximizing the number of matches can result in matches being concentrated on highly popular…

机器学习 · 计算机科学 2026-03-10 Yuki Shibukawa , Koichi Tanaka , Yuta Saito , Shinji Ito

We consider a stochastic multi-armed bandit (MAB) problem motivated by ``large'' action spaces, and endowed with a population of arms containing exactly $K$ arm-types, each characterized by a distinct mean reward. The decision maker is…

机器学习 · 计算机科学 2023-01-19 Anand Kalvit , Assaf Zeevi