中文
相关论文

相关论文: Put CASH on Bandits: A Max K-Armed Problem for Aut…

200 篇论文

We propose a multi-agent multi-armed bandit (MA-MAB) framework aimed at ensuring fair outcomes across agents while maximizing overall system performance. A key challenge in this setting is decision-making under limited information about arm…

机器学习 · 计算机科学 2026-01-28 Tianyi Xu , Jiaxin Liu , Nicholas Mattei , Zizhan Zheng

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

机器学习 · 计算机科学 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao

We present a new type of acquisition functions for online decision making in multi-armed and contextual bandit problems with extreme payoffs. Specifically, we model the payoff function as a Gaussian process and formulate a novel type of…

机器学习 · 计算机科学 2022-10-12 Yibo Yang , Antoine Blanchard , Themistoklis Sapsis , Paris Perdikaris

The multi-armed bandit (MAB) problem is a classic example of the exploration-exploitation dilemma. It is concerned with maximising the total rewards for a gambler by sequentially pulling an arm from a multi-armed slot machine where each arm…

机器学习 · 统计学 2018-05-16 Xue Lu , Niall Adams , Nikolas Kantas

Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while maximizing profit for the EC platform remains a sophisticated…

机器学习 · 计算机科学 2023-02-15 Jiaming Cheng , Duong Thuy Anh Nguyen , Lele Wang , Duong Tung Nguyen , Vijay K. Bhargava

Multi-armed bandit (MAB) algorithms are efficient approaches to reduce the opportunity cost of online experimentation and are used by companies to find the best product from periodically refreshed product catalogs. However, these algorithms…

机器学习 · 计算机科学 2024-12-19 Mohsen Bayati , Junyu Cao , Wanning Chen

Automated algorithm selection and hyperparameter tuning facilitates the application of machine learning. Traditional multi-armed bandit strategies look to the history of observed rewards to identify the most promising arms for optimizing…

机器学习 · 计算机科学 2020-05-29 Mischa Schmidt , Julia Gastinger , Sébastien Nicolas , Anett Schülke

This paper investigates stochastic and adversarial combinatorial multi-armed bandit problems. In the stochastic setting under semi-bandit feedback, we derive a problem-specific regret lower bound, and discuss its scaling with the dimension…

机器学习 · 计算机科学 2015-11-09 Richard Combes , M. Sadegh Talebi , Alexandre Proutiere , Marc Lelarge

The multi-armed bandit (MAB) model is one of the most classical models to study decision-making in an uncertain environment. In this model, a player chooses one of $K$ possible arms of a bandit machine to play at each time step, where the…

机器学习 · 计算机科学 2023-06-13 Bo Li , Chi Ho Yeung

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

机器学习 · 计算机科学 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Modern deep learning methods are very sensitive to many hyperparameters, and, due to the long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization is typically computationally infeasible. On the other…

机器学习 · 计算机科学 2018-07-06 Stefan Falkner , Aaron Klein , Frank Hutter

Multi-armed bandit(MAB) problem is a reinforcement learning framework where an agent tries to maximise her profit by proper selection of actions through absolute feedback for each action. The dueling bandits problem is a variation of MAB…

机器学习 · 计算机科学 2019-02-08 Nischal Agrawal , Prasanna Chaporkar

Originally motivated by default risk management applications, this paper investigates a novel problem, referred to as the profitable bandit problem here. At each step, an agent chooses a subset of the K possible actions. For each action…

机器学习 · 统计学 2018-05-09 Mastane Achab , Stephan Clémençon , Aurélien Garivier

Modern optimization problems in scientific and engineering domains often rely on expensive black-box evaluations, such as those arising in physical simulations or deep learning pipelines, where gradient information is unavailable or…

统计计算 · 统计学 2026-01-05 Foo Hui-Mean , Yuan-chin Ivan Chang

One of the key drivers of complexity in the classical (stochastic) multi-armed bandit (MAB) problem is the difference between mean rewards in the top two arms, also known as the instance gap. The celebrated Upper Confidence Bound (UCB)…

机器学习 · 计算机科学 2021-10-27 Anand Kalvit , Assaf Zeevi

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up random search through…

机器学习 · 计算机科学 2018-06-20 Lisha Li , Kevin Jamieson , Giulia DeSalvo , Afshin Rostamizadeh , Ameet Talwalkar

We obtain the upper bound of the loss function for a strategy in the multi-armed bandit problem with Gaussian distributions of incomes. Considered strategy is an asymptotic generalization of the strategy proposed by J. Bather for the…

统计理论 · 数学 2019-02-04 Alexander Kolnogorov , Sergey Garbar

Motivated by problems in search and detection we present a solution to a Combinatorial Multi-Armed Bandit (CMAB) problem with both heavy-tailed reward distributions and a new class of feedback, filtered semibandit feedback. In a CMAB…

机器学习 · 计算机科学 2017-05-29 James A. Grant , David S. Leslie , Kevin Glazebrook , Roberto Szechtman

We consider the problem of contextual bandits with stochastic experts, which is a variation of the traditional stochastic contextual bandit with experts problem. In our problem setting, we assume access to a class of stochastic experts,…

机器学习 · 统计学 2021-03-04 Rajat Sen , Karthikeyan Shanmugam , Nihal Sharma , Sanjay Shakkottai

For traffic routing platforms, the choice of which route to recommend to a user depends on the congestion on these routes -- indeed, an individual's utility depends on the number of people using the recommended route at that instance.…

机器学习 · 计算机科学 2023-01-24 Pranjal Awasthi , Kush Bhatia , Sreenivas Gollapudi , Kostas Kollias