中文
相关论文

相关论文: Improving Portfolio Optimization Results with Band…

200 篇论文

Multi-armed bandit algorithms have been argued for decades as useful for adaptively randomized experiments. In such experiments, an algorithm varies which arms (e.g. alternative interventions to help students learn) are assigned to…

机器学习 · 计算机科学 2021-03-29 Joseph Jay Williams , Jacob Nogas , Nina Deliu , Hammad Shaikh , Sofia S. Villar , Audrey Durand , Anna Rafferty

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

We study a decentralized collaborative requesting problem that aims to optimize the information freshness of time-sensitive clients in edge networks consisting of multiple clients, access nodes (ANs), and servers. Clients request content…

机器学习 · 计算机科学 2026-01-21 Yi Zhuang , Kun Yang , Xingran Chen

We investigate two perturbation approaches to overcome conservatism that optimism based algorithms chronically suffer from in practice. The first approach replaces optimism with a simple randomization when using confidence sets. The second…

机器学习 · 统计学 2021-10-13 Baekjin Kim , Ambuj Tewari

In evolutionary computation, different reproduction operators have various search dynamics. To strike a well balance between exploration and exploitation, it is attractive to have an adaptive operator selection (AOS) mechanism that…

神经与进化计算 · 计算机科学 2020-04-24 Lei Sun , Ke Li

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

机器学习 · 计算机科学 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

Today's top advertisers typically manage hundreds of campaigns simultaneously and consistently launch new ones throughout the year. A crucial challenge for marketing managers is determining the optimal allocation of limited budgets across…

机器学习 · 统计学 2024-09-04 Lin Ge , Yang Xu , Jianing Chu , David Cramer , Fuhong Li , Kelly Paulson , Rui Song

Thompson Sampling is one of the most widely used and studied bandit algorithms, known for its simple structure, low regret performance, and solid theoretical guarantees. Yet, in stark contrast to most other families of bandit algorithms,…

机器学习 · 计算机科学 2026-05-28 Yanlin Qu , Hongseok Namkoong , Assaf Zeevi

We consider a novel formulation of the multi-armed bandit model, which we call the contextual bandit with restricted context, where only a limited number of features can be accessed by the learner at every iteration. This novel formulation…

人工智能 · 计算机科学 2017-06-09 Djallel Bouneffouf , Irina Rish , Guillermo A. Cecchi , Raphael Feraud

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

机器学习 · 计算机科学 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

The stochastic multi-arm bandit problem has been extensively studied under standard assumptions on the arm's distribution (e.g bounded with known support, exponential family, etc). These assumptions are suitable for many real-world problems…

机器学习 · 统计学 2021-11-19 Dorian Baudry , Patrick Saux , Odalric-Ambrym Maillard

We investigate the problem of stochastic, combinatorial multi-armed bandits where the learner only has access to bandit feedback and the reward function can be non-linear. We provide a general framework for adapting discrete offline…

机器学习 · 计算机科学 2023-10-13 Guanyu Nie , Yididiya Y Nadew , Yanhui Zhu , Vaneet Aggarwal , Christopher John Quinn

For traffic routing platforms, the choice of which route to recommend to a user depends on the congestion on these routes -- indeed, an individual's utility depends on the number of people using the recommended route at that instance.…

机器学习 · 计算机科学 2023-01-24 Pranjal Awasthi , Kush Bhatia , Sreenivas Gollapudi , Kostas Kollias

We study a novel multi-armed bandit problem that models the challenge faced by a company wishing to explore new strategies to maximize revenue whilst simultaneously maintaining their revenue above a fixed baseline, uniformly over time.…

机器学习 · 统计学 2016-02-16 Yifan Wu , Roshan Shariff , Tor Lattimore , Csaba Szepesvári

Many efficient algorithms with strong theoretical guarantees have been proposed for the contextual multi-armed bandit problem. However, applying these algorithms in practice can be difficult because they require domain expertise to build…

机器学习 · 计算机科学 2018-10-23 Adam N. Elmachtoub , Ryan McNellis , Sechan Oh , Marek Petrik

In this paper we study a generalized version of classical multi-armed bandits (MABs) problem by allowing for arbitrary constraints on constituent bandits at each decision point. The motivation of this study comes from many situations that…

机器学习 · 计算机科学 2014-10-07 Xiang-yang Li , Shaojie Tang , Yaqin Zhou

Recent advances in generative artificial intelligence (GenAI) models have enabled the generation of personalized content that adapts to up-to-date user context. While personalized decision systems are often modeled using bandit…

机器学习 · 统计学 2025-05-23 Marc Brooks , Gabriel Durham , Kihyuk Hong , Ambuj Tewari

We consider a multi-armed bandit problem in a setting where each arm produces a noisy reward realization which depends on an observable random covariate. As opposed to the traditional static multi-armed bandit problem, this setting allows…

统计理论 · 数学 2013-05-27 Vianney Perchet , Philippe Rigollet

Originally motivated by default risk management applications, this paper investigates a novel problem, referred to as the profitable bandit problem here. At each step, an agent chooses a subset of the K possible actions. For each action…

机器学习 · 统计学 2018-05-09 Mastane Achab , Stephan Clémençon , Aurélien Garivier

Reinforcement learning generalizes multi-armed bandit problems with additional difficulties of a longer planning horizon and unknown transition kernel. We explore a black-box reduction from discounted infinite-horizon tabular reinforcement…

机器学习 · 计算机科学 2024-03-12 Ian A. Kash , Lev Reyzin , Zishun Yu