中文
相关论文

相关论文: Online Batch Decision-Making with High-Dimensional…

200 篇论文

The celebrated multi-armed bandit problem in decision theory models the basic trade-off between exploration, or learning about the state of a system, and exploitation, or utilizing the system. In this paper we study the variant of the…

数据结构与算法 · 计算机科学 2013-06-19 Sudipto Guha , Kamesh Munagala

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

机器学习 · 统计学 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

Bandit algorithms solve diverse sequential decision-making problems, but are often too sample-inefficient for from-scratch personalization. To substantially reduce exploration times, latent bandit algorithms exploit cross-instance structure…

机器学习 · 计算机科学 2026-05-11 Emil Carlsson , Newton Mwai , Fredrik D. Johansson

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user…

机器学习 · 统计学 2022-08-23 Gi-Soo Kim , Hyun-Joon Yang , Jane P. Kim

We propose a new sequential decision-making setting, combining key aspects of two established online learning problems with bandit feedback. The optimal action to play at any given moment is contingent on an underlying changing state which…

机器学习 · 计算机科学 2023-11-07 Alexander Galozy , Slawomir Nowaczyk , Mattias Ohlsson

Personalized web services strive to adapt their services (advertisements, news articles, etc) to individual users by making use of both content and user information. Despite a few recent advances, this problem remains challenging for at…

机器学习 · 计算机科学 2012-03-05 Lihong Li , Wei Chu , John Langford , Robert E. Schapire

We study a sequential resource allocation problem where a decision maker selects subsets of agents at each period to maximize overall outcomes without prior knowledge of individual-level effects. Our framework applies to settings such as…

机器学习 · 计算机科学 2025-08-29 Katherine B. Adams , Justin J. Boutilier , Qinyang He , Yonatan Mintz

Motivated by the observation that overexposure to unwanted marketing activities leads to customer dissatisfaction, we consider a setting where a platform offers a sequence of messages to its users and is penalized when users abandon the…

机器学习 · 计算机科学 2019-03-21 Junyu Cao , Wei Sun

Equitably allocating limited resources in high-stakes domains-such as education, employment, and healthcare-requires balancing short-term utility with long-term impact, while accounting for delayed outcomes, hidden heterogeneity, and…

人工智能 · 计算机科学 2025-11-17 Mohammadsina Almasi , Hadis Anahideh

This paper studies a bandit optimization problem where the goal is to maximize a function $f(x)$ over $T$ periods for some unknown strongly concave function $f$. We consider a new pairwise comparison oracle, where the decision-maker chooses…

机器学习 · 计算机科学 2025-05-29 Xiangyu Chang , Xi Chen , Yining Wang , Zhiyi Zeng

Leveraging offline data is an attractive way to accelerate online sequential decision-making. However, it is crucial to account for latent states in users or environments in the offline data, and latent bandits form a compelling model for…

机器学习 · 计算机科学 2025-09-03 Chinmaya Kausik , Kevin Tan , Ambuj Tewari

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

机器学习 · 统计学 2022-05-31 Abhimanyu Dubey , Alex Pentland

Learning personalized cancer treatment with machine learning holds great promise to improve cancer patients' chance of survival. Despite recent advances in machine learning and precision oncology, this approach remains challenging as…

机器学习 · 计算机科学 2022-07-12 Mingyu Lu , Yifang Chen , Su-In Lee

Multi-armed Bandits (MABs) are increasingly employed in online platforms and e-commerce to optimize decision making for personalized user experiences. In this work, we focus on the Contextual Bandit problem with linear rewards, under…

机器学习 · 计算机科学 2024-09-17 Rowan Swiers , Subash Prabanantham , Andrew Maher

Classical collaborative filtering, and content-based filtering methods try to learn a static recommendation model given training data. These approaches are far from ideal in highly dynamic recommendation domains such as news recommendation…

机器学习 · 计算机科学 2016-06-01 Shuai Li , Alexandros Karatzoglou , Claudio Gentile

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the best treatment to give…

机器学习 · 计算机科学 2025-04-08 Mirco Mutti , Jeongyeol Kwon , Shie Mannor , Aviv Tamar

Taking advantage of contextual information can potentially boost the performance of recommender systems. In the era of big data, such side information often has several dimensions. Thus, developing decision-making algorithms to cope with…

机器学习 · 计算机科学 2023-07-26 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

We consider the stochastic contextual bandit problem under the high dimensional linear model. We focus on the case where the action space is finite and random, with each action associated with a randomly generated contextual covariate. This…

机器学习 · 统计学 2020-09-07 Yining Wang , Yi Chen , Ethan X. Fang , Zhaoran Wang , Runze Li

Multi-armed bandit problems are receiving a great deal of attention because they adequately formalize the exploration-exploitation trade-offs arising in several industrially relevant applications, such as online advertisement and, more…

机器学习 · 计算机科学 2013-11-05 Nicolò Cesa-Bianchi , Claudio Gentile , Giovanni Zappella

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…