中文
相关论文

相关论文: Functional Sequential Treatment Allocation with Co…

200 篇论文

We study the problem of federated stochastic multi-arm contextual bandits with unknown contexts, in which M agents are faced with different bandits and collaborate to learn. The communication model consists of a central server and the…

机器学习 · 计算机科学 2024-01-31 Jiabin Lin , Shana Moothedath

We consider the problem of selecting the optimal subgroup to treat when data on covariates is available from a randomized trial or observational study. We distinguish between four different settings including (i) treatment selection when…

统计方法学 · 统计学 2018-02-28 Tyler J. VanderWeele , Alex R. Luedtke , Mark J. van der Laan , Ronald C. Kessler

We study the sequential batch learning problem in linear contextual bandits with finite action sets, where the decision maker is constrained to split incoming individuals into (at most) a fixed number of batches and can only observe…

机器学习 · 计算机科学 2020-04-15 Yanjun Han , Zhengqing Zhou , Zhengyuan Zhou , Jose Blanchet , Peter W. Glynn , Yinyu Ye

The celebrated multi-armed bandit problem in decision theory models the basic trade-off between exploration, or learning about the state of a system, and exploitation, or utilizing the system. In this paper we study the variant of the…

数据结构与算法 · 计算机科学 2013-06-19 Sudipto Guha , Kamesh Munagala

We propose and investigate a class of new algorithms for sequential decision making that interacts with \textit{a batch of users} simultaneously instead of \textit{a user} at each decision epoch. This type of batch models is motivated by…

机器学习 · 统计学 2020-03-02 Chi-Hua Wang , Guang Cheng

This thesis aims to study some of the mathematical challenges that arise in the analysis of statistical sequential decision-making algorithms for postoperative patients follow-up. Stochastic bandits (multiarmed, contextual) model the…

机器学习 · 统计学 2024-05-06 Patrick Saux

We consider a multiobjective multiarmed bandit problem with lexicographically ordered objectives. In this problem, the goal of the learner is to select arms that are lexicographic optimal as much as possible without knowing the arm reward…

机器学习 · 计算机科学 2019-07-30 Alihan Hüyük , Cem Tekin

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

机器学习 · 计算机科学 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

We consider a combinatorial multi-armed bandit problem for maximum value reward function under maximum value and index feedback. This is a new feedback structure that lies in between commonly studied semi-bandit and full-bandit feedback…

机器学习 · 计算机科学 2023-05-26 Yiliu Wang , Wei Chen , Milan Vojnović

The present paper deals with the problem of allocating patients to two competing treatments in the presence of covariates or prognostic factors in order to achieve a good trade-off among ethical concerns, inferential precision and…

统计方法学 · 统计学 2012-08-17 Alessandro Baldi Antognini , Maroussa Zagoraiou

An extension of the traditional two-armed bandit problem is considered, in which the decision maker has access to some side information before deciding which arm to pull. At each time t, before making a selection, the decision maker is able…

信息论 · 计算机科学 2007-07-16 Chih-Chun Wang , Sanjeev R. Kulkarni , H. Vincent Poor

There is increasing interest in allocating treatments based on observed individual characteristics: examples include targeted marketing, individualized credit offers, and heterogeneous pricing. Treatment personalization introduces…

计量经济学 · 经济学 2023-04-06 Evan Munro

We consider the stochastic contextual bandit problem with additional regularization. The motivation comes from problems where the policy of the agent must be close to some baseline policy which is known to perform well on the task. To…

机器学习 · 统计学 2019-06-06 Xavier Fontaine , Quentin Berthet , Vianney Perchet

In many areas, practitioners seek to use observational data to learn a treatment assignment policy that satisfies application-specific constraints, such as budget, fairness, simplicity, or other functional form constraints. For example,…

统计理论 · 数学 2020-09-08 Susan Athey , Stefan Wager

A sensing policy for the restless multi-armed bandit problem with stationary but unknown reward distributions is proposed. The work is presented in the context of cognitive radios in which the bandit problem arises when deciding which parts…

信息论 · 计算机科学 2012-11-20 Jan Oksanen , Visa Koivunen , H. Vincent Poor

In the classic multi-armed bandits problem, the goal is to have a policy for dynamically operating arms that each yield stochastic rewards with unknown means. The key metric of interest is regret, defined as the gap between the expected…

最优化与控制 · 数学 2010-11-23 Yi Gai , Bhaskar Krishnamachari , Rahul Jain

Conventional treatment policies map patient covariates to a single recommended intervention in order to maximize expected clinical outcomes. Although a rich body of causal inference methods has been developed to estimate such policies,…

机器学习 · 计算机科学 2026-05-20 Laura Fuentes-Vicente , Mathieu Even , Gaëlle Dormion , Antoine Chambaz , Uri Shalit , Julie Josse

Causal knowledge can be used to support decision-making problems. This has been recognized in the causal bandits literature, where a causal (multi-armed) bandit is characterized by a causal graphical model and a target variable. The arms…

机器学习 · 计算机科学 2025-10-14 Francisco N. F. Q. Simoes , Itai Feigenbaum , Mehdi Dastani , Thijs van Ommen

We consider a variant of the contextual bandit problem. In standard contextual bandits, when a user arrives we get the user's complete feature vector and then assign a treatment (arm) to that user. In a number of applications (like…

机器学习 · 计算机科学 2020-02-25 Sanath Kumar Krishnamurthy , Susan Athey

The Colonel Blotto game is a renowned resource allocation problem with a long-standing literature in game theory (almost 100 years). However, its scope of application is still restricted by the lack of studies on the incomplete-information…

计算机科学与博弈论 · 计算机科学 2019-09-12 Dong Quan Vu , Patrick Loiseau , Alonso Silva