中文
相关论文

相关论文: Learning Peer Influence Probabilities with Linear …

200 篇论文

This paper studies adaptive targeting under network interference in a bandit setting, where treatments applied to one individual may affect others through spillover effects. We consider a linear model in a sparse regime, where each…

机器学习 · 统计学 2026-05-28 Xiaomeng Wang , Hamsa Bastani , Osbert Bastani , Zhimei Ren

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

机器学习 · 计算机科学 2016-01-26 Daniel Barsky , Koby Crammer

We propose an estimator and confidence interval for computing the value of a policy from off-policy data in the contextual bandit setting. To this end we apply empirical likelihood techniques to formulate our estimator and confidence…

机器学习 · 计算机科学 2020-10-20 Nikos Karampatziakis , John Langford , Paul Mineiro

We consider the problem of \emph{influence maximization}, the problem of maximizing the number of people that become aware of a product by finding the `best' set of `seed' users to expose the product to. Most prior work on this topic…

社会与信息网络 · 计算机科学 2016-04-28 Sharan Vaswani , Laks. V. S. Lakshmanan , Mark Schmidt

I study peer effects that arise from irreversible decisions in the absence of a standard social equilibrium. I model a latent sequence of decisions in continuous time and obtain a closed-form expression for the likelihood, which allows to…

计量经济学 · 经济学 2026-02-18 Vincent Starck

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

机器学习 · 计算机科学 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

Exploration policies in Bayesian bandits maximize the average reward over problem instances drawn from some distribution $\mathcal{P}$. In this work, we learn such policies for an unknown distribution $\mathcal{P}$ using samples from…

机器学习 · 计算机科学 2020-06-11 Craig Boutilier , Chih-Wei Hsu , Branislav Kveton , Martin Mladenov , Csaba Szepesvari , Manzil Zaheer

We study the linear contextual bandit problem where an agent has to select one candidate from a pool and each candidate belongs to a sensitive group. In this setting, candidates' rewards may not be directly comparable between groups, for…

Real-world applications of contextual bandits often exhibit non-stationarity due to seasonality, serendipity, and evolving social trends. While a number of non-stationary contextual bandit learning algorithms have been proposed in the…

机器学习 · 计算机科学 2023-10-17 Zheqing Zhu , Yueyang Liu , Xu Kuang , Benjamin Van Roy

This paper presents a new contextual bandit algorithm, NeuralBandit, which does not need hypothesis on stationarity of contexts and rewards. Several neural networks are trained to modelize the value of rewards knowing the context. Two…

神经与进化计算 · 计算机科学 2014-09-30 Robin Allesiardo , Raphael Feraud , Djallel Bouneffouf

Bandit algorithms sequentially accumulate data using adaptive sampling policies, offering flexibility for real-world applications. However, excessive sampling can be costly, motivating the devolopment of early stopping methods and reliable…

统计理论 · 数学 2025-02-06 Zihan Cui

We consider the kernelized contextual bandit problem with a large feature space. This problem involves $K$ arms, and the goal of the forecaster is to maximize the cumulative rewards through learning the relationship between the contexts and…

机器学习 · 统计学 2025-05-21 Shogo Iwazaki , Junpei Komiyama , Masaaki Imaizumi

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually…

信息检索 · 计算机科学 2019-07-04 Yong Liu , Yingtai Xiao , Qiong Wu , Chunyan Miao , Juyong Zhang

We describe MELEE, a meta-learning algorithm for learning a good exploration policy in the interactive contextual bandit setting. Here, an algorithm must take actions based on contexts, and learn based only on a reward signal from the…

机器学习 · 计算机科学 2019-01-25 Amr Sharaf , Hal Daumé

We study risk-aware offline policy learning, aiming to learn a decision rule from logged data that is optimal under general risk criteria. This problem is crucial in high-stakes domains where online interaction is infeasible and adverse…

机器学习 · 统计学 2026-05-18 Yilong Wan , Yuqiang Li , Xianyi Wu

While contextual bandit has a mature theory, effectively leveraging different feedback patterns to enhance the pace of learning remains unclear. Bandits with feedback graphs, which interpolates between the full information and bandit…

机器学习 · 计算机科学 2023-10-30 Mengxiao Zhang , Yuheng Zhang , Olga Vrousgou , Haipeng Luo , Paul Mineiro

When an Agent visits a platform recommending a menu of content to select from, their choice of item depends not only on fixed preferences, but also on their prior engagements with the platform. The Recommender's primary objective is…

信息检索 · 计算机科学 2022-10-26 Arpit Agarwal , William Brown

Contextual multi-armed bandit problems arise frequently in important industrial applications. Existing solutions model the context either linearly, which enables uncertainty driven (principled) exploration, or non-linearly, by using…

机器学习 · 计算机科学 2018-07-27 Mark Collier , Hector Urdiales Llorens

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the best treatment to give…

机器学习 · 计算机科学 2025-04-08 Mirco Mutti , Jeongyeol Kwon , Shie Mannor , Aviv Tamar

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

机器学习 · 计算机科学 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy