English
Related papers

Related papers: Contextual Bandits for Advertising Campaigns: A Di…

200 papers

Influence Maximization (IM) aims to maximize the number of people that become aware of a product by finding the `best' set of `seed' users to initiate the product advertisement. Unlike prior arts on static social networks containing fixed…

Social and Information Networks · Computer Science 2019-11-14 Xudong Wu , Luoyi Fu , Zixin Zhang , Jingfan Meng , Xinbing Wang , Guihai Chen

We analyze the following group learning problem in the context of opinion diffusion: Consider a network with $M$ users, each facing $N$ options. In a discrete time setting, at each time step, each user chooses $K$ out of the $N$ options,…

Machine Learning · Computer Science 2013-09-17 Yang Liu , Mingyan Liu

In this paper we propose a novel framework for decentralized, online learning by many learners. At each moment of time, an instance characterized by a certain context may arrive to each learner; based on the context, the learner can select…

Machine Learning · Computer Science 2015-03-24 Cem Tekin , Mihaela van der Schaar

We study contextual bandits in the presence of a stage-wise constraint when the constraint must be satisfied both with high probability and in expectation. We start with the linear case where both the reward function and the stage-wise…

Machine Learning · Computer Science 2025-08-22 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett

Causal knowledge can be used to support decision-making problems. This has been recognized in the causal bandits literature, where a causal (multi-armed) bandit is characterized by a causal graphical model and a target variable. The arms…

Machine Learning · Computer Science 2025-10-14 Francisco N. F. Q. Simoes , Itai Feigenbaum , Mehdi Dastani , Thijs van Ommen

In many real-world scenarios, an individual's local social network carries significant influence over the opinions they form and subsequently propagate. In this paper, we propose a novel diffusion model -- the Pressure Threshold model (PT)…

Social and Information Networks · Computer Science 2026-04-03 Curt Stutsman , Eliot W. Robson , Abhishek K. Umrawal

We investigate contextual bandits in the presence of side-observations across arms in order to design recommendation algorithms for users connected via social networks. Users in social networks respond to their friends' activity, and hence…

Machine Learning · Computer Science 2020-10-27 Rahul Singh , Fang Liu , Xin Liu , Ness Shroff

We study the stochastic contextual bandit problem, where the reward is generated from an unknown function with additive noise. No assumption is made about the reward function other than boundedness. We propose a new algorithm, NeuralUCB,…

Machine Learning · Computer Science 2020-07-03 Dongruo Zhou , Lihong Li , Quanquan Gu

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

Contextual multi-armed bandit algorithms are widely used in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health. Most of the existing algorithms have regret proportional…

Machine Learning · Statistics 2020-02-14 Gi-Soo Kim , Myunghee Cho Paik

In this paper, we address the important issue of uncertainty in the edge influence probability estimates for the well studied influence maximization problem --- the task of finding $k$ seed nodes in a social network to maximize the…

Social and Information Networks · Computer Science 2016-06-14 Wei Chen , Tian Lin , Zihan Tan , Mingfei Zhao , Xuren Zhou

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

Machine Learning · Computer Science 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

In many real-world sequential decision-making problems, an action does not immediately reflect on the feedback and spreads its effects over a long time frame. For instance, in online advertising, investing in a platform produces an…

Machine Learning · Computer Science 2023-05-31 Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Intelligent agents equipped with causal knowledge can optimize their action spaces to avoid unnecessary exploration. The structural causal bandit framework provides a graphical characterization for identifying actions that are unable to…

Machine Learning · Computer Science 2025-11-25 Min Woo Park , Sanghack Lee

Aggression in online social networks has been studied mostly from the perspective of machine learning which detects such behavior in a static context. However, the way aggression diffuses in the network has received little attention as it…

Social and Information Networks · Computer Science 2021-08-31 Marinos Poiitis , Athena Vakali , Nicolas Kourtellis

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

Machine Learning · Computer Science 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic

We study the effectiveness of using multiple phases for maximizing the extent of information diffusion through a social network, and present insights while considering various aspects. In particular, we focus on the independent cascade…

Social and Information Networks · Computer Science 2018-02-27 Swapnil Dhamal

The information flows among the people while they communicate through social media websites. Due to the dependency on digital media, a person shares important information or regular updates with friends and family. The set of persons on…

Social and Information Networks · Computer Science 2024-06-14 Rahul Kumar Gautam , Anjeneya Swami Kare , Durga Bhavani S

Learning effective negotiation strategies poses two key challenges: the exploration-exploitation dilemma and dealing with large action spaces. However, there is an absence of learning-based approaches that effectively address these…

Artificial Intelligence · Computer Science 2024-07-02 Yexin Li , Zhancun Mu , Siyuan Qi