English
Related papers

Related papers: Contextual User Browsing Bandits for Large-Scale O…

200 papers

In this paper, we study a cold-start problem in recommendation systems where we have completely new users entered the systems. There is not any interaction or feedback of the new users with the systems previoustly, thus no ratings are…

Information Retrieval · Computer Science 2014-05-30 Hai Thanh Nguyen , Jérémie Mary , Philippe Preux

We consider the problem of personalised news recommendation where each user consumes news in a sequential fashion. Existing personalised news recommendation methods focus on exploiting user interests and ignores exploration in…

Information Retrieval · Computer Science 2022-06-30 Mengyan Zhang , Thanh Nguyen-Tang , Fangzhao Wu , Zhenyu He , Xing Xie , Cheng Soon Ong

In networked environments, users frequently share recommendations about content, products, services, and courses of action with others. The extent to which such recommendations are successful and adopted is highly contextual, dependent on…

Machine Learning · Computer Science 2025-10-23 Ahmed Sayeed Faruk , Mohammad Shahverdikondori , Elena Zheleva

Traditional online learning models are typically initialized from scratch. By contrast, contemporary real-world applications often have access to historical datasets that can potentially enhanced the online learning processes. We study how…

Machine Learning · Computer Science 2025-12-19 Wang Chi Cheung , Lixing Lyu

Contextual bandit algorithms have become widely used for recommendation in online systems (e.g. marketplaces, music streaming, news), where they now wield substantial influence on which items get exposed to the users. This raises questions…

Machine Learning · Computer Science 2021-09-14 Lequn Wang , Yiwei Bai , Wen Sun , Thorsten Joachims

Most recommender systems recommend a list of items. The user examines the list, from the first item to the last, and often chooses the first attractive item and does not examine the rest. This type of user behavior can be modeled by the…

Machine Learning · Computer Science 2016-07-01 Shi Zong , Hao Ni , Kenny Sung , Nan Rosemary Ke , Zheng Wen , Branislav Kveton

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

Econometrics · Economics 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

Conservative mechanism is a desirable property in decision-making problems which balance the tradeoff between the exploration and exploitation. We propose the novel \emph{conservative contextual combinatorial cascading bandit…

Machine Learning · Computer Science 2021-04-26 Kun Wang , Canzhe Zhao , Shuai Li , Shuo Shao

Conversational recommendation systems elicit user preferences by interacting with users to obtain their feedback on recommended commodities. Such systems utilize a multi-armed bandit framework to learn user preferences in an online manner…

Machine Learning · Computer Science 2024-07-29 Shuhua Yang , Hui Yuan , Xiaoying Zhang , Mengdi Wang , Hong Zhang , Huazheng Wang

Contextual bandits are a rich model for sequential decision making given side information, with important applications, e.g., in recommender systems. We propose novel algorithms for contextual bandits harnessing neural networks to…

Machine Learning · Statistics 2022-03-01 Parnian Kassraie , Andreas Krause

Contextual bandits are widely used in industrial personalization systems. These online learning frameworks learn a treatment assignment policy in the presence of treatment effects that vary with the observed contextual features of the…

Machine Learning · Computer Science 2022-05-11 Claudia Roberts , Maria Dimakopoulou , Qifeng Qiao , Ashok Chandrashekhar , Tony Jebara

Recommender systems relying on contextual multi-armed bandits continuously improve relevant item recommendations by taking into account the contextual information. The objective of bandit algorithms is to learn the best arm (e.g., best item…

Machine Learning · Computer Science 2025-12-10 Ahmed Sayeed Faruk , Elena Zheleva

The linear contextual bandit literature is mostly focused on the design of efficient learning algorithms for a given representation. However, a contextual bandit problem may admit multiple linear representations, each one with different…

Machine Learning · Computer Science 2021-04-09 Matteo Papini , Andrea Tirinzoni , Marcello Restelli , Alessandro Lazaric , Matteo Pirotta

Contextual bandits with linear payoffs, which are also known as linear bandits, provide a powerful alternative for solving practical problems of sequential decisions, e.g., online advertisements. In the era of big data, contextual data…

Machine Learning · Computer Science 2019-03-21 Xiaotian Yu

Contextual bandits serve as a fundamental algorithmic framework for optimizing recommendation decisions online. Though extensive attention has been paid to tailoring contextual bandits for recommendation applications, the "herding effects"…

Machine Learning · Computer Science 2024-08-29 Luyue Xu , Liming Wang , Hong Xie , Mingqiang Zhou

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…

Information Retrieval · Computer Science 2020-08-24 Mawulolo K. Ameko , Miranda L. Beltzer , Lihua Cai , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes

We consider a novel variant of the contextual bandit problem (i.e., the multi-armed bandit with side-information, or context, available to a decision-maker) where the reward associated with each context-based decision may not always be…

Machine Learning · Computer Science 2020-07-21 Djallel Bouneffouf , Sohini Upadhyay , Yasaman Khazaeni

Motivated by concerns about making online decisions that incur undue amount of risk at each time step, in this paper, we formulate the probably anytime-safe stochastic combinatorial semi-bandits problem. In this problem, the agent is given…

Machine Learning · Computer Science 2023-06-05 Yunlong Hou , Vincent Y. F. Tan , Zixin Zhong

Many physical systems have underlying safety considerations that require that the strategy deployed ensures the satisfaction of a set of constraints. Further, often we have only partial information on the state of the system. We study the…

Machine Learning · Computer Science 2022-03-30 Jiabin Lin , Xian Yeow Lee , Talukder Jubery , Shana Moothedath , Soumik Sarkar , Baskar Ganapathysubramanian

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang