English
Related papers

Related papers: Hierarchical Conversational Preference Elicitation…

200 papers

Conversational recommender systems offer the promise of interactive, engaging ways for users to find items they enjoy. We seek to improve conversational recommendation via three dimensions: 1) We aim to mimic a common mode of human…

Computation and Language · Computer Science 2021-12-13 Shuyang Li , Bodhisattwa Prasad Majumder , Julian McAuley

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik

Two-sided online matching platforms are employed in various markets. However, agents' preferences in the current market are usually implicit and unknown, thus needing to be learned from data. With the growing availability of dynamic side…

Machine Learning · Computer Science 2024-05-30 Yuantong Li , Chi-hua Wang , Guang Cheng , Will Wei Sun

We investigate contextual bandits in the presence of side-observations across arms in order to design recommendation algorithms for users connected via social networks. Users in social networks respond to their friends' activity, and hence…

Machine Learning · Computer Science 2020-10-27 Rahul Singh , Fang Liu , Xin Liu , Ness Shroff

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

Machine Learning · Computer Science 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

Contextual bandit learning is increasingly favored in modern large-scale recommendation systems. To better utlize the contextual information and available user or item features, the integration of neural networks have been introduced to…

Machine Learning · Computer Science 2024-06-05 Hongbo Guo , Zheqing Zhu

Contextual bandits are widely used in industrial personalization systems. These online learning frameworks learn a treatment assignment policy in the presence of treatment effects that vary with the observed contextual features of the…

Machine Learning · Computer Science 2022-05-11 Claudia Roberts , Maria Dimakopoulou , Qifeng Qiao , Ashok Chandrashekhar , Tony Jebara

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…

Information Retrieval · Computer Science 2020-08-24 Mawulolo K. Ameko , Miranda L. Beltzer , Lihua Cai , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes

There is much empirical evidence that item-item collaborative filtering works well in practice. Motivated to understand this, we provide a framework to design and analyze various recommendation algorithms. The setup amounts to online binary…

Machine Learning · Computer Science 2016-01-11 Guy Bresler , Devavrat Shah , Luis F. Voloch

We consider a novel variant of the contextual bandit problem (i.e., the multi-armed bandit with side-information, or context, available to a decision-maker) where the reward associated with each context-based decision may not always be…

Machine Learning · Computer Science 2020-07-21 Djallel Bouneffouf , Sohini Upadhyay , Yasaman Khazaeni

We address the cold start problem in recommendation systems assuming no contextual information is available neither about users, nor items. We consider the case in which we only have access to a set of ratings of items by users. Most of the…

Machine Learning · Computer Science 2014-07-11 Jérémie Mary , Romaric Gaudel , Preux Philippe

Decision-making problems of sequential nature, where decisions made in the past may have an impact on the future, are used to model many practically important applications. In some real-world applications, feedback about a decision is…

Machine Learning · Computer Science 2023-03-02 Ronald C. van den Broek , Rik Litjens , Tobias Sagis , Luc Siecker , Nina Verbeeke , Pratik Gajane

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by applications in clinical trials and recommendation systems, we assume that two arms are connected if and only if they are similar (i.e.,…

Machine Learning · Computer Science 2025-09-18 Han Qi , Fei Guo , Li Zhu , Qiaosheng Zhang

This paper offers a comprehensive analysis of collaborative bandit algorithms and provides a thorough comparison of their performance. Collaborative bandits aim to improve the performance of contextual bandits by introducing relationships…

Machine Learning · Computer Science 2025-10-07 Eren Ozbay , Ashkan Golgoon

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

Online platforms in the Internet Economy commonly incorporate recommender systems that recommend products (or "arms") to users (or "agents"). A key challenge in this domain arises from myopic agents who are naturally incentivized to exploit…

Information Retrieval · Computer Science 2024-06-19 Xiaowu Dai , Wenlu Xu , Yuan Qi , Michael I. Jordan

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric recommendations has…

Information Retrieval · Computer Science 2023-12-22 Yikun Ban , Yunzhe Qi , Jingrui He

This paper presents a new contextual bandit algorithm, NeuralBandit, which does not need hypothesis on stationarity of contexts and rewards. Several neural networks are trained to modelize the value of rewards knowing the context. Two…

Neural and Evolutionary Computing · Computer Science 2014-09-30 Robin Allesiardo , Raphael Feraud , Djallel Bouneffouf

In this paper, we study a cold-start problem in recommendation systems where we have completely new users entered the systems. There is not any interaction or feedback of the new users with the systems previoustly, thus no ratings are…

Information Retrieval · Computer Science 2014-05-30 Hai Thanh Nguyen , Jérémie Mary , Philippe Preux

Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while maximizing profit for the EC platform remains a sophisticated…

Machine Learning · Computer Science 2023-02-15 Jiaming Cheng , Duong Thuy Anh Nguyen , Lele Wang , Duong Tung Nguyen , Vijay K. Bhargava