English
Related papers

Related papers: Simulated Contextual Bandits for Personalization T…

200 papers

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

Data Structures and Algorithms · Computer Science 2014-05-21 Aleksandrs Slivkins

In this paper, we propose a pipeline to generate contextualized list recommendations with descriptive shelves in the domain of audiobooks. By creating several shelves for topics the user has an affinity to, e.g. Uplifting Women's Fiction,…

Intelligent recommendation systems have clearly increased the revenue of well-known e-commerce firms. Users receive product recommendations from recommendation systems. Cinematic recommendations are made to users by a movie recommendation…

Information Retrieval · Computer Science 2026-03-02 Rohit Chivukula , T. Jaya Lakshmi , Hemlata Sharma , C. H. S. N. P. Sairam Rallabandi

Users are able to access millions of songs through music streaming services like Spotify, Pandora, and Deezer. Access to such large catalogs, created a need for relevant song recommendations. However, user preferences are highly subjective…

Information Retrieval · Computer Science 2020-09-08 Boning Gong , Mesut Kaya , Nava Tintarev

Contextual bandits are a rich model for sequential decision making given side information, with important applications, e.g., in recommender systems. We propose novel algorithms for contextual bandits harnessing neural networks to…

Machine Learning · Statistics 2022-03-01 Parnian Kassraie , Andreas Krause

Contextual multi-armed bandit has shown to be an effective tool in recommender systems. In this paper, we study a novel problem of multi-facet bandits involving a group of bandits, each characterizing the users' needs from one unique…

Machine Learning · Computer Science 2021-07-02 Yikun Ban , Jingrui He , Curtiss B. Cook

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for designing self-learning security modules for computer networks and related tasks. The paper has two contributions: a conceptual one and an…

Networking and Internet Architecture · Computer Science 2012-07-13 Tobias Jung , Sylvain Martin , Damien Ernst , Guy Leduc

Recommendation has become one of the most important components of online services for improving sale records, however visualization work for online recommendation is still very limited. This paper presents an interactive recommendation…

Information Retrieval · Computer Science 2017-01-03 Kodzo Wegba , Aidong Lu , Yuemeng Li , Wencheng Wang

Personalized recommendation of Points of Interest (POIs) plays a key role in satisfying users on Location-Based Social Networks (LBSNs). In this paper, we propose a probabilistic model to find the mapping between user-annotated tags and…

Information Retrieval · Computer Science 2018-06-18 Mohammad Aliannejadi , Fabio Crestani

Artificial behavioral agents are often evaluated based on their consistent behaviors and performance to take sequential actions in an environment to maximize some notion of cumulative reward. However, human decision making in real life…

Artificial Intelligence · Computer Science 2021-12-28 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf , Jenna Reinen , Irina Rish

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

Machine Learning · Computer Science 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

A huge amount of user generated content related to movies is created with the popularization of web 2.0. With these continues exponential growth of data, there is an inevitable need for recommender systems as people find it difficult to…

Information Retrieval · Computer Science 2019-06-04 Lasitha Uyangoda , Supunmali Ahangama , Tharindu Ranasinghe

Micro-videos have recently gained immense popularity, sparking critical research in micro-video recommendation with significant implications for the entertainment, advertising, and e-commerce industries. However, the lack of large-scale…

Information Retrieval · Computer Science 2023-09-28 Yongxin Ni , Yu Cheng , Xiangyan Liu , Junchen Fu , Youhua Li , Xiangnan He , Yongfeng Zhang , Fajie Yuan

To address the challenge of information overload from massive web contents, recommender systems are widely applied to retrieve and present personalized results for users. However, recommendation tasks are inherently constrained to filtering…

Artificial Intelligence · Computer Science 2025-06-04 Jiongnan Liu , Zhicheng Dou , Ning Hu , Chenyan Xiong

In this work, we tackle the problem of adapting a real-time recommender system to multiple application domains, and their underlying data models and customization requirements. To do that, we present Uptrendz, a multi-domain recommendation…

Information Retrieval · Computer Science 2023-01-04 Emanuel Lacic , Tomislav Duricic , Leon Fadljevic , Dieter Theiler , Dominik Kowald

Recent advancements in Large Language Models (LLMs) have expanded context windows to million-token scales, yet benchmarks for evaluating memory remain limited to short-session synthetic dialogues. We introduce \textsc{MemoryCD}, the first…

Computation and Language · Computer Science 2026-03-30 Weizhi Zhang , Xiaokai Wei , Wei-Chieh Huang , Zheng Hui , Chen Wang , Michelle Gong , Philip S. Yu

In everyday conversations, humans can take on different roles and adapt their vocabulary to their chosen roles. We explore whether LLMs can take on, that is impersonate, different roles when they generate text in-context. We ask LLMs to…

Artificial Intelligence · Computer Science 2023-11-28 Leonard Salewski , Stephan Alaniz , Isabel Rio-Torto , Eric Schulz , Zeynep Akata

Contextual bandit and reinforcement learning algorithms have been successfully used in various interactive learning systems such as online advertising, recommender systems, and dynamic pricing. However, they have yet to be widely adopted in…

Machine Learning · Computer Science 2022-09-23 Sorawit Saengkyongam , Nikolaj Thams , Jonas Peters , Niklas Pfister

Recommender systems should adapt to user interests as the latter evolve. A prevalent cause for the evolution of user interests is the influence of their social circle. In general, when the interests are not known, online algorithms that…

Machine Learning · Computer Science 2020-09-23 Silviu Maniu , Stratis Ioannidis , Bogdan Cautis

We introduce a Multi-User Contextual Cascading Bandit model, a new combinatorial bandit framework that captures realistic online advertising scenarios where multiple users interact with sequentially displayed items simultaneously. Unlike…

Machine Learning · Computer Science 2025-08-26 Jiho Park , Huiwen Jia