English
Related papers

Related papers: Epinet for Content Cold Start

200 papers

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Despite recommender systems play a key role in network content platforms, mining the user's interests is still a significant challenge. Existing works predict the user interest by utilizing user behaviors, i.e., clicks, views, etc., but…

Information Retrieval · Computer Science 2023-08-15 Xuanji Xiao , Huaqiang Dai , Qian Dong , Shuzi Niu , Yuzhen Liu , Pei Liu

The aim of the recommender systems is to provide relevant and potentially interesting information to each user. This is fulfilled by utilizing the already recorded tendencies of similar users or detecting items similar to interested items…

Social and Information Networks · Computer Science 2019-12-20 Mohammad Reza Zarei , Mohammad R. Moosavi

Thompson sampling is an algorithm for online decision problems where actions are taken sequentially in a manner that must balance between exploiting what is known to maximize immediate performance and investing to accumulate new information…

Machine Learning · Computer Science 2020-07-16 Daniel Russo , Benjamin Van Roy , Abbas Kazerouni , Ian Osband , Zheng Wen

Personalization is a crucial aspect of many online experiences. In particular, content ranking is often a key component in delivering sophisticated personalization results. Commonly, supervised learning-to-rank methods are applied, which…

Machine Learning · Computer Science 2020-04-29 Beyza Ermis , Patrick Ernst , Yannik Stein , Giovanni Zappella

We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence…

Information Retrieval · Computer Science 2024-07-08 Shameem A Puthiya Parambath , Christos Anagnostopoulos , Roderick Murray-Smith

We develop a novel latent-bandit algorithm for tackling the cold-start problem for new users joining a recommender system. This new algorithm significantly outperforms the state of the art, simultaneously achieving both higher accuracy and…

Information Retrieval · Computer Science 2023-05-31 David Young , Douglas Leith

Traditional recommender systems based on revealed preferences often fail to capture the fundamental duality in user behavior, where consumption choices are driven by both inherent value (enrichment) and instant appeal (temptation).…

Information Retrieval · Computer Science 2025-07-24 Md Sanzeed Anwar , Paramveer S. Dhillon , Grant Schoenebeck

Reinforcement learning (RL) has shown great promise in optimizing long-term user interest in recommender systems. However, existing RL-based recommendation methods need a large number of interactions for each user to learn a robust…

Machine Learning · Computer Science 2020-12-07 Yanan Wang , Yong Ge , Li Li , Rui Chen , Tong Xu

We address the problem of online sequential decision making, i.e., balancing the trade-off between exploiting the current knowledge to maximize immediate performance and exploring the new information to gain long-term benefits using the…

Machine Learning · Computer Science 2022-09-20 Kartik Anand Pant , Amod Hegde , K. V. Srinivas

In recommender systems, a cold-start problem occurs when there is no past interaction record associated with the user or item. Typical solutions to the cold-start problem make use of contextual information, such as user demographic…

Information Retrieval · Computer Science 2021-06-07 Yihong Zhang , Takuya Maekawa , Takahiro Hara

We study the effects of approximate inference on the performance of Thompson sampling in the $k$-armed bandit problems. Thompson sampling is a successful algorithm for online decision-making but requires posterior inference, which often…

Machine Learning · Computer Science 2020-01-16 My Phan , Yasin Abbasi-Yadkori , Justin Domke

For tackling the well known cold-start user problem in model-based recommender systems, one approach is to recommend a few items to a cold-start user and use the feedback to learn a profile. The learned profile can then be used to make good…

Information Retrieval · Computer Science 2017-03-02 Sampoorna Biswas , Laks V. S. Lakshmanan , Senjuti Basu Ray

The last decade has witnessed many successes of deep learning-based models for industry-scale recommender systems. These models are typically trained offline in a batch manner. While being effective in capturing users' past interactions…

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

Machine Learning · Computer Science 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

Information Retrieval (IR) systems used in search and recommendation platforms frequently employ Learning-to-Rank (LTR) models to rank items in response to user queries. These models heavily rely on features derived from user interactions,…

Information Retrieval · Computer Science 2024-12-11 Randy Ardywibowo , Rakesh Sunki , Lucy Kuo , Sankalp Nayak

Online interactive recommender systems strive to promptly suggest to consumers appropriate items (e.g., movies, news articles) according to the current context including both the consumer and item content information. However, such context…

Information Retrieval · Computer Science 2021-07-02 Qing Wang , Chunqiu Zeng , Wubai Zhou , Tao Li , Larisa Shwartz , Genady Ya. Grabarnik

The item cold-start problem is critical for online recommendation systems, as the success of this phase determines whether high-quality new items can transition to popular ones, receive essential feedback to inspire creators, and thus lead…

Information Retrieval · Computer Science 2025-06-19 Yu-Ting Lan , Yang Huo , Yi Shen , Xiao Yang , Zuotao Liu

Addressing the challenges related to data sparsity, cold-start problems, and diversity in recommendation systems is both crucial and demanding. Many current solutions leverage knowledge graphs to tackle these issues by combining both…

Information Retrieval · Computer Science 2024-03-28 Yejin Kim , Scott Rome , Kevin Foley , Mayur Nankani , Rimon Melamed , Javier Morales , Abhay Yadav , Maria Peifer , Sardar Hamidian , H. Howie Huang