English
Related papers

Related papers: A Model-based Multi-Agent Personalized Short-Video…

200 papers

Personalized question recommendation aims to guide individual students through questions to enhance their mastery of learning targets. Most previous methods model this task as a Markov Decision Process and use reinforcement learning to…

Artificial Intelligence · Computer Science 2025-08-01 Haipeng Liu , Yuxuan Liu , Ting Long

In this paper, we argue that the paradigm commonly adopted for offline evaluation of sequential recommender systems is unsuitable for evaluating reinforcement learning-based recommenders. We find that most of the existing offline evaluation…

Information Retrieval · Computer Science 2023-01-04 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

An increasing reliance on recommender systems has led to concerns about the creation of filter bubbles on social media, especially on short video platforms like TikTok. However, their formation is still not entirely understood due to the…

Information Retrieval · Computer Science 2025-04-15 Nicholas Sukiennik , Haoyu Wang , Zailin Zeng , Chen Gao , Yong Li

This paper proposes a generative method to dynamically simulate users' short video watching journey for watch time prediction in short video recommendation. Unlike existing methods that rely on multimodal features for video content…

Information Retrieval · Computer Science 2025-09-23 Chao Feng , Yanze Zhang , Chenghao Zhang

Sequential recommendation is one of the most important tasks in recommender systems, which aims to recommend the next interacted item with historical behaviors as input. Traditional sequential recommendation always mainly considers the…

Information Retrieval · Computer Science 2023-08-09 Yunzhu Pan , Chen Gao , Jianxin Chang , Yanan Niu , Yang Song , Kun Gai , Depeng Jin , Yong Li

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Information Retrieval · Computer Science 2023-03-13 Ziru Liu , Jiejie Tian , Qingpeng Cai , Xiangyu Zhao , Jingtong Gao , Shuchang Liu , Dayou Chen , Tonghao He , Dong Zheng , Peng Jiang , Kun Gai

Traditional collaborative filtering (CF) based recommender systems tend to perform poorly when the user-item interactions/ratings are highly scarce. To address this, we propose a learning framework that improves collaborative filtering with…

Information Retrieval · Computer Science 2020-12-18 Wenlin Wang , Hongteng Xu , Ruiyi Zhang , Wenqi Wang , Piyush Rai , Lawrence Carin

We present the Learned Ranking Function (LRF), a system that takes short-term user-item behavior predictions as input and outputs a slate of recommendations that directly optimizes for long-term user satisfaction. Most previous work is…

Machine Learning · Computer Science 2024-08-14 Yi Wu , Daryl Chang , Jennifer She , Zhe Zhao , Li Wei , Lukasz Heldt

The rapid growth of short videos has necessitated effective recommender systems to match users with content tailored to their evolving preferences. Current video recommendation models primarily treat each video as a whole, overlooking the…

Information Retrieval · Computer Science 2025-05-06 Zhiyu He , Zhixin Ling , Jiayu Li , Zhiqiang Guo , Weizhi Ma , Xinchen Luo , Min Zhang , Guorui Zhou

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

Machine Learning · Computer Science 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

We consider the problem of sequential recommendation, where the current recommendation is made based on past interactions. This recommendation task requires efficient processing of the sequential data and aims to provide recommendations…

Information Retrieval · Computer Science 2023-07-28 Xumei Xi , Yuke Zhao , Quan Liu , Liwen Ouyang , Yang Wu

Human attention is a scarce resource in modern computing. A multitude of microtasks vie for user attention to crowdsource information, perform momentary assessments, personalize services, and execute actions with a single touch. A lot gets…

Human-Computer Interaction · Computer Science 2020-07-21 Bo-Jhang Ho , Bharathan Balaji , Mehmet Koseoglu , Sandeep Sandha , Siyou Pei , Mani Srivastava

Recommending novel content, which expands user horizons by introducing them to new interests, has been shown to improve users' long-term experience on recommendation platforms \cite{chen2021values}. Users however are not constantly looking…

Information Retrieval · Computer Science 2023-06-05 Pan Li , Yuyan Wang , Ed H. Chi , Minmin Chen

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users sequentially interact with the system and provide complex and multi-faceted…

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

Adversarial attacks on video recognition models have been explored recently. However, most existing works treat each video frame equally and ignore their temporal interactions. To overcome this drawback, a few methods try to select some key…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Xingxing Wei , Huanqian Yan , Bo Li

Recommender systems objectives can be broadly characterized as modeling user preferences over short-or long-term time horizon. A large body of previous research studied long-term recommendation through dimensionality reduction techniques…

Information Retrieval · Computer Science 2018-07-25 Kiewan Villatel , Elena Smirnova , Jérémie Mary , Philippe Preux

Recently, interactive recommendation systems based on reinforcement learning have been attended by researchers due to the consider recommendation procedure as a dynamic process and update the recommendation model based on immediate user…

Information Retrieval · Computer Science 2021-11-01 Vahid Baghi , Seyed Mohammad Seyed Motehayeri , Ali Moeini , Rooholah Abedian

Given an input query, a recommendation model is trained using user feedback data (e.g., click data) to output a ranked list of items. In real-world systems, besides accuracy, an important consideration for a new model is novelty of its…

Information Retrieval · Computer Science 2024-06-21 Amit Sharma , Hua Li , Xue Li , Jian Jiao

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid growth of information…

Artificial Intelligence · Computer Science 2021-02-02 Milad Vaali Esfahaani , Yanbo Xue , Peyman Setoodeh