English
Related papers

Related papers: Personalized Negative Reservoir for Incremental Le…

200 papers

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

In designing personalized ranking algorithms, it is desirable to encourage a high precision at the top of the ranked list. Existing methods either seek a smooth convex surrogate for a non-smooth ranking metric or directly modify updating…

Machine Learning · Statistics 2018-08-15 Kuan Liu , Prem Natarajan

In this paper, we propose a theoretically founded sequential strategy for training large-scale Recommender Systems (RS) over implicit feedback, mainly in the form of clicks. The proposed approach consists in minimizing pairwise ranking loss…

Information Retrieval · Computer Science 2020-12-15 Aleksandra Burashnikova , Marianne Clausel , Charlotte Laclau , Frack Iutzeller , Yury Maximov , Massih-Reza Amini

Analytical models developed in offline settings with pre-prepared data are typically used to predict students' performance. However, when data are available over time, this learning method is not suitable anymore. Online learning is…

Computers and Society · Computer Science 2024-07-16 Chahrazed Labba , Anne Boyer

In modern recommender systems, CTR/CVR models are increasingly trained with ranking objectives to improve item ranking quality. While this shift aligns training more closely with serving goals, most existing methods rely on in-batch…

Information Retrieval · Computer Science 2025-06-17 YaChen Yan , Liubo Li , Ravi Choudhary

Recommender systems provide essential web services by learning users' personal preferences from collected data. However, in many cases, systems also need to forget some training data. From the perspective of privacy, several privacy…

Information Retrieval · Computer Science 2022-01-26 Chong Chen , Fei Sun , Min Zhang , Bolin Ding

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu

User behavior on online platforms is evolving, reflecting real-world changes in how people post, whether it's helpful messages or hate speech. Models that learn to capture this content can experience a decrease in performance over time due…

Machine Learning · Computer Science 2025-11-04 Yasas Senarath , Hemant Purohit

We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing…

Machine Learning · Statistics 2022-04-22 Yuta Saito , Masahiro Nomura

Recommender systems predict what items a user will interact with next, based on their past interactions. The problem is often approached through supervised learning, but recent advancements have shifted towards policy optimization of…

Machine Learning · Computer Science 2023-04-28 Dawen Liang , Nikos Vlassis

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based…

Information Retrieval · Computer Science 2024-12-16 Hansa Meghwani

In recommendation systems, there has been a growth in the number of recommendable items (# of movies, music, products). When the set of recommendable items is large, training and evaluation of item recommendation models becomes…

Information Retrieval · Computer Science 2024-10-14 Anushya Subbiah , Steffen Rendle , Vikram Aggarwal

Session-based recommendation has received growing attention recently due to the increasing privacy concern. Despite the recent success of neural session-based recommenders, they are typically developed in an offline manner using a static…

Machine Learning · Computer Science 2020-07-24 Fei Mi , Xiaoyu Lin , Boi Faltings

The scarcity of high-quality training data presents a fundamental bottleneck to scaling machine learning models. This challenge is particularly acute in recommendation systems, where extreme sparsity in user interactions leads to rugged…

Information Retrieval · Computer Science 2026-05-12 Luankang Zhang , Hao Wang , Zhongzhou Liu , Mingjia Yin , Yonghao Huang , Jiaqi Li , Wei Guo , Yong Liu , Huifeng Guo , Defu Lian , Enhong Chen

Recommendation models trained on the user feedback collected from deployed recommendation systems are commonly biased. User feedback is considerably affected by the exposure mechanism, as users only provide feedback on the items exposed to…

Information Retrieval · Computer Science 2023-11-13 Hangtong Xu , Yuanbo Xu , Yongjian Yang , Fuzhen Zhuang , Hui Xiong

In session-based or sequential recommendation, it is important to consider a number of factors like long-term user engagement, multiple types of user-item interactions such as clicks, purchases etc. The current state-of-the-art supervised…

Machine Learning · Computer Science 2020-06-12 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Class-incremental learning deals with sequential data streams composed of batches of classes. Various algorithms have been proposed to address the challenging case where samples from past classes cannot be stored. However, selecting an…

Machine Learning · Computer Science 2024-03-28 Eva Feillet , Adrian Popescu , Céline Hudelot