English
Related papers

Related papers: Evaluating Performance and Bias of Negative Sampli…

200 papers

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods,…

Information Retrieval · Computer Science 2025-06-10 Rahul Agarwal , Amit Jaspal , Saurabh Gupta , Omkar Vichare

We consider the task of learning from both positive and negative feedback in a sequential recommendation scenario, as both types of feedback are often present in user interactions. Meanwhile, conventional sequential learning models usually…

Information Retrieval · Computer Science 2025-08-21 Veronika Ivanova , Evgeny Frolov , Alexey Vasilev

Neural ranking models (NRMs) have become one of the most important techniques in information retrieval (IR). Due to the limitation of relevance labels, the training of NRMs heavily relies on negative sampling over unlabeled data. In general…

Information Retrieval · Computer Science 2022-09-13 Yinqiong Cai , Jiafeng Guo , Yixing Fan , Qingyao Ai , Ruqing Zhang , Xueqi Cheng

The task of item recommendation requires ranking a large catalogue of items given a context. Item recommendation algorithms are evaluated using ranking metrics that depend on the positions of relevant items. To speed up the computation of…

Information Retrieval · Computer Science 2019-12-06 Steffen Rendle

The strategy for selecting candidate sets -- the set of items that the recommendation system is expected to rank for each user -- is an important decision in carrying out an offline top-$N$ recommender system evaluation. The set of…

Information Retrieval · Computer Science 2023-10-31 Ngozi Ihemelandu , Michael D. Ekstrand

In recent years, neural models have been repeatedly touted to exhibit state-of-the-art performance in recommendation. Nevertheless, multiple recent studies have revealed that the reported state-of-the-art results of many neural…

Information Retrieval · Computer Science 2023-05-04 Yushun Dong , Jundong Li , Tobias Schnabel

Recommendation and ranking systems are known to suffer from popularity bias; the tendency of the algorithm to favor a few popular items while under-representing the majority of other items. Prior research has examined various approaches for…

Information Retrieval · Computer Science 2021-03-12 Himan Abdollahpouri , Masoud Mansoury , Robin Burke , Bamshad Mobasher , Edward Malthouse

Online food ordering marketplaces are multi-stakeholder systems where recommendations impact the experience and growth of each participant in the system. A recommender system in this setting has to encapsulate the objectives and constraints…

Machine Learning · Computer Science 2020-08-25 Abhay Shukla , Jairaj Sathyanarayana , Dipyaman Banerjee

Sub-sampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the…

Machine Learning · Statistics 2017-09-07 Daniel Ting , Eric Brochu

Selection bias is prevalent in the data for training and evaluating recommendation systems with explicit feedback. For example, users tend to rate items they like. However, when rating an item concerning a specific user, most of the…

Information Retrieval · Computer Science 2021-09-14 Weishen Pan , Sen Cui , Hongyi Wen , Kun Chen , Changshui Zhang , Fei Wang

Sampling proper negatives from a large document pool is vital to effectively train a dense retrieval model. However, existing negative sampling strategies suffer from the uninformative or false negative problem. In this work, we empirically…

Computation and Language · Computer Science 2022-10-25 Kun Zhou , Yeyun Gong , Xiao Liu , Wayne Xin Zhao , Yelong Shen , Anlei Dong , Jingwen Lu , Rangan Majumder , Ji-Rong Wen , Nan Duan , Weizhu Chen

One of the challenges in contrastive learning is the selection of appropriate \textit{hard negative} examples, in the absence of label information. Random sampling or importance sampling methods based on feature similarity often lead to…

Machine Learning · Computer Science 2022-06-03 Afrina Tabassum , Muntasir Wahed , Hoda Eldardiry , Ismini Lourentzou

In implicit collaborative filtering (CF) task of recommender systems, recent works mainly focus on model structure design with promising techniques like graph neural networks (GNNs). Effective and efficient negative sampling methods that…

Information Retrieval · Computer Science 2024-03-29 Kexin Shi , Yun Zhang , Bingyi Jing , Wenjia Wang

In today's modern era of Big data, computationally efficient and scalable methods are needed to support timely insights and informed decision making. One such method is sub-sampling, where a subset of the Big data is analysed and used as…

Methodology · Statistics 2022-09-07 Amalan Mahendran , Helen Thompson , James M. McGree

Conventional collaborative filtering techniques treat a top-n recommendations problem as a task of generating a list of the most relevant items. This formulation, however, disregards an opposite - avoiding recommendations with completely…

Machine Learning · Computer Science 2016-07-15 Evgeny Frolov , Ivan Oseledets

Negative user preference is an important context that is not sufficiently utilized by many existing recommender systems. This context is especially useful in scenarios where the cost of negative items is high for the users. In this work, we…

Information Retrieval · Computer Science 2021-02-19 Bibek Paudel , Sandro Luck , Abraham Bernstein

Learning user preferences for products based on their past purchases or reviews is at the cornerstone of modern recommendation engines. One complication in this learning task is that some users are more likely to purchase products or review…

Information Retrieval · Computer Science 2023-03-08 Wanning Chen , Mohsen Bayati

Recommender systems help people find relevant content in a personalized way. One main promise of such systems is that they are able to increase the visibility of items in the long tail, i.e., the lesser-known items in a catalogue. Existing…

Information Retrieval · Computer Science 2024-07-03 Anastasiia Klimashevskaia , Dietmar Jannach , Mehdi Elahi , Christoph Trattner

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald