English
Related papers

Related papers: On the Theories Behind Hard Negative Sampling for …

200 papers

Large retail outlets offer products that may be domain-specific, and this requires having a model that can understand subtle differences in similar items. Sampling techniques used to train these models are most of the time, computationally…

Information Retrieval · Computer Science 2025-11-04 Uthman Jinadu , Siawpeng Er , Le Yu , Chen Liang , Bingxin Li , Yi Ding , Aleksandar Velkoski

While deep learning has demonstrated impressive progress, it remains a daunting challenge to learn from hard samples as these samples are usually noisy and intricate. These hard samples play a crucial role in the optimal performance of deep…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Qiao Xiao , Boqian Wu , Lu Yin , Christopher Neil Gadzinski , Tianjin Huang , Mykola Pechenizkiy , Decebal Constantin Mocanu

Pairwise learning strategies are prevalent for optimizing recommendation models on implicit feedback data, which usually learns user preference by discriminating between positive (i.e., clicked by a user) and negative items (i.e., obtained…

Information Retrieval · Computer Science 2023-02-17 Xiao Chen , Wenqi Fan , Jingfan Chen , Haochen Liu , Zitao Liu , Zhaoxiang Zhang , Qing Li

News recommender systems are hindered by the brief lifespan of articles, as they undergo rapid relevance decay. Recent studies have demonstrated the potential of content-based neural techniques in tackling this problem. However, these…

Information Retrieval · Computer Science 2024-11-14 Miguel Ângelo Rebelo , João Vinagre , Ivo Pereira , Álvaro Figueira

Memory-augmented language agents rely on embedding models for effective memory retrieval. However, existing training data construction overlooks a critical limitation: the hierarchical difficulty of negative samples and their natural…

Computation and Language · Computer Science 2026-01-22 Motong Tian , Allen P. Wong , Mingjun Mao , Wangchunshu Zhou

Heuristic negative sampling enhances recommendation performance by selecting negative samples of varying hardness levels from predefined candidate pools to guide the model toward learning more accurate decision boundaries. However, our…

Machine Learning · Computer Science 2025-08-12 Chu Zhao , Eneng Yang , Yizhou Dang , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Learning from implicit feedback is a fundamental problem in modern recommender systems, where only positive interactions are observed and explicit negative signals are unavailable. In such settings, negative sampling plays a critical role…

Information Retrieval · Computer Science 2026-02-24 Chen Chen , Haobo Lin , Yuanbo Xu

Unsupervised sentence representation learning remains a critical challenge in modern natural language processing (NLP) research. Recently, contrastive learning techniques have achieved significant success in addressing this issue by…

Computation and Language · Computer Science 2024-11-20 Wenxiao Liu , Zihong Yang , Chaozhuo Li , Zijin Hong , Jianfeng Ma , Zhiquan Liu , Litian Zhang , Feiran Huang

Fast item ranking is an important task in recommender systems. In previous works, graph-based Approximate Nearest Neighbor (ANN) approaches have demonstrated good performance on item ranking tasks with generic searching/matching measures…

Information Retrieval · Computer Science 2022-11-02 Khoa Doan , Shulong Tan , Weijie Zhao , Ping Li

High-dimensional, low sample-size (HDLSS) data problems have been a topic of immense importance for the last couple of decades. There is a vast literature that proposed a wide variety of approaches to deal with this situation, among which…

Methodology · Statistics 2021-07-09 Kaixu Yang , Tapabrata Maiti

Distantly supervised named entity recognition (DS-NER) has been proposed to exploit the automatically labeled training data instead of human annotations. The distantly annotated datasets are often noisy and contain a considerable number of…

Computation and Language · Computer Science 2023-05-23 Lu Xu , Lidong Bing , Wei Lu

Collaborative filtering (CF) stands as a cornerstone in recommender systems, yet effectively leveraging the massive unlabeled data presents a significant challenge. Current research focuses on addressing the challenge of unlabeled data by…

Information Retrieval · Computer Science 2024-12-25 Yuhan Zhao , Rui Chen , Qilong Han , Hongtao Song , Li Chen

The first part of this thesis focuses on maximizing the overall recommendation accuracy. This accuracy is usually evaluated with some user-oriented metric tailored to the recommendation scenario, but because recommendation is usually…

Information Retrieval · Computer Science 2023-11-14 Roger Zhe Li

Recommenders built upon implicit collaborative filtering are typically trained to distinguish between users' positive and negative preferences. When direct observations of the latter are unavailable, negative training data are constructed…

Information Retrieval · Computer Science 2026-01-28 Yueqing Xuan , Kacper Sokol , Mark Sanderson , Jeffrey Chan

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

Machine Learning · Computer Science 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

Negative sampling plays a crucial role in training successful sequential recommendation models. Instead of merely employing random negative sample selection, numerous strategies have been proposed to mine informative negative samples to…

Information Retrieval · Computer Science 2023-06-21 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

Next-item recommender systems are often trained using only positive feedback with randomly-sampled negative feedback. We show the benefits of using real negative feedback both as inputs into the user sequence and also as negative targets…

Machine Learning · Computer Science 2025-07-28 M. Jeffrey Mei , Oliver Bembom , Andreas F. Ehmann

Recommender systems (RSs) employ user-item feedback, e.g., ratings, to match customers to personalized lists of products. Approaches to top-k recommendation mainly rely on Learning-To-Rank algorithms and, among them, the most widely adopted…

Information Retrieval · Computer Science 2021-07-30 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Felice Antonio Merra

Large-scale supervised classification algorithms, especially those based on deep convolutional neural networks (DCNNs), require vast amounts of training data to achieve state-of-the-art performance. Decreasing this data requirement would…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Maya Kabkab , Azadeh Alavi , Rama Chellappa

Item recommendation is the task of predicting a personalized ranking on a set of items (e.g. websites, movies, products). In this paper, we investigate the most common scenario with implicit feedback (e.g. clicks, purchases). There are many…

Information Retrieval · Computer Science 2012-05-14 Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , Lars Schmidt-Thieme