English
Related papers

Related papers: Divergence Meets Consensus: A Multi-Source Negativ…

200 papers

Negative sampling is a limiting factor w.r.t. the generalization of metric-learned neural networks. We show that uniform negative sampling provides little information about the class boundaries and thus propose three novel techniques for…

Machine Learning · Computer Science 2021-02-15 James O' Neill , Danushka Bollegala

As its availability and generality in online services, implicit feedback is more commonly used in recommender systems. However, implicit feedback usually presents noisy samples in real-world recommendation scenarios (such as misclicks or…

Information Retrieval · Computer Science 2024-05-29 Zhuangzhuang He , Yifan Wang , Yonghui Yang , Peijie Sun , Le Wu , Haoyue Bai , Jinqi Gong , Richang Hong , Min Zhang

Sampling proper negatives from a large document pool is vital to effectively train a dense retrieval model. However, existing negative sampling strategies suffer from the uninformative or false negative problem. In this work, we empirically…

Computation and Language · Computer Science 2022-10-25 Kun Zhou , Yeyun Gong , Xiao Liu , Wayne Xin Zhao , Yelong Shen , Anlei Dong , Jingwen Lu , Rangan Majumder , Ji-Rong Wen , Nan Duan , Weizhu Chen

Transferring knowledge from a cross-encoder teacher via Knowledge Distillation (KD) has become a standard paradigm for training retrieval models. While existing studies have largely focused on mining hard negatives to improve…

Information Retrieval · Computer Science 2026-04-29 Youngjoon Jang , Seongtae Hong , Hyeonseok Moon , Heuiseok Lim

Recommender system (RS) aims to capture personalized preferences from massive user behaviors, making them pivotal in the era of information explosion. However, the presence of ``information cocoons'', interaction sparsity, cold-start…

Information Retrieval · Computer Science 2025-07-28 Haokai Ma , Ruobing Xie , Lei Meng , Fuli Feng , Xiaoyu Du , Xingwu Sun , Zhanhui Kang , Xiangxu Meng

In the advent of big data and machine learning, researchers now have a wealth of congressional candidate ideal point estimates at their disposal for theory testing. Weak relationships raise questions about the extent to which they capture a…

Applications · Statistics 2026-01-09 Mellissa Meisels , Melody Huang , Tiffany M. Tang

Negative sampling is a pivotal technique in implicit collaborative filtering (CF) recommendation, enabling efficient and effective training by contrasting observed interactions with sampled unobserved ones. Recently, large language models…

Information Retrieval · Computer Science 2026-05-19 Jiayi Wu , Zhengyu Wu , Xunkai Li , Rong-Hua Li , Guoren Wang

Recommender systems (RS) have started to employ knowledge distillation, which is a model compression technique training a compact model (student) with the knowledge transferred from a cumbersome model (teacher). The state-of-the-art methods…

Information Retrieval · Computer Science 2021-06-08 Wonbin Kweon , SeongKu Kang , Hwanjo Yu

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Information Retrieval · Computer Science 2018-08-13 Xiangyu Zhao , Liang Zhang , Zhuoye Ding , Long Xia , Jiliang Tang , Dawei Yin

For image generation with diffusion models (DMs), a negative prompt n can be used to complement the text prompt p, helping define properties not desired in the synthesized image. While this improves prompt adherence and image quality,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Alakh Desai , Nuno Vasconcelos

This paper investigates negative sampling for contrastive learning in the context of audio-text retrieval. The strategy for negative sampling refers to selecting negatives (either audio clips or textual descriptions) from a pool of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-20 Huang Xie , Okko Räsänen , Tuomas Virtanen

Negative sampling has emerged as an effective technique that enables deep learning models to learn better representations by introducing the paradigm of learn-to-compare. The goal of this approach is to add robustness to deep learning…

Computation and Language · Computer Science 2025-03-26 Suman Adhya , Avishek Lahiri , Debarshi Kumar Sanyal , Partha Pratim Das

In contrastive self-supervised learning, positive samples are typically drawn from the same image but in different augmented views, resulting in a relatively limited source of positive samples. An effective way to alleviate this problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xianzhong Long , Chen Peng , Yun Li

Score Distillation Sampling (SDS) has been pivotal for leveraging pre-trained diffusion models in downstream tasks such as inverse problems, but it faces two major challenges: $(i)$ mode collapse and $(ii)$ latent space inversion, which…

Machine Learning · Computer Science 2024-10-15 Nicolas Zilberstein , Morteza Mardani , Santiago Segarra

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy

Negative sampling stands as a pivotal technique in dense retrieval, essential for training effective retrieval models and significantly impacting retrieval performance. While existing negative sampling methods have made commendable progress…

Information Retrieval · Computer Science 2024-02-20 Zhen Yang , Zhou Shao , Yuxiao Dong , Jie Tang

Personalized outfit recommendation has recently been in the spotlight with the rapid growth of the online fashion industry. However, recommending outfits has two significant challenges that should be addressed. The first challenge is that…

Information Retrieval · Computer Science 2021-10-14 Seongjae Kim , Jinseok Seol , Holim Lim , Sang-goo Lee

Collaborative filtering (CF) is a widely employed technique that predicts user preferences based on past interactions. Negative sampling plays a vital role in training CF-based models with implicit feedback. In this paper, we propose a…

Information Retrieval · Computer Science 2023-08-21 Xi Wu , Liangwei Yang , Jibing Gong , Chao Zhou , Tianyu Lin , Xiaolong Liu , Philip S. Yu

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu