English
Related papers

Related papers: Bayesian Negative Sampling for Recommendation

200 papers

Self-supervised representation learning on image-text data facilitates crucial medical applications, such as image classification, visual grounding, and cross-modal retrieval. One common approach involves contrasting semantically similar…

Machine Learning · Computer Science 2023-08-15 Peiqi Wang , Yingcheng Liu , Ching-Yun Ko , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

Negative sampling is essential for implicit collaborative filtering to provide proper negative training signals so as to achieve desirable performance. We experimentally unveil a common limitation of all existing negative sampling methods…

Information Retrieval · Computer Science 2024-01-11 Riwei Lai , Rui Chen , Qilong Han , Chi Zhang , Li Chen

The choice of negative examples is important in noise contrastive estimation. Recent works find that hard negatives -- highest-scoring incorrect examples under the model -- are effective in practice, but they are used without a formal…

Computation and Language · Computer Science 2021-04-14 Wenzheng Zhang , Karl Stratos

The binary classification problem has a situation where only biased data are observed in one of the classes. In this paper, we propose a new method to approach the positive and biased negative (PbN) classification problem, which is a weakly…

Methodology · Statistics 2025-10-28 Shotaro Watanabe , Hidetoshi Matsui

Estimating the parameters of probabilistic models of language such as maxent models and probabilistic neural models is computationally difficult since it involves evaluating partition functions by summing over an entire vocabulary, which…

Machine Learning · Computer Science 2014-10-31 Chris Dyer

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

In this paper the problem of learning appropriate bias for an environment of related tasks is examined from a Bayesian perspective. The environment of related tasks is shown to be naturally modelled by the concept of an {\em objective}…

Machine Learning · Computer Science 2019-11-15 Jonathan Baxter

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

Machine Learning · Computer Science 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

One of the challenges in contrastive learning is the selection of appropriate \textit{hard negative} examples, in the absence of label information. Random sampling or importance sampling methods based on feature similarity often lead to…

Machine Learning · Computer Science 2022-06-03 Afrina Tabassum , Muntasir Wahed , Hoda Eldardiry , Ismini Lourentzou

Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can…

Machine Learning · Computer Science 2019-07-01 Jessa Bekker , Pieter Robberechts , Jesse Davis

Recommender systems trained on implicit feedback data rely on negative sampling to distinguish positive items from negative items for each user. Since the majority of positive interactions come from a small group of active users, negative…

Information Retrieval · Computer Science 2025-11-12 Yueqing Xuan , Kacper Sokol , Mark Sanderson , Jeffrey Chan

News recommender systems are hindered by the brief lifespan of articles, as they undergo rapid relevance decay. Recent studies have demonstrated the potential of content-based neural techniques in tackling this problem. However, these…

Information Retrieval · Computer Science 2024-11-14 Miguel Ângelo Rebelo , João Vinagre , Ivo Pereira , Álvaro Figueira

For many interesting tasks, such as medical diagnosis and web page classification, a learner only has access to some positively labeled examples and many unlabeled examples. Learning from this type of data requires making assumptions about…

Machine Learning · Computer Science 2018-08-28 Jessa Bekker , Jesse Davis

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Popularity bias is a persistent issue associated with recommendation systems, posing challenges to both fairness and efficiency. Existing literature widely acknowledges that reducing popularity bias often requires sacrificing recommendation…

Information Retrieval · Computer Science 2023-06-05 Bin Liu , Erjia Chen , Bang Wang

Negative sampling has emerged as an effective technique that enables deep learning models to learn better representations by introducing the paradigm of learn-to-compare. The goal of this approach is to add robustness to deep learning…

Computation and Language · Computer Science 2025-03-26 Suman Adhya , Avishek Lahiri , Debarshi Kumar Sanyal , Partha Pratim Das

Sequential recommendation models are primarily optimized to distinguish positive samples from negative ones during training in which negative sampling serves as an essential component in learning the evolving user preferences through…

Information Retrieval · Computer Science 2022-08-09 Xiaoyang Liu , Chong Liu , Pinzheng Wang , Rongqin Zheng , Lixin Zhang , Leyu Lin , Zhijun Chen , Liangliang Fu

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

State-of-the-art approaches for Knowledge Base Completion (KBC) exploit deep neural networks trained with both false and true assertions: positive assertions are explicitly taken from the knowledge base, whereas negative ones are generated…

Machine Learning · Computer Science 2019-08-20 Sarthak Dash , Alfio Gliozzo

Classification is an important task in many fields including biomedical research and machine learning. Traditionally, a classification rule is constructed based a bunch of labeled data. Recently, due to technological innovation and…

Methodology · Statistics 2014-06-19 Jing Wang , Eunsik Park , Yuan-chin Ivan Chang