English
Related papers

Related papers: SymCERE: Symmetric Contrastive Learning for Robust…

200 papers

Noise-contrastive estimation (NCE) is a statistically consistent method for learning unnormalized probabilistic models. It has been empirically observed that the choice of the noise distribution is crucial for NCE's performance. However,…

Machine Learning · Computer Science 2021-10-22 Bingbin Liu , Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Generative retrieval-based recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. However, in large-scale recommendation systems, this approach becomes increasingly…

Information Retrieval · Computer Science 2025-06-23 Penglong Zhai , Yifang Yuan , Fanyi Di , Jie Li , Yue Liu , Chen Li , Jie Huang , Sicong Wang , Yao Xu , Xin Li

Current text conditioned image generation methods output realistic looking images, but they fail to capture specific styles. Simply finetuning them on the target style datasets still struggles to grasp the style features. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Serkan Ozturk , Samet Hicsonmez , Pinar Duygulu

Estimating the parameters of probabilistic models of language such as maxent models and probabilistic neural models is computationally difficult since it involves evaluating partition functions by summing over an entire vocabulary, which…

Machine Learning · Computer Science 2014-10-31 Chris Dyer

Recently, contrastive learning has been applied to the sequential recommendation task to address data sparsity caused by users with few item interactions and items with few user adoptions. Nevertheless, the existing contrastive…

Information Retrieval · Computer Science 2022-09-07 Lei Wang , Ee-Peng Lim , Zhiwei Liu , Tianxiang Zhao

Neural language models do not scale well when the vocabulary is large. Noise-contrastive estimation (NCE) is a sampling-based method that allows for fast learning with large vocabularies. Although NCE has shown promising performance in…

Computation and Language · Computer Science 2017-09-25 Farhana Ferdousi Liza , Marek Grzes

Template matching by normalized cross correlation (NCC) is widely used for finding image correspondences. We improve the robustness of this algorithm by preprocessing images with "siamese" convolutional networks trained to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Davit Buniatyan , Thomas Macrina , Dodam Ih , Jonathan Zung , H. Sebastian Seung

Modern neural recording techniques such as two-photon imaging or Neuropixel probes allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework…

We propose PsiRec, a novel user preference propagation recommender that incorporates pseudo-implicit feedback for enriching the original sparse implicit feedback dataset. Three of the unique characteristics of PsiRec are: (i) it views…

Information Retrieval · Computer Science 2019-01-07 Yun He , Haochen Chen , Ziwei Zhu , James Caverlee

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

Information Retrieval · Computer Science 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

To tackle cold-start and data sparsity issues in recommender systems, numerous multimodal, sequential, and contrastive techniques have been proposed. While these augmentations can boost recommendation performance, they tend to add noise and…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

Machine Learning · Computer Science 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

Modern online service providers such as online shopping platforms often provide both search and recommendation (S&R) services to meet different user needs. Rarely has there been any effective means of incorporating user behavior data from…

Information Retrieval · Computer Science 2023-05-19 Zihua Si , Zhongxiang Sun , Xiao Zhang , Jun Xu , Xiaoxue Zang , Yang Song , Kun Gai , Ji-Rong Wen

In recent years, several unsupervised, "contrastive" learning algorithms in vision have been shown to learn representations that perform remarkably well on transfer tasks. We show that this family of algorithms maximizes a lower bound on…

Machine Learning · Computer Science 2020-06-08 Mike Wu , Chengxu Zhuang , Milan Mosse , Daniel Yamins , Noah Goodman

Several prior studies have suggested that word frequency biases can cause the Bert model to learn indistinguishable sentence embeddings. Contrastive learning schemes such as SimCSE and ConSERT have already been adopted successfully in…

Computation and Language · Computer Science 2023-09-15 Pu Miao , Zeyao Du , Junlin Zhang

Micro-video recommender systems suffer from the ubiquitous noises in users' behaviors, which might render the learned user representation indiscriminating, and lead to trivial recommendations (e.g., popular items) or even weird ones that…

Information Retrieval · Computer Science 2022-08-18 Shengyu Zhang , Bofang Li , Dong Yao , Fuli Feng , Jieming Zhu , Wenyan Fan , Zhou Zhao , Xiaofei He , Tat-seng Chua , Fei Wu

Monaural speech enhancement (SE) is an ill-posed problem due to the irreversible degradation process. Recent methods to achieve SE tasks rely solely on positive information, e.g., ground-truth speech and speech-relevant features. Different…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-27 Xinmeng Xu , Weiping Tu , Chang Han , Yuhong Yang

Recently, neighbor-based contrastive learning has been introduced to effectively exploit neighborhood information for clustering. However, these methods rely on the homophily assumption-that connected nodes share similar class labels and…

Social and Information Networks · Computer Science 2025-12-23 Liang Peng , Yixuan Ye , Cheng Liu , Hangjun Che , Man-Fai Leung , Si Wu , Hau-San Wong