中文
相关论文

相关论文: Revisiting Recommendation Loss Functions through C…

200 篇论文

Contrastive learning has recently seen tremendous success in self-supervised learning. So far, however, it is largely unclear why the learned representations generalize so effectively to a large variety of downstream tasks. We here prove…

机器学习 · 计算机科学 2022-04-08 Roland S. Zimmermann , Yash Sharma , Steffen Schneider , Matthias Bethge , Wieland Brendel

The goal of contrasting learning is to learn a representation that preserves underlying clusters by keeping samples with similar content, e.g. the ``dogness'' of a dog, close to each other in the space generated by the representation. A…

机器学习 · 计算机科学 2023-02-17 Advait Parulekar , Liam Collins , Karthikeyan Shanmugam , Aryan Mokhtari , Sanjay Shakkottai

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Correlation exploitation is essential for efficient multi-user channel estimation (MUCE) in massive MIMO systems. However, the existing works either rely on presumed strong correlation or learn the correlation through large amount of…

信号处理 · 电气工程与系统科学 2023-03-07 Yihan Xu , Lixiang Lian

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

信息检索 · 计算机科学 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

Binary pointwise labels (aka implicit feedback) are heavily leveraged by deep learning based recommendation algorithms nowadays. In this paper we discuss the limited expressiveness of these labels may fail to accommodate varying degrees of…

信息检索 · 计算机科学 2022-04-19 Menghan Wang , Yuchen Guo , Zhenqi Zhao , Guangzheng Hu , Yuming Shen , Mingming Gong , Philip Torr

There is a rapidly-growing research interest in engaging users with multi-modal data for accurate user modeling on recommender systems. Existing multimedia recommenders have achieved substantial improvements by incorporating various…

信息检索 · 计算机科学 2023-05-04 Dong Yao , Shengyu Zhang , Zhou Zhao , Jieming Zhu , Wenqiao Zhang , Rui Zhang , Xiaofei He , Fei Wu

Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks…

机器学习 · 计算机科学 2024-06-10 Yu-Chang Wu , Shen-Huan Lyu , Haopu Shang , Xiangyu Wang , Chao Qian

This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding. The proposed approach imposes alignment between the attention pattern of…

计算与语言 · 计算机科学 2023-05-24 Tassilo Klein , Moin Nabi

Contrastive losses have been extensively used as a tool for multimodal representation learning. However, it has been empirically observed that their use is not effective to learn an aligned representation space. In this paper, we argue that…

Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been widely used to extract keyword representations, previous CL…

音频与语音处理 · 电气工程与系统科学 2024-01-15 Yu Xi , Baochen Yang , Hao Li , Jiaqi Guo , Kai Yu

Motivated by problems in online advertising, we address the task of Learning from Label Proportions (LLP). We introduce a novel and versatile low-variance debiasing methodology to learn from aggregate label information, significantly…

机器学习 · 计算机科学 2026-02-02 Lorne Applebaum , Travis Dick , Claudio Gentile , Haim Kaplan , Tomer Koren

Contrastive learning (CL) has shown its power in recommendation. However, most CL-based recommendation models build their CL tasks merely focusing on the user's aspects, ignoring the rich diverse information in items. In this work, we…

信息检索 · 计算机科学 2023-01-18 Ruobing Xie , Zhijie Qiu , Bo Zhang , Leyu Lin

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

机器学习 · 计算机科学 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

信息检索 · 计算机科学 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

Recent research has reported a performance degradation in self-supervised contrastive learning for specially designed efficient networks, such as MobileNet and EfficientNet. A common practice to address this problem is to introduce a…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Wenye Lin , Yifeng Ding , Zhixiong Cao , Hai-tao Zheng

Vast quantities of person-generated health data (wearables) are collected but the process of annotating to feed to machine learning models is impractical. This paper discusses ways in which self-supervised approaches that use contrastive…

机器学习 · 计算机科学 2021-11-16 Kevalee Shah , Dimitris Spathis , Chi Ian Tang , Cecilia Mascolo

Recommender systems and search are both indispensable in facilitating personalization and ease of browsing in online fashion platforms. However, the two tools often operate independently, failing to combine the strengths of recommender…

信息检索 · 计算机科学 2022-07-26 Karin Sevegnani , Arjun Seshadri , Tian Wang , Anurag Beniwal , Julian McAuley , Alan Lu , Gerard Medioni