English
Related papers

Related papers: Dual Temperature Helps Contrastive Learning Withou…

200 papers

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Large Language Models (LLMs) have demonstrated exceptional performance across diverse tasks. However, their deployment in long-context scenarios faces high computational overhead and information redundancy. While soft prompt compression has…

Computation and Language · Computer Science 2026-05-12 Jiwei Tang , Zhijing Huang , Xinyu Zhang , Chen Jason Zhang , Jianxing Yu , Libin Zheng , Rui Meng , Jian Yin

Contrastive learning has emerged as a cornerstone in recent achievements of unsupervised representation learning. Its primary paradigm involves an instance discrimination task with a mutual information loss. The loss is known as InfoNCE and…

Artificial Intelligence · Computer Science 2023-08-31 Kyungeun Lee , Jaeill Kim , Suhyun Kang , Wonjong Rhee

Contrastive Analysis is a sub-field of Representation Learning that aims at separating common factors of variation between two datasets, a background (i.e., healthy subjects) and a target (i.e., diseased subjects), from the salient factors…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Robin Louiset , Edouard Duchesnay , Antoine Grigis , Pietro Gori

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language…

Computation and Language · Computer Science 2022-06-01 Shu'ang Li , Xuming Hu , Li Lin , Aiwei Liu , Lijie Wen , Philip S. Yu

As its availability and generality in online services, implicit feedback is more commonly used in recommender systems. However, implicit feedback usually presents noisy samples in real-world recommendation scenarios (such as misclicks or…

Information Retrieval · Computer Science 2024-05-29 Zhuangzhuang He , Yifan Wang , Yonghui Yang , Peijie Sun , Le Wu , Haoyue Bai , Jinqi Gong , Richang Hong , Min Zhang

Contrastive learning (CL) has been successful as a powerful representation learning method. In this paper, we propose a contrastive learning framework for cross-domain sentiment classification. We aim to induce domain invariant optimal…

Computation and Language · Computer Science 2020-12-08 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

The rapid growth of Large Language Models (LLMs) usage has highlighted the importance of gradient-free in-context learning (ICL). However, interpreting their inner workings remains challenging. This paper introduces a novel multimodal…

Computation and Language · Computer Science 2024-08-26 Yosuke Miyanishi , Minh Le Nguyen

The recently proposed Collaborative Metric Learning (CML) paradigm has aroused wide interest in the area of recommendation systems (RS) owing to its simplicity and effectiveness. Typically, the existing literature of CML depends largely on…

Machine Learning · Computer Science 2022-06-24 Shilong Bao , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Co-Salient Object Detection (CoSOD) aims at detecting common salient objects within a group of relevant source images. Most of the latest works employ the attention mechanism for finding common objects. To achieve accurate CoSOD results…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Peng Zheng , Jie Qin , Shuo Wang , Tian-Zhu Xiang , Huan Xiong

Unsupervised sentence representation learning remains a critical challenge in modern natural language processing (NLP) research. Recently, contrastive learning techniques have achieved significant success in addressing this issue by…

Computation and Language · Computer Science 2024-11-20 Wenxiao Liu , Zihong Yang , Chaozhuo Li , Zijin Hong , Jianfeng Ma , Zhiquan Liu , Litian Zhang , Feiran Huang

Cross-modal contrastive learning has led the recent advances in multimodal retrieval with its simplicity and effectiveness. In this work, however, we reveal that cross-modal contrastive learning suffers from incorrect normalization of the…

Information Retrieval · Computer Science 2022-12-23 Yookoon Park , Mahmoud Azab , Bo Xiong , Seungwhan Moon , Florian Metze , Gourab Kundu , Kirmani Ahmed

Limited availability of labeled physiological data often prohibits the use of powerful supervised deep learning models in the biomedical machine intelligence domain. We approach this problem and propose a novel encoding framework that…

Machine Learning · Computer Science 2023-06-13 Philipp Hallgarten , David Bethge , Ozan Özdenizci , Tobias Grosse-Puppendahl , Enkelejda Kasneci

Deep learning has been a prevalence in computational chemistry and widely implemented in molecule property predictions. Recently, self-supervised learning (SSL), especially contrastive learning (CL), gathers growing attention for the…

Machine Learning · Computer Science 2022-06-01 Yuyang Wang , Rishikesh Magar , Chen Liang , Amir Barati Farimani

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

Label smoothing (LS) is an arising learning paradigm that uses the positively weighted average of both the hard training labels and uniformly distributed soft labels. It was shown that LS serves as a regularizer for training data with hard…

Machine Learning · Computer Science 2022-06-28 Jiaheng Wei , Hangyu Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama , Yang Liu

Partial label learning (PLL) is an important problem that allows each training example to be labeled with a coarse candidate set, which well suits many real-world data annotation scenarios with label ambiguity. Despite the promise, the…

Machine Learning · Computer Science 2022-12-01 Haobo Wang , Ruixuan Xiao , Yixuan Li , Lei Feng , Gang Niu , Gang Chen , Junbo Zhao