English
Related papers

Related papers: Refinement Contrastive Learning of Cell-Gene Assoc…

200 papers

In deepfake detection, the varying degrees of compression employed by social media platforms pose significant challenges for model generalization and reliability. Although existing methods have progressed from single-modal to multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ching-Yi Lai , Chih-Yu Jian , Pei-Cheng Chuang , Chia-Ming Lee , Chih-Chung Hsu , Chiou-Ting Hsu , Chia-Wen Lin

Self-supervised learning (SSL) has recently achieved great success in mining the user-item interactions for collaborative filtering. As a major paradigm, contrastive learning (CL) based SSL helps address data sparsity in Web platforms by…

Information Retrieval · Computer Science 2024-02-20 Dan Zhang , Yangliao Geng , Wenwen Gong , Zhongang Qi , Zhiyu Chen , Xing Tang , Ying Shan , Yuxiao Dong , Jie Tang

This paper studies the problem of graph-level clustering, which is a novel yet challenging task. This problem is critical in a variety of real-world applications such as protein clustering and genome analysis in bioinformatics. Recent years…

Machine Learning · Computer Science 2023-03-09 Wei Ju , Yiyang Gu , Binqi Chen , Gongbo Sun , Yifang Qin , Xingyuming Liu , Xiao Luo , Ming Zhang

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilities. Most existing SNNs training methods first integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Haonan Qiu , Zeyin Song , Yanqi Chen , Munan Ning , Wei Fang , Tao Sun , Zhengyu Ma , Li Yuan , Yonghong Tian

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Contrastive learning is a powerful self-supervised learning method, but we have a limited theoretical understanding of how it works and why it works. In this paper, we prove that contrastive learning with the standard InfoNCE loss is…

Machine Learning · Computer Science 2024-02-26 Zhiquan Tan , Yifan Zhang , Jingqin Yang , Yang Yuan

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

In the face of rapidly accumulating genomic data, our understanding of the RNA regulatory code remains incomplete. Recent self-supervised methods in other domains have demonstrated the ability to learn rules underlying the data-generating…

Machine Learning · Computer Science 2023-10-18 Philip Fradkin , Ruian Shi , Bo Wang , Brendan Frey , Leo J. Lee

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Despite their effectiveness, current deep learning models face challenges with images coming from different domains with varying appearance and content. We introduce SegCLR, a versatile framework designed to segment images across different…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Alvaro Gomariz , Yusuke Kikuchi , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Daniela Ferrara , Huanxiang Lu , Orcun Goksel

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filtering signals…

Information Retrieval · Computer Science 2025-07-18 Weizhi Zhang , Liangwei Yang , Zihe Song , Henrry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao