English
Related papers

Related papers: Metapath-based Hyperbolic Contrastive Learning for…

200 papers

Knowledge graph embeddings (KGE) have been validated as powerful methods for inferring missing links in knowledge graphs (KGs) that they typically map entities into Euclidean space and treat relations as transformations of entities.…

Machine Learning · Computer Science 2024-02-26 Wenjie Zheng , Wenxue Wang , Shu Zhao , Fulan Qian

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

Multimodal contrastive learning (MCL) aims to embed data from different modalities in a shared embedding space. However, empirical evidence shows that representations from different modalities occupy completely separate regions of embedding…

Machine Learning · Computer Science 2025-10-09 Lingjie Yi , Raphael Douady , Chao Chen

Heterogeneous graph neural networks (HGNNs) have been widely applied in heterogeneous information network tasks, while most HGNNs suffer from poor scalability or weak representation when they are applied to large-scale heterogeneous graphs.…

Machine Learning · Computer Science 2022-11-23 Ziming Wan , Deqing Wang , Xuehua Ming , Fuzhen Zhuang , Chenguang Du , Ting Jiang , Zhengyang Zhao

Heterogeneous graphs (HGs) also known as heterogeneous information networks have become ubiquitous in real-world scenarios; therefore, HG embedding, which aims to learn representations in a lower-dimension space while preserving the…

Social and Information Networks · Computer Science 2020-12-02 Xiao Wang , Deyu Bo , Chuan Shi , Shaohua Fan , Yanfang Ye , Philip S. Yu

Detecting ever-evolving social bots has become increasingly challenging. Advanced bots tend to interact more with humans as a camouflage to evade detection. While graph-based detection methods can exploit various relations in social…

Social and Information Networks · Computer Science 2024-08-29 Qi Wu , Yingguang Yang , Buyun He , Hao Liu , Renyu Yang , Yong Liao

Heterogeneous graphs are ubiquitous in real-world applications because they can represent various relationships between different types of entities. Therefore, learning embeddings in such graphs is a critical problem in graph machine…

Machine Learning · Computer Science 2024-04-02 Yue Zhang , Yuntian He , Saket Gurukar , Srinivasan Parthasarathy

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

Machine Learning · Computer Science 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

While the introduction of contrastive learning frameworks in sentence representation learning has significantly contributed to advancements in the field, it still remains unclear whether state-of-the-art sentence embeddings can capture the…

Computation and Language · Computer Science 2024-06-10 Young Hyun Yoo , Jii Cha , Changhyeon Kim , Taeuk Kim

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message…

Machine Learning · Computer Science 2025-11-12 Xiang Chen , Kun Yue , Wenjie Liu , Zhenyu Zhang , Liang Duan

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

Artificial Intelligence · Computer Science 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

Hyperbolic graph convolutional networks (HGCNs) have demonstrated significant potential in extracting information from hierarchical graphs. However, existing HGCNs are limited to shallow architectures due to the computational expense of…

Machine Learning · Computer Science 2024-08-12 Jiaxu Liu , Xinping Yi , Xiaowei Huang

Node classification is an essential problem in graph learning. However, many models typically obtain unsatisfactory performance when applied to few-shot scenarios. Some studies have attempted to combine meta-learning with graph neural…

Machine Learning · Computer Science 2024-07-23 Yonghao Liu , Mengyu Li , Ximing Li , Lan Huang , Fausto Giunchiglia , Yanchun Liang , Xiaoyue Feng , Renchu Guan

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean space neglect the…

Machine Learning · Computer Science 2025-06-09 Ngoc Bui , Menglin Yang , Runjin Chen , Leonardo Neves , Mingxuan Ju , Rex Ying , Neil Shah , Tong Zhao

Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Shiyang Yan , Zongxuan Liu , Lin Xu

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Multimodal representation learning, exemplified by multimodal contrastive learning (MMCL) using image-text pairs, aims to learn powerful representations by aligning cues across modalities. This approach relies on the core assumption that…

Machine Learning · Computer Science 2025-09-29 Yichao Cai , Yuhang Liu , Erdun Gao , Tianjiao Jiang , Zhen Zhang , Anton van den Hengel , Javen Qinfeng Shi

Heterogeneous Graph Neural Networks (HGNNs), have demonstrated excellent capabilities in processing heterogeneous information networks. Self-supervised learning on heterogeneous graphs, especially contrastive self-supervised strategy, shows…

Machine Learning · Computer Science 2025-06-09 Yanbei Liu , Chongxu Wang , Zhitao Xiao , Lei Geng , Yanwei Pang , Xiao Wang