English
Related papers

Related papers: Hierarchical Contrastive Learning Enhanced Heterog…

200 papers

Graphs are powerful representations for relations among objects, which have attracted plenty of attention. A fundamental challenge for graph learning is how to train an effective Graph Neural Network (GNN) encoder without labels, which are…

Machine Learning · Computer Science 2022-10-19 Baoyu Jing , Shengyu Feng , Yuejia Xiang , Xi Chen , Yu Chen , Hanghang Tong

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it…

Machine Learning · Computer Science 2021-08-10 Rayyan Ahmad Khan , Martin Kleinsteuber

Identifying influential nodes in complex networks is a fundamental task in network analysis with wide-ranging applications across domains. While deep learning has advanced node influence detection, existing supervised approaches remain…

Social and Information Networks · Computer Science 2025-09-04 Yanmei Hu , Yihang Wu , Bing Sun , Xue Yue , Biao Cai , Xiangtao Li , Yang Chen

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in…

Information Retrieval · Computer Science 2023-08-08 Dongjun Lee , Donggeun Ko , Jaekwang Kim

In this paper, we focus on graph representation learning of heterogeneous information network (HIN), in which various types of vertices are connected by various types of relations. Most of the existing methods conducted on HIN revise…

Machine Learning · Computer Science 2019-12-24 Huiting Hong , Hantao Guo , Yucheng Lin , Xiaoqing Yang , Zang Li , Jieping Ye

We present a novel technique for self-supervised video representation learning by: (a) decoupling the learning objective into two contrastive subtasks respectively emphasizing spatial and temporal features, and (b) performing it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zehua Zhang , David Crandall

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

The prior self-supervised learning researches mainly select image-level instance discrimination as pretext task. It achieves a fantastic classification performance that is comparable to supervised learning methods. However, with degraded…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Bing Zhao , Jun Li , Hong Zhu

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Although machine learning on hypergraphs has attracted considerable attention, most of the works have focused on (semi-)supervised learning, which may cause heavy labeling costs and poor generalization. Recently, contrastive learning has…

Machine Learning · Computer Science 2023-01-06 Dongjin Lee , Kijung Shin

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell