English
Related papers

Related papers: Self-supervised Heterogeneous Graph Pre-training B…

200 papers

Spatial-temporal graph representations play a crucial role in urban sensing applications, including traffic analysis, human mobility behavior modeling, and citywide crime prediction. However, a key challenge lies in the noisy and sparse…

Machine Learning · Computer Science 2025-08-15 Qianru Zhang , Xinyi Gao , Haixin Wang , Dong Huang , Siu-Ming Yiu , Hongzhi Yin

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it…

Machine Learning · Computer Science 2021-08-10 Rayyan Ahmad Khan , Martin Kleinsteuber

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

3D point cloud segmentation has received significant interest for its growing applications. However, the generalization ability of models suffers in dynamic scenarios due to the distribution shift between test and training data. To promote…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Tianpei Zou , Sanqing Qu , Zhijun Li , Alois Knoll , Lianghua He , Guang Chen , Changjun Jiang

Inspired by the success of contrastive learning (CL) in computer vision and natural language processing, graph contrastive learning (GCL) has been developed to learn discriminative node representations on graph datasets. However, the…

Machine Learning · Computer Science 2023-01-03 Zehong Wang , Qi Li , Donghua Yu , Xiaolong Han , Xiao-Zhi Gao , Shigen Shen

Graph similarity learning (GSL), also referred to as graph matching in many scenarios, is a fundamental problem in computer vision, pattern recognition, and graph learning. However, previous GSL methods assume that graphs are homogeneous…

Machine Learning · Computer Science 2025-03-13 Shilong Sang , Ke-Jia Chen , Zheng liu

Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL)…

Machine Learning · Computer Science 2023-05-15 Wei Xia , Quanxue Gao , Ming Yang , Xinbo Gao

We propose a heterogeneous graph mamba network (HGMN) as the first exploration in leveraging the selective state space models (SSSMs) for heterogeneous graph learning. Compared with the literature, our HGMN overcomes two major challenges:…

Machine Learning · Computer Science 2024-05-24 Zhenyu Pan , Yoonsung Jeong , Xiaoda Liu , Han Liu

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation…

Machine Learning · Computer Science 2021-04-14 Ning Liu , Songlei Jian , Dongsheng Li , Yiming Zhang , Zhiquan Lai , Hongzuo Xu

Consistency learning plays a crucial role in semi-supervised medical image segmentation as it enables the effective utilization of limited annotated data while leveraging the abundance of unannotated data. The effectiveness and efficiency…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Zhenxi Zhang , Ran Ran , Chunna Tian , Heng Zhou , Xin Li , Fan Yang , Zhicheng Jiao

Self-supervised learning (SSL) of graph neural networks is emerging as a promising way of leveraging unlabeled data. Currently, most methods are based on contrastive learning adapted from the image domain, which requires view generation and…

Machine Learning · Computer Science 2022-07-12 Yaochen Xie , Zhao Xu , Shuiwang Ji

Human-centric visual analysis plays a pivotal role in diverse applications, including surveillance, healthcare, and human-computer interaction. With the emergence of large-scale unlabeled human image datasets, there is an increasing need…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mingshuang Luo , Ruibing Hou , Bo Chao , Hong Chang , Zimo Liu , Yaowei Wang , Shiguang Shan

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

It has been shown that semi-parametric methods, which combine standard neural networks with non-parametric components such as external memory modules and data retrieval, are particularly helpful in data scarcity and out-of-distribution…

Machine Learning · Computer Science 2023-10-18 Zihan Qiu , Zhen Liu , Shuicheng Yan , Shanghang Zhang , Jie Fu

Contrastive learning has recently attracted plenty of attention in deep graph clustering for its promising performance. However, complicated data augmentations and time-consuming graph convolutional operation undermine the efficiency of…

Machine Learning · Computer Science 2022-06-28 Yue Liu , Xihong Yang , Sihang Zhou , Xinwang Liu

Graph Neural Networks (GNNs) have been predominant for graph learning tasks; however, recent studies showed that a well-known graph algorithm, Label Propagation (LP), combined with a shallow neural network can achieve comparable performance…

Machine Learning · Computer Science 2022-12-01 Zhiqiang Zhong , Sergey Ivanov , Jun Pang

While graph neural networks (GNNs) have been successful for node classification tasks and link prediction tasks in graph, learning graph-level representations still remains a challenge. For the graph-level representation, it is important to…

Machine Learning · Computer Science 2023-03-02 Sangseon Lee , Dohoon Lee , Yinhua Piao , Sun Kim

In recent years, heterogeneous graph few-shot learning has been proposed to address the label sparsity issue in heterogeneous graphs (HGs), which contain various types of nodes and edges. The existing methods have achieved good performance…

Machine Learning · Computer Science 2023-08-11 Pengfei Ding , Yan Wang , Guanfeng Liu

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

The cost of head pose labeling is the main challenge of improving the fine-grained Head Pose Estimation (HPE). Although Self-Supervised Learning (SSL) can be a solution to the lack of huge amounts of labeled data, its efficacy for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Mahdi Pourmirzaei , Farzaneh Esmaili , Ebrahim Mousavi , Sasan Karamizadeh , Seyedehsamaneh Shojaeilangari