English
Related papers

Related papers: Self-supervised Heterogeneous Graph Pre-training B…

200 papers

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

Machine Learning · Computer Science 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Semi-supervised learning has emerged as a powerful paradigm for leveraging large amounts of unlabeled data to improve the performance of machine learning models when labeled data are scarce. Among existing approaches, methods derived from…

Machine Learning · Computer Science 2026-04-29 Ali Aghababaei-Harandi , Aude Sportisse , Massih-Reza Amini

Contrastive learning is a significant paradigm in graph self-supervised learning. However, it requires negative samples to prevent model collapse and learn discriminative representations. These negative samples inevitably lead to heavy…

Machine Learning · Computer Science 2024-08-12 Yunhui Liu , Huaisong Zhang , Tieke He , Tao Zheng , Jianhua Zhao

Crime has become a major concern in many cities, which calls for the rising demand for timely predicting citywide crime occurrence. Accurate crime prediction results are vital for the beforehand decision-making of government to alleviate…

Machine Learning · Computer Science 2022-08-19 Zhonghang Li , Chao Huang , Lianghao Xia , Yong Xu , Jian Pei

Few-shot learning is an interesting and challenging study, which enables machines to learn from few samples like humans. Existing studies rarely exploit auxiliary information from large amount of unlabeled data. Self-supervised learning is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Hainan Li , Renshuai Tao , Jun Li , Haotong Qin , Yifu Ding , Shuo Wang , Xianglong Liu

In semi-supervised domain adaptation (SSDA), the model aims to leverage partially labeled target domain data along with a large amount of labeled source domain data to enhance its generalization capability for the target domain. A key…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Houcheng Su , Mengzhu Wang , Jiao Li , Nan Yin , Liang Yang , Li Shen

Recently, increasing attention has been paid to heterogeneous graph representation learning (HGRL), which aims to embed rich structural and semantic information in heterogeneous information networks (HINs) into low-dimensional node…

Machine Learning · Computer Science 2022-10-12 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Single-Program-Multiple-Data (SPMD) parallelism has recently been adopted to train large deep neural networks (DNNs). Few studies have explored its applicability on heterogeneous clusters, to fully exploit available resources for large…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-12 Shiwei Zhang , Lansong Diao , Chuan Wu , Zongyan Cao , Siyu Wang , Wei Lin

In this work, we investigate semi-supervised learning (SSL) for image classification using adversarial training. Previous results have illustrated that generative adversarial networks (GANs) can be used for multiple purposes. Triple-GAN,…

Machine Learning · Computer Science 2019-10-22 Wenyuan Li , Zichen Wang , Yuguang Yue , Jiayun Li , William Speier , Mingyuan Zhou , Corey W. Arnold

The recently proposed self-ensembling methods have achieved promising results in deep semi-supervised learning, which penalize inconsistent predictions of unlabeled data under different perturbations. However, they only consider adding…

Machine Learning · Computer Science 2018-03-29 Yucen Luo , Jun Zhu , Mengxi Li , Yong Ren , Bo Zhang

Traffic flow prediction plays a critical role in the intelligent transportation system, and it is also a challenging task because of the underlying complex Spatio-temporal patterns and heterogeneities evolving across time. However, most…

Artificial Intelligence · Computer Science 2024-12-24 Jiyao Wang , Zehua Peng , Yijia Zhang , Dengbo He , Lei Chen

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually…

Machine Learning · Computer Science 2024-05-08 Mingguo He , Zhewei Wei , Shikun Feng , Zhengjie Huang , Weibin Li , Yu Sun , Dianhai Yu

The success of deep networks in medical image segmentation relies heavily on massive labeled training data. However, acquiring dense annotations is a time-consuming process. Weakly-supervised methods normally employ less expensive forms of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mu Tian , Qinzhu Yang , Yi Gao

The human brain exhibits a strong ability to spontaneously associate different visual attributes of the same or similar visual scene, such as associating sketches and graffiti with real-world visual objects, usually without supervising…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Zhiqiang Chen , Guofan Fan , Jinying Gao , Lei Ma , Bo Lei , Tiejun Huang , Shan Yu

Adapter-based tuning methods have shown significant potential in transferring knowledge from pre-trained Vision-Language Models to the downstream tasks. However, after reviewing existing adapters, we find they generally fail to fully…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yumiao Zhao , Bo Jiang , Xiao Wang , Qin Xu , Jin Tang

The search for new high-performance organic semiconducting molecules is challenging due to the vastness of the chemical space, machine learning methods, particularly deep learning models like graph neural networks (GNNs), have shown…

Chemical Physics · Physics 2021-12-06 Zaixi Zhang , Qi Liu , Shengyu Zhang , Chang-Yu Hsieh , Liang Shi , Chee-Kong Lee

Single-cell RNA sequencing (scRNA-seq) data analysis is pivotal for understanding cellular heterogeneity. However, the high sparsity and complex noise patterns inherent in scRNA-seq data present significant challenges for traditional…

Genomics · Quantitative Biology 2024-08-13 Wenwen Min , Zhen Wang , Fangfang Zhu , Taosheng Xu , Shunfang Wang

Recent years have witnessed the rapid development of heterogeneous graph neural networks (HGNNs) in information retrieval (IR) applications. Many existing HGNNs design a variety of tailor-made graph convolutions to capture structural and…

Machine Learning · Computer Science 2023-08-15 Chenguang Du , Kaichun Yao , Hengshu Zhu , Deqing Wang , Fuzhen Zhuang , Hui Xiong

Mental disorder populations exhibit pronounced heterogeneity -- that is, the significant differences between samples -- poses a significant challenge to the definition of positive pairs in contrastive learning. To address this, we propose a…

Machine Learning · Computer Science 2026-03-23 Xiaolong Li , Guiliang Guo , Guangqi Wen , Peng Cao , Jinzhu Yang , Honglin Wu , Xiaoli Liu , Fei Wang , Osmar R. Zaiane