English
Related papers

Related papers: Attention-wise masked graph contrastive learning f…

200 papers

For graph self-supervised learning (GSSL), masked autoencoder (MAE) follows the generative paradigm and learns to reconstruct masked graph edges or node features. Contrastive Learning (CL) maximizes the similarity between augmented views of…

Machine Learning · Computer Science 2023-10-25 Yuxiang Wang , Xiao Yan , Chuang Hu , Fangcheng Fu , Wentao Zhang , Hao Wang , Shuo Shang , Jiawei Jiang

Recent works explore learning graph representations in a self-supervised manner. In graph contrastive learning, benchmark methods apply various graph augmentation approaches. However, most of the augmentation methods are non-learnable,…

Machine Learning · Computer Science 2022-05-30 Hang Gao , Jiangmeng Li , Wenwen Qiang , Lingyu Si , Fuchun Sun , Changwen Zheng

Predicting medications is a crucial task in many intelligent healthcare systems. It can assist doctors in making informed medication decisions for patients according to electronic medical records (EMRs). However, medication prediction is a…

Artificial Intelligence · Computer Science 2022-05-02 Yang An , Bo Jin , Xiaopeng Wei

In recent years, artificial intelligence has played an important role on accelerating the whole process of drug discovery. Various of molecular representation schemes of different modals (e.g. textual sequence or graph) are developed. By…

Machine Learning · Computer Science 2022-11-28 Tianyu Wu , Yang Tang , Qiyu Sun , Luolin Xiong

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effective…

Machine Learning · Computer Science 2024-01-11 Yucheng Wang , Yuecong Xu , Jianfei Yang , Min Wu , Xiaoli Li , Lihua Xie , Zhenghua Chen

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

Complex data mining has wide application value in many fields, especially in the feature extraction and classification tasks of unlabeled data. This paper proposes an algorithm based on self-supervised learning and verifies its…

Machine Learning · Computer Science 2025-04-08 Yingbin Liang , Lu Dai , Shuo Shi , Minghao Dai , Junliang Du , Haige Wang

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Unsupervised anomaly detection using deep learning has garnered significant research attention due to its broad applicability, particularly in medical imaging where labeled anomalous data are scarce. While earlier approaches leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chunlei Li , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Graph self-supervised learning (SSL), including contrastive and generative approaches, offers great potential to address the fundamental challenge of label scarcity in real-world graph data. Among both sets of graph SSL techniques, the…

Machine Learning · Computer Science 2023-04-12 Zhenyu Hou , Yufei He , Yukuo Cen , Xiao Liu , Yuxiao Dong , Evgeny Kharlamov , Jie Tang

Molecular representation learning has shown great success in advancing AI-based drug discovery. The core of many recent works is based on the fact that the 3D geometric structure of molecules provides essential information about their…

Machine Learning · Computer Science 2024-10-23 Jiying Zhang , Zijing Liu , Yu Wang , Yu Li

Graph contrastive learning (GCL) has emerged as a state-of-the-art strategy for learning representations of diverse graphs including social and biomedical networks. GCL widely uses stochastic graph topology augmentation, such as uniform…

Machine Learning · Computer Science 2024-02-22 Yucheng Wu , Leye Wang , Xiao Han , Han-Jia Ye

Galaxy morphology reflects structural properties which contribute to understand the formation and evolution of galaxies. Deep convolutional networks have proven to be very successful in learning hidden features that allow for unprecedented…

Astrophysics of Galaxies · Physics 2022-12-07 Shoulin Wei , Yadi Li , Wei Lu , Nan Li , Bo Liang , Wei Dai , Zhijian Zhang

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or…

Machine Learning · Computer Science 2020-06-11 Kaveh Hassani , Amir Hosein Khasahmadi

To deal with the exhausting annotations, self-supervised representation learning from unlabeled point clouds has drawn much attention, especially centered on augmentation-based contrastive methods. However, specific augmentations hardly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhuheng Lu , Yuewei Dai , Weiqing Li , Zhiyong Su

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Most existing graph-based semi-supervised hyperspectral image classification methods rely on superpixel partitioning techniques. However, they suffer from misclassification of certain pixels due to inaccuracies in superpixel boundaries,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuqing Zhang , Qi Han , Ligeng Wang , Kai Cheng , Bo Wang , Kun Zhan

Unsupervised learning methods based on contrastive learning have drawn increasing attention and achieved promising results. Most of them aim to learn representations invariant to instance-level variations, which are provided by different…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Feng Wang , Huaping Liu , Di Guo , Fuchun Sun