English
Related papers

Related papers: 3D Graph Contrastive Learning for Molecular Proper…

200 papers

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Graph classification is a widely studied problem and has broad applications. In many real-world problems, the number of labeled graphs available for training classification models is limited, which renders these models prone to overfitting.…

Machine Learning · Computer Science 2020-09-15 Jiaqi Zeng , Pengtao Xie

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Structure-based drug discovery faces the dual challenge of accurately capturing 3D protein-ligand interactions while navigating ultra-large chemical spaces to identify synthetically accessible candidates. In this work, we present a unified…

Machine Learning · Computer Science 2026-04-22 Carles Navarro , Philipp Tholke , Gianni de Fabritiis

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Graph Contrastive Learning (GCL) is a widely adopted approach in self-supervised graph representation learning, applying contrastive objectives to produce effective representations. However, current GCL methods primarily focus on capturing…

Machine Learning · Computer Science 2025-07-11 Dongxiao He , Yongqi Huang , Jitao Zhao , Xiaobao Wang , Zhen Wang

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Graph contrastive learning (GCL) has recently emerged as a promising approach for graph representation learning. Some existing methods adopt the 1-vs-K scheme to construct one positive and K negative samples for each graph, but it is…

Machine Learning · Computer Science 2023-09-06 Minjie Chen , Yao Cheng , Ye Wang , Xiang Li , Ming Gao

A recent focal area in the space of graph neural networks (GNNs) is graph self-supervised learning (SSL), which aims to derive useful node representations without labeled data. Notably, many state-of-the-art graph SSL methods are…

Machine Learning · Computer Science 2023-03-30 William Shiao , Zhichun Guo , Tong Zhao , Evangelos E. Papalexakis , Yozen Liu , Neil Shah

Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific…

Social and Information Networks · Computer Science 2022-02-22 Xovee Xu , Fan Zhou , Kunpeng Zhang , Siyuan Liu

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Graph Neural Networks (GNNs) have achieved great success in learning graph representations and thus facilitating various graph-related tasks. However, most GNN methods adopt a supervised learning setting, which is not always feasible in…

Machine Learning · Computer Science 2022-08-16 Hongliang Chi , Yao Ma

Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation…

Machine Learning · Computer Science 2022-03-08 Haoran Yang , Hongxu Chen , Shirui Pan , Lin Li , Philip S. Yu , Guandong Xu

Self-supervised learning (SSL) has recently achieved promising performance for 3D medical image analysis tasks. Most current methods follow existing SSL paradigm originally designed for photographic or natural images, which cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yankai Jiang , Mingze Sun , Heng Guo , Xiaoyu Bai , Ke Yan , Le Lu , Minfeng Xu

State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jiho Jang , Seonhoon Kim , Kiyoon Yoo , Chaerin Kong , Jangho Kim , Nojun Kwak

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Contrastive learning have been widely used as pretext tasks for self-supervised pre-trained molecular representation learning models in AI-aided drug design and discovery. However, exiting methods that generate molecular views by…

Biomolecules · Quantitative Biology 2023-03-14 Ziqiao Zhang , Ailin Xie , Jihong Guan , Shuigeng Zhou