English
Related papers

Related papers: Evaluating Self-Supervised Learning for Molecular …

200 papers

MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hoang Hai Nam Nguyen , Phan Nguyen Duc Hieu , Ho Won Lee

Graph Self-Supervised Learning (GSSL) offers a powerful paradigm for learning graph representations without labeled data. However, existing work assumes clean, manually curated graphs. Recent advances in NLP enable the large-scale automatic…

Machine Learning · Computer Science 2026-05-08 Othmane Kabal , Mounira Harzallah , Fabrice Guillet , Hideaki Takeda , Ryutaro Ichise

Graph Transformers have recently attracted attention for molecular property prediction by combining the inductive biases of graph neural networks (GNNs) with the global receptive field of Transformers. However, many existing hybrid…

Machine Learning · Computer Science 2026-04-09 Yi Yang , Ovidiu Daescu

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

Subgraph representation learning based on Graph Neural Network (GNN) has exhibited broad applications in scientific advancements, such as predictions of molecular structure-property relationships and collective cellular function. In…

Machine Learning · Computer Science 2022-10-17 Yili Shen , Xiao Liu , Cheng-Wei Ju , Jiaxu Yan , Jun Yi , Zhou Lin , Hui Guan

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity,…

Machine Learning · Computer Science 2023-10-18 Jiawang Dan , Ruofan Wu , Yunpeng Liu , Baokun Wang , Changhua Meng , Tengfei Liu , Tianyi Zhang , Ningtao Wang , Xing Fu , Qi Li , Weiqiang Wang

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Multivariate time-series data in fields like healthcare and industry are informative but challenging due to high dimensionality and lack of labels. Recent self-supervised learning methods excel in learning rich representations without…

Machine Learning · Computer Science 2024-10-22 Ching Chang , Chiao-Tung Chan , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Recently many efforts have been devoted to applying graph neural networks (GNNs) to molecular property prediction which is a fundamental task for computational drug and material discovery. One of major obstacles to hinder the successful…

Machine Learning · Computer Science 2021-09-27 Shuangli Li , Jingbo Zhou , Tong Xu , Dejing Dou , Hui Xiong

Molecular Representation Learning is essential to solving many drug discovery and computational chemistry problems. It is a challenging problem due to the complex structure of molecules and the vast chemical space. Graph representations of…

Machine Learning · Computer Science 2023-01-18 Atia Hamidizadeh , Tony Shen , Martin Ester

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the…

Machine Learning · Computer Science 2023-08-08 Kai Yang , Yuan Liu , Zijuan Zhao , Peijin Ding , Wenqian Zhao

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Molecular Representation Learning (MRL) has proven impactful in numerous biochemical applications such as drug discovery and enzyme design. While Graph Neural Networks (GNNs) are effective at learning molecular representations from a 2D…

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Our work introduces an innovative approach to graph learning by leveraging Hyperdimensional Computing. Graphs serve as a widely embraced method for conveying information, and their utilization in learning has gained significant attention.…

Machine Learning · Computer Science 2024-03-20 Pere Verges , Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau

With the rapid increase of compound databases available in medicinal and material science, there is a growing need for learning representations of molecules in a semi-supervised manner. In this paper, we propose an unsupervised hierarchical…

Machine Learning · Statistics 2017-11-30 Hai Nguyen , Shin-ichi Maeda , Kenta Oono

Graph-level clustering is a fundamental task of data mining, aiming at dividing unlabeled graphs into distinct groups. However, existing deep methods that are limited by pooling have difficulty extracting diverse and complex graph structure…

Machine Learning · Computer Science 2025-04-03 Renda Han , Guangzhen Yao , Wenxin Zhang , Yu Li , Wen Xin , Huajie Lei , Mengfei Li , Zeyu Zhang , Chengze Du , Yahe Tian

With the consolidation of deep learning in drug discovery, several novel algorithms for learning molecular representations have been proposed. Despite the interest of the community in developing new methods for learning molecular embeddings…

Biomolecules · Quantitative Biology 2022-05-09 María Virginia Sabando , Ignacio Ponzoni , Evangelos E. Milios , Axel J. Soto

Deep graph embedding is an important approach for community discovery. Deep graph neural network with self-supervised mechanism can obtain the low-dimensional embedding vectors of nodes from unlabeled and unstructured graph data. The…

Social and Information Networks · Computer Science 2021-02-09 Shuliang Xu , Shenglan Liu , Lin Feng