English
Related papers

Related papers: Multi-level Self-supervised Pretraining on Composi…

200 papers

Graph foundation models have recently attracted significant attention due to its strong generalizability. Although existing methods resort to language models to learn unified semantic representations across domains, they disregard the…

Machine Learning · Computer Science 2025-10-17 Yao Cheng , Yige Zhao , Jianxiang Yu , Xiang Li

Graph neural networks are currently leading the performance charts in learning-based molecule property prediction and classification. Computational chemistry has, therefore, become the a prominent testbed for generic graph neural networks,…

Machine Learning · Computer Science 2020-02-04 Eliya Nachmani , Lior Wolf

Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that…

Molecular representation learning is pivotal in predicting molecular properties and advancing drug design. Traditional methodologies, which predominantly rely on homogeneous graph encoding, are limited by their inability to integrate…

Machine Learning · Computer Science 2025-03-24 Mukun Chen , Jia Wu , Shirui Pan , Fu Lin , Bo Du , Xiuwen Gong , Wenbin Hu

Molecular property prediction, crucial for early drug candidate screening and optimization, has seen advancements with deep learning-based methods. While deep learning-based methods have advanced considerably, they often fall short in fully…

Biomolecules · Quantitative Biology 2024-07-01 Taojie Kuang , Yiming Ren , Zhixiang Ren

Self-supervised vision-language pretraining from pure images and text with a contrastive loss is effective, but ignores fine-grained alignment due to a dual-stream architecture that aligns image and text representations only on a global…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Zaid Khan , Vijay Kumar BG , Xiang Yu , Samuel Schulter , Manmohan Chandraker , Yun Fu

In recent years, graph neural networks (GNNs) have facilitated the development of graph data mining. However, training GNNs requires sufficient labeled task-specific data, which is expensive and sometimes unavailable. To be less dependent…

Machine Learning · Computer Science 2025-10-15 Shengyin Sun , Chen Ma , Jiehao Chen

To mitigate the suboptimal nature of graph structure, Graph Structure Learning (GSL) has emerged as a promising approach to improve graph structure and boost performance in downstream tasks. Despite the proposal of numerous GSL methods, the…

Machine Learning · Computer Science 2024-06-14 Zhiyao Zhou , Sheng Zhou , Bochao Mao , Jiawei Chen , Qingyun Sun , Yan Feng , Chun Chen , Can Wang

Geometric deep learning (GDL) has demonstrated huge power and enormous potential in molecular data analysis. However, a great challenge still remains for highly efficient molecular representations. Currently, covalent-bond-based molecular…

Computational Physics · Physics 2023-06-28 Cong Shen , Jiawei Luo , Kelin Xia

Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular…

Machine Learning · Computer Science 2021-03-25 Yin Fang , Haihong Yang , Xiang Zhuang , Xin Shao , Xiaohui Fan , Huajun Chen

Background: Virtual Screening (VS) has become an essential tool in drug discovery, enabling the rapid and cost-effective identification of potential bioactive molecules. Among recent advancements, Graph Neural Networks (GNNs) have gained…

Quantitative Methods · Quantitative Biology 2025-10-27 Salvatore Contino , Paolo Sortino , Maria Rita Gulotta , Ugo Perricone , Roberto Pirrone

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Graph representation learning has attracted increasing research attention. However, most existing studies fuse all structural features and node attributes to provide an overarching view of graphs, neglecting finer substructures' semantics,…

Machine Learning · Computer Science 2021-05-25 Qingyun Sun , Jianxin Li , Hao Peng , Jia Wu , Yuanxing Ning , Phillip S. Yu , Lifang He

Multiplex networks are complex graph structures in which a set of entities are connected to each other via multiple types of relations, each relation representing a distinct layer. Such graphs are used to investigate many complex…

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

We examine two fundamental tasks associated with graph representation learning: link prediction and semi-supervised node classification. We present a novel autoencoder architecture capable of learning a joint representation of both local…

Machine Learning · Computer Science 2019-03-12 Phi Vu Tran

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Antonio Montanaro , Diego Valsesia , Giulia Fracastoro , Enrico Magli

Graph self-supervised learning has gained increasing attention due to its capacity to learn expressive node representations. Many pretext tasks, or loss functions have been designed from distinct perspectives. However, we observe that…

Machine Learning · Computer Science 2022-03-23 Wei Jin , Xiaorui Liu , Xiangyu Zhao , Yao Ma , Neil Shah , Jiliang Tang

Protein representation learning aims to learn informative protein embeddings capable of addressing crucial biological questions, such as protein function prediction. Although sequence-based transformer models have shown promising results by…

Quantitative Methods · Quantitative Biology 2024-10-22 Michail Chatzianastasis , Yang Zhang , George Dasoulas , Michalis Vazirgiannis

We introduce a composition-weighted symbolic regression framework for interpretable prediction of materials properties directly from chemical composition. The method jointly learns analytical functional forms and task-dependent elemental…

Materials Science · Physics 2026-05-05 Yang Huang , Jingrun Chen