English
Related papers

Related papers: Advancing Molecular Graph-Text Pre-training via Fi…

200 papers

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

Pretraining molecular representations is crucial for drug and material discovery. Recent methods focus on learning representations from geometric structures, effectively capturing 3D position information. Yet, they overlook the rich…

Machine Learning · Computer Science 2024-11-19 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

Molecular graph representation learning is widely used in chemical and biomedical research. While pre-trained 2D graph encoders have demonstrated strong performance, they overlook the rich molecular domain knowledge associated with…

Machine Learning · Computer Science 2025-10-09 Xingtong Yu , Chang Zhou , Xinming Zhang , Yuan Fang

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Artificial intelligence has demonstrated immense potential in scientific research. Within molecular science, it is revolutionizing the traditional computer-aided paradigm, ushering in a new era of deep learning. With recent progress in…

Biomolecules · Quantitative Biology 2024-03-22 Yi Xiao , Xiangxin Zhou , Qiang Liu , Liang Wang

Molecule property prediction has gained significant attention in recent years. The main bottleneck is the label insufficiency caused by expensive lab experiments. In order to alleviate this issue and to better leverage textual knowledge for…

Machine Learning · Computer Science 2023-10-24 Haiteng Zhao , Shengchao Liu , Chang Ma , Hannan Xu , Jie Fu , Zhi-Hong Deng , Lingpeng Kong , Qi Liu

Molecular property prediction is a crucial foundation for drug discovery. In recent years, pre-trained deep learning models have been widely applied to this task. Some approaches that incorporate prior biological domain knowledge into the…

Machine Learning · Computer Science 2024-08-20 Tianyu Zhang , Yuxiang Ren , Chengbin Hou , Hairong Lv , Xuegong Zhang

The integration of deep learning, particularly AI-Generated Content, with high-quality data derived from ab initio calculations has emerged as a promising avenue for transforming the landscape of scientific research. However, the challenge…

Machine Learning · Computer Science 2024-12-11 Kaiwei Zhang , Yange Lin , Guangcheng Wu , Yuxiang Ren , Xuecang Zhang , Bo wang , Xiaoyu Zhang , Weitao Du

Recent advancements in biology and chemistry have leveraged multi-modal learning, integrating molecules and their natural language descriptions to enhance drug discovery. However, current pre-training frameworks are limited to two…

Machine Learning · Computer Science 2025-02-05 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

Tiered graph autoencoders provide the architecture and mechanisms for learning tiered latent representations and latent spaces for molecular graphs that explicitly represent and utilize groups (e.g., functional groups). This enables the…

Machine Learning · Computer Science 2021-07-02 Daniel T. Chang

Molecular structure recognition is the task of translating a molecular image into its graph structure. Significant variation in drawing styles and conventions exhibited in chemical literature poses a significant challenge for automating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Yujie Qian , Jiang Guo , Zhengkai Tu , Zhening Li , Connor W. Coley , Regina Barzilay

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue

Predicting molecular properties is essential for drug discovery, and computational methods can greatly enhance this process. Molecular graphs have become a focus for representation learning, with Graph Neural Networks (GNNs) widely used.…

Machine Learning · Computer Science 2025-01-31 Yan Sun , Yutong Lu , Yan Yi Li , Zihao Jing , Carson K. Leung , Pingzhao Hu

We consider feature representation learning problem of molecular graphs. Graph Neural Networks have been widely used in feature representation learning of molecular graphs. However, most existing methods deal with molecular graphs…

Machine Learning · Computer Science 2022-06-08 Zhaoning Yu , Hongyang Gao

We view molecular optimization as a graph-to-graph translation problem. The goal is to learn to map from one molecular graph to another with better properties based on an available corpus of paired molecules. Since molecules can be…

Machine Learning · Computer Science 2019-01-30 Wengong Jin , Kevin Yang , Regina Barzilay , Tommi Jaakkola

Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for their vast knowledge…

Quantitative Methods · Quantitative Biology 2024-06-11 Junfeng Fang , Shuai Zhang , Chang Wu , Zhengyi Yang , Zhiyuan Liu , Sihang Li , Kun Wang , Wenjie Du , Xiang Wang

Molecular representation is a critical element in our understanding of the physical world and the foundation for modern molecular machine learning. Previous molecular machine learning models have employed strings, fingerprints, global…

Machine Learning · Computer Science 2025-05-28 Daniil A. Boiko , Thiago Reschützegger , Benjamin Sanchez-Lengeling , Samuel M. Blau , Gabe Gomes

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Mothilal Asokan , Kebin Wu , Fatima Albreiki

With the advent of the era of foundation models, pre-training and fine-tuning have become common paradigms. Recently, parameter-efficient fine-tuning has garnered widespread attention due to its better balance between the number of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Bin Cheng , Jiaxuan Lu

While Large Language Models (LLMs) have shown exceptional generalization capabilities, their ability to process graph data, such as molecular structures, remains limited. To bridge this gap, this paper proposes Graph2Token, an efficient…

Machine Learning · Computer Science 2025-03-11 Runze Wang , Mingqi Yang , Yanming Shen