English
Related papers

Related papers: GraphT5: Unified Molecular Graph-Language Modeling…

200 papers

The application of language models (LMs) to molecular structure generation using line notations such as SMILES and SELFIES has been well-established in the field of cheminformatics. However, extending these models to generate 3D molecular…

Machine Learning · Computer Science 2024-12-03 Kaiyuan Gao , Yusong Wang , Haoxiang Guan , Zun Wang , Qizhi Pei , John E. Hopcroft , Kun He , Lijun Wu

Recent data-efficient molecular generation approaches exploit graph grammars to introduce interpretability into the generative models. However, grammar learning therein relies on expert annotation or unreliable heuristics for algorithmic…

Artificial Intelligence · Computer Science 2025-05-30 Michael Sun , Weize Yuan , Gang Liu , Wojciech Matusik , Jie Chen

We view molecular optimization as a graph-to-graph translation problem. The goal is to learn to map from one molecular graph to another with better properties based on an available corpus of paired molecules. Since molecules can be…

Machine Learning · Computer Science 2019-01-30 Wengong Jin , Kevin Yang , Regina Barzilay , Tommi Jaakkola

We introduce G2T-LLM, a novel approach for molecule generation that uses graph-to-tree text encoding to transform graph-based molecular structures into a hierarchical text format optimized for large language models (LLMs). This encoding…

Machine Learning · Computer Science 2024-10-04 Zhaoning Yu , Xiangyang Xu , Hongyang Gao

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

Artificial Intelligence predicts drug properties by encoding drug molecules, aiding in the rapid screening of candidates. Different molecular representations, such as SMILES and molecule graphs, contain complementary information for…

Machine Learning · Computer Science 2024-06-27 Muzhen Cai , Sendong Zhao , Haochun Wang , Yanrui Du , Zewen Qiang , Bing Qin , Ting Liu

The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the…

Machine Learning · Computer Science 2023-05-19 Dimitrios Christofidellis , Giorgio Giannone , Jannis Born , Ole Winther , Teodoro Laino , Matteo Manica

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

Drug target interaction (DTI) prediction is a cornerstone of computational drug discovery, enabling rational design, repurposing, and mechanistic insights. While deep learning has advanced DTI modeling, existing approaches primarily rely on…

Machine Learning · Computer Science 2025-11-05 Feng Jiang , Amina Mollaysa , Hehuan Ma , Tommaso Mansi , Junzhou Huang , Mangal Prakash , Rui Liao

Accurate molecular property prediction requires integrating complementary information from molecular structure and chemical semantics. In this work, we propose LGM-CL, a local-global multimodal contrastive learning framework that jointly…

Machine Learning · Computer Science 2026-02-02 Xiayu Liu , Zhengyi Lu , Yunhong Liao , Chan Fan , Hou-biao Li

The simplified molecular-input line-entry system (SMILES) is the most popular representation of chemical compounds. Therefore, many SMILES-based molecular property prediction models have been developed. In particular, transformer-based…

Quantitative Methods · Quantitative Biology 2022-05-03 Ingoo Lee , Hojung Nam

Predicting molecular properties is essential for drug discovery, and computational methods can greatly enhance this process. Molecular graphs have become a focus for representation learning, with Graph Neural Networks (GNNs) widely used.…

Machine Learning · Computer Science 2025-01-31 Yan Sun , Yutong Lu , Yan Yi Li , Zihao Jing , Carson K. Leung , Pingzhao Hu

We revisit the effectiveness of topological descriptors for molecular graph classification and design a simple, yet strong baseline. We demonstrate that a simple approach to feature engineering - employing histogram aggregation of edge…

Machine Learning · Computer Science 2024-07-24 Jakub Adamczyk , Wojciech Czech

Motivated by the success of T5 (Text-To-Text Transfer Transformer) in pre-trained natural language processing models, we propose a unified-modal SpeechT5 framework that explores the encoder-decoder pre-training for self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-25 Junyi Ao , Rui Wang , Long Zhou , Chengyi Wang , Shuo Ren , Yu Wu , Shujie Liu , Tom Ko , Qing Li , Yu Zhang , Zhihua Wei , Yao Qian , Jinyu Li , Furu Wei

Small molecules are essential to drug discovery, and graph-language models hold promise for learning molecular properties and functions from text. However, existing molecule-text datasets are limited in scale and informativeness,…

Biomolecules · Quantitative Biology 2025-06-03 Yihan Zhu , Gang Liu , Eric Inae , Meng Jiang

Most current molecular language models transfer the masked language model or image-text generation model from natural language processing to molecular field. However, molecules are not solely characterized by atom/bond symbols; they…

Emerging Technologies · Computer Science 2024-11-26 Yifan Wu , Min Zeng , Yang Li , Yang Zhang , Min Li

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

Pre-trained models for Natural Languages (NL) like BERT and GPT have been recently shown to transfer well to Programming Languages (PL) and largely benefit a broad set of code-related tasks. Despite their success, most current methods…

Computation and Language · Computer Science 2021-09-03 Yue Wang , Weishi Wang , Shafiq Joty , Steven C. H. Hoi

Graph-structured data plays a vital role in numerous domains, such as social networks, citation networks, commonsense reasoning graphs and knowledge graphs. While graph neural networks have been employed for graph processing, recent…

Computation and Language · Computer Science 2026-05-19 Wooyoung Kim , Byungyoon Park , Wooju Kim

With the development of deep learning technology, large language models have achieved remarkable results in many natural language processing tasks. However, these models still have certain limitations in handling complex reasoning tasks and…

Computation and Language · Computer Science 2025-02-25 Xiaoxuan Liao , Binrong Zhu , Jacky He , Guiran Liu , Hongye Zheng , Jia Gao