English
Related papers

Related papers: GraphT5: Unified Molecular Graph-Language Modeling…

200 papers

In this work, we propose a simple transformer-based baseline for multimodal molecular representation learning, integrating three distinct modalities: SMILES strings, 2D graph representations, and 3D conformers of molecules. A key aspect of…

Machine Learning · Computer Science 2024-10-25 Andrei Manolache , Dragos Tantaru , Mathias Niepert

Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text.…

Machine Learning · Computer Science 2023-07-17 Chen Qian , Huayi Tang , Zhirui Yang , Hong Liang , Yong Liu

Representing molecular structures effectively in chemistry remains a challenging task. Language models and graph-based models are extensively utilized within this domain, consistently achieving state-of-the-art results across an array of…

Machine Learning · Computer Science 2025-05-27 Nikolai Rekut , Alexey Orlov , Klea Ziu , Elizaveta Starykh , Martin Takac , Aleksandr Beznosikov

Generative pre-trained Transformer (GPT) has demonstrates its great success in natural language processing and related techniques have been adapted into molecular modeling. Considering that text is the most important record for scientific…

Computation and Language · Computer Science 2023-05-29 Zequn Liu , Wei Zhang , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Ming Zhang , Tie-Yan Liu

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning,…

Chemical Physics · Physics 2024-08-06 Jun-Hyung Park , Yeachan Kim , Mingyu Lee , Hyuntae Park , SangKeun Lee

Aligning molecular sequence representations (e.g., SMILES notations) with textual descriptions is critical for applications spanning drug discovery, materials design, and automated chemical literature analysis. Existing methodologies…

Artificial Intelligence · Computer Science 2025-11-25 Letian Chen , Runhan Shi , Gufeng Yu , Yang Yang

Building cross-model intelligence that can understand charts and communicate the salient information hidden behind them is an appealing challenge in the vision and language(V+L) community. The capability to uncover the underlined table data…

Computation and Language · Computer Science 2023-05-31 Mingyang Zhou , Yi R. Fung , Long Chen , Christopher Thomas , Heng Ji , Shih-Fu Chang

Molecule property prediction has gained significant attention in recent years. The main bottleneck is the label insufficiency caused by expensive lab experiments. In order to alleviate this issue and to better leverage textual knowledge for…

Machine Learning · Computer Science 2023-10-24 Haiteng Zhao , Shengchao Liu , Chang Ma , Hannan Xu , Jie Fu , Zhi-Hong Deng , Lingpeng Kong , Qi Liu

Enhancing accurate molecular property prediction relies on effective and proficient representation learning. It is crucial to incorporate diverse molecular relationships characterized by multi-similarity (self-similarity and relative…

Machine Learning · Computer Science 2024-02-05 Hao Xu , Zhengyang Zhou , Pengyu Hong

In the field of chemical structure recognition, the task of converting molecular images into machine-readable data formats such as SMILES string stands as a significant challenge, primarily due to the varied drawing styles and conventions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yufan Chen , Ching Ting Leung , Yong Huang , Jianwei Sun , Hao Chen , Hanyu Gao

Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for their vast knowledge…

Quantitative Methods · Quantitative Biology 2024-06-11 Junfeng Fang , Shuai Zhang , Chang Wu , Zhengyi Yang , Zhiyuan Liu , Sihang Li , Kun Wang , Wenjie Du , Xiang Wang

Large language models have made significant strides in natural language processing, enabling innovative applications in molecular science by processing textual representations of molecules. However, most existing language models cannot…

Machine Learning · Computer Science 2024-02-07 Pengfei Liu , Yiming Ren , Jun Tao , Zhixiang Ren

Most machine learning models for molecular property prediction rely on a single molecular representation (either a sequence, a graph, or a 3D structure) and treat molecular geometry as static. We present MolFM-Lite, a multi-modal model that…

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Recent advances in large language models (LLMs) have led to models that tackle diverse molecular tasks, such as chemical reaction prediction and molecular property prediction. Large-scale molecular instruction-tuning datasets have enabled…

Machine Learning · Computer Science 2025-05-27 Chanhui Lee , Hanbum Ko , Yuheon Song , YongJun Jeong , Rodrigo Hormazabal , Sehui Han , Kyunghoon Bae , Sungbin Lim , Sungwoong Kim

Molecules are graphs, but large language models~(LLMs) are usually asked to reason about them through linear strings. The most popular molecular representation, SMILES, compresses atoms, bonds, branches and rings into a compact sequence in…

Biomolecules · Quantitative Biology 2026-05-19 Zhiyuan Yan , Chen Liu , Boxuan Zhao , Kaiqing Lin , Jixiang Zhao , Yimi Wang , Liuzhenghao Lv , Hao Li , Shanzhuo Zhang , Li Yuan , Fanyang Mo

Molecular optimization, which transforms a given input molecule X into another Y with desirable properties, is essential in molecular drug discovery. The traditional translating approaches, generating the molecular graphs from scratch by…

Machine Learning · Computer Science 2020-08-17 Chaojie Ji , Yijia Zheng , Ruxin Wang , Yunpeng Cai , Hongyan Wu

SMILES is a linear representation of chemical structures which encodes the connection table, and the stereochemistry of a molecule as a line of text with a grammar structure denoting atoms, bonds, rings and chains, and this information can…

Machine Learning · Computer Science 2018-12-03 Arindam Paul , Dipendra Jha , Reda Al-Bahrani , Wei-keng Liao , Alok Choudhary , Ankit Agrawal

Recent research on predicting the binding affinity between drug molecules and proteins use representations learned, through unsupervised learning techniques, from large databases of molecule SMILES and protein sequences. While these…