English
Related papers

Related papers: Multi-modal Molecule Structure-text Model for Text…

200 papers

We present a multimodal search tool that facilitates retrieval of chemical reactions, molecular structures, and associated text from scientific literature. Queries may combine molecular diagrams, textual descriptions, and reaction data,…

The recent success of large foundation models in artificial intelligence has prompted the emergence of chemical pre-trained models. Despite the growing interest in large molecular pre-trained models that provide informative representations…

Machine Learning · Computer Science 2025-05-26 Jinho Chang , Jong Chul Ye

Understanding molecular structure and related knowledge is crucial for scientific research. Recent studies integrate molecular graphs with their textual descriptions to enhance molecular representation learning. However, they focus on the…

Artificial Intelligence · Computer Science 2025-06-02 Yibo Li , Yuan Fang , Mengmei Zhang , Chuan Shi

The integration of molecular and natural language representations has emerged as a focal point in molecular science, with recent advancements in Language Models (LMs) demonstrating significant potential for comprehensive modeling of both…

Biomolecules · Quantitative Biology 2025-03-19 Qizhi Pei , Rui Yan , Kaiyuan Gao , Jinhua Zhu , Lijun Wu

Molecule property prediction has gained significant attention in recent years. The main bottleneck is the label insufficiency caused by expensive lab experiments. In order to alleviate this issue and to better leverage textual knowledge for…

Machine Learning · Computer Science 2023-10-24 Haiteng Zhao , Shengchao Liu , Chang Ma , Hannan Xu , Jie Fu , Zhi-Hong Deng , Lingpeng Kong , Qi Liu

The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based architectures that do…

Computation and Language · Computer Science 2025-06-24 Shuhan Guo , Yatao Bian , Ruibing Wang , Nan Yin , Zhen Wang , Quanming Yao

Optical Chemical Structure Recognition (OCSR) plays a pivotal role in modern chemical informatics, enabling the automated conversion of chemical structure images from scientific literature, patents, and educational materials into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Wenrui Zhang , Xinggang Wang , Bin Feng , Wenyu Liu

Generative pre-trained Transformer (GPT) has demonstrates its great success in natural language processing and related techniques have been adapted into molecular modeling. Considering that text is the most important record for scientific…

Computation and Language · Computer Science 2023-05-29 Zequn Liu , Wei Zhang , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Ming Zhang , Tie-Yan Liu

Molecular property prediction and generative design via deep learning models has been the subject of intense research given its potential to accelerate development of new, high-performance materials. More recently, these workflows have been…

Artificial Intelligence · Computer Science 2024-12-16 Nathaniel H. Park , Tiffany J. Callahan , James L. Hedrick , Tim Erdmann , Sara Capponi

Despite deep learning's success in chemistry, its impact is hindered by a lack of interpretability and an inability to resolve activity cliffs, where minor structural nuances trigger drastic property shifts. Current representation learning,…

Machine Learning · Computer Science 2026-03-26 Xiangsen Chen , Ruilong Wu , Yanyan Lan , Ting Ma , Yang Liu

With the development of computer-assisted techniques, research communities including biochemistry and deep learning have been devoted into the drug discovery field for over a decade. Various applications of deep learning have drawn great…

Machine Learning · Computer Science 2023-03-07 Wenhao Hu , Yingying Liu , Xuanyu Chen , Wenhao Chai , Hangyue Chen , Hongwei Wang , Gaoang Wang

Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation learning methods, among which multi-modal molecular…

Machine Learning · Computer Science 2025-05-13 Rong Yin , Ruyue Liu , Xiaoshuai Hao , Xingrui Zhou , Yong Liu , Can Ma , Weiping Wang

Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for their vast knowledge…

Quantitative Methods · Quantitative Biology 2024-06-11 Junfeng Fang , Shuai Zhang , Chang Wu , Zhengyi Yang , Zhiyuan Liu , Sihang Li , Kun Wang , Wenjie Du , Xiang Wang

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedicated to designing…

Machine Learning · Computer Science 2024-06-21 He Cao , Yanjun Shao , Zhiyuan Liu , Zijing Liu , Xiangru Tang , Yuan Yao , Yu Li

Language Models (LMs) have greatly influenced diverse domains. However, their inherent limitation in comprehending 3D molecular structures has considerably constrained their potential in the biomolecular domain. To bridge this gap, we focus…

Machine Learning · Computer Science 2024-03-19 Sihang Li , Zhiyuan Liu , Yanchen Luo , Xiang Wang , Xiangnan He , Kenji Kawaguchi , Tat-Seng Chua , Qi Tian

AI models for drug discovery and chemical literature mining must interpret molecular images and generate outputs consistent with 3D geometry and stereochemistry. Most molecular language models rely on strings or graphs, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jing Lan , Hexiao Ding , Hongzhao Chen , Yufeng Jiang , Nga-Chun Ng , Gwing Kei Yip , Gerald W. Y. Cheng , Yunlin Mao , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Text-guided molecule generation is a task where molecules are generated to match specific textual descriptions. Recently, most existing SMILES-based molecule generation methods rely on an autoregressive architecture. In this work, we…

Machine Learning · Computer Science 2024-02-21 Haisong Gong , Qiang Liu , Shu Wu , Liang Wang

The automatic analysis of chemical literature has immense potential to accelerate the discovery of new materials and drugs. Much of the critical information in patent documents and scientific articles is contained in figures, depicting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Lucas Morin , Martin Danelljan , Maria Isabel Agea , Ahmed Nassar , Valery Weber , Ingmar Meijer , Peter Staar , Fisher Yu

Understanding and continuously refining multimodal molecular knowledge is crucial for advancing biomedicine, chemistry, and materials science. Molecule language models (MoLMs) have become powerful tools in these domains, integrating…

Machine Learning · Computer Science 2025-12-01 Zhenyu Lei , Patrick Soga , Yaochen Zhu , Yinhan He , Yushun Dong , Jundong Li

Structure-based drug design (SBDD), which maps target proteins to candidate molecular ligands, is a fundamental task in drug discovery. Effectively aligning protein structural representations with molecular representations, and ensuring…

Artificial Intelligence · Computer Science 2025-11-03 Wei Zhang , Zekun Guo , Yingce Xia , Peiran Jin , Shufang Xie , Tao Qin , Xiang-Yang Li