English
Related papers

Related papers: Chem3DLLM: 3D Multimodal Large Language Models for…

200 papers

Predicting the 3D structure of a macromolecule, such as a protein or an RNA molecule, is ranked top among the most difficult and attractive problems in bioinformatics and computational biology. Its importance comes from the relationship…

Biomolecules · Quantitative Biology 2016-12-14 Zhiyong Wang

Large language models (LLMs) are increasingly recognized as powerful tools for scientific discovery, particularly in molecular science. A fundamental requirement for these models is the ability to accurately understand molecular structures,…

Machine Learning · Computer Science 2025-05-23 Yunhui Jang , Jaehyung Kim , Sungsoo Ahn

This paper demonstrates that language models are strong structure-based protein designers. We present LM-Design, a generic approach to reprogramming sequence-based protein language models (pLMs), that have learned massive sequential…

Machine Learning · Computer Science 2023-02-10 Zaixiang Zheng , Yifan Deng , Dongyu Xue , Yi Zhou , Fei YE , Quanquan Gu

There is increasing adoption of artificial intelligence in drug discovery. However, existing studies use machine learning to mainly utilize the chemical structures of molecules but ignore the vast textual knowledge available in chemistry.…

Machine Learning · Computer Science 2024-01-31 Shengchao Liu , Weili Nie , Chengpeng Wang , Jiarui Lu , Zhuoran Qiao , Ling Liu , Jian Tang , Chaowei Xiao , Anima Anandkumar

Understanding 3D medical image volumes is critical in the medical field, yet existing 3D medical convolution and transformer-based self-supervised learning (SSL) methods often lack deep semantic comprehension. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Qiuhui Chen , Xuancheng Yao , Huping Ye , Yi Hong

Recent advancements in multimodal large language models (LLMs) have demonstrated significant potential across various domains, particularly in concept reasoning. However, their applications in understanding 3D environments remain limited,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kuan-Chih Huang , Xiangtai Li , Lu Qi , Shuicheng Yan , Ming-Hsuan Yang

This work explores expanding the capabilities of large language models (LLMs) pretrained on text to generate 3D meshes within a unified model. This offers key advantages of (1) leveraging spatial knowledge already embedded in LLMs, derived…

Machine Learning · Computer Science 2024-11-15 Zhengyi Wang , Jonathan Lorraine , Yikai Wang , Hang Su , Jun Zhu , Sanja Fidler , Xiaohui Zeng

Recent advancements in autonomous driving, augmented reality, robotics, and embodied intelligence have necessitated 3D perception algorithms. However, current 3D perception methods, especially specialized small models, exhibit poor…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Fan Yang , Sicheng Zhao , Yanhao Zhang , Hui Chen , Haonan Lu , Jungong Han , Guiguang Ding

We consider molecule generation in 3D space using language models (LMs), which requires discrete tokenization of 3D molecular geometries. Although tokenization of molecular graphs exists, that for 3D geometries is largely unexplored. Here,…

Artificial Intelligence · Computer Science 2024-08-20 Xiner Li , Limei Wang , Youzhi Luo , Carl Edwards , Shurui Gui , Yuchao Lin , Heng Ji , Shuiwang Ji

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Generative machine learning models for exploring chemical space have shown immense promise, but many molecules they generate are too difficult to synthesize, making them impractical for further investigation or development. In this work, we…

Large Language Models (LLMs) have demonstrated great performance in few-shot In-Context Learning (ICL) for a variety of generative and discriminative chemical design tasks. The newly expanded context windows of LLMs can further improve ICL…

The molecular large language models have garnered widespread attention due to their promising potential on molecular applications. However, current molecular large language models face significant limitations in understanding molecules due…

Biomolecules · Quantitative Biology 2025-10-23 Zaifei Yang , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

Machine learning in drug discovery has been focused on virtual screening of molecular libraries using discriminative models. Generative models are an entirely different approach that learn to represent and optimize molecules in a continuous…

Quantitative Methods · Quantitative Biology 2020-11-17 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

Organic reaction, the foundation of modern chemical industry, is crucial for new material development and drug discovery. However, deciphering reaction mechanisms and modeling multi-molecular relationships remain formidable challenges due…

Chemical Physics · Physics 2025-08-13 Lirong Wu , Junjie Wang , Zhifeng Gao , Xiaohong Ji , Rong Zhu , Xinyu Li , Linfeng Zhang , Guolin Ke , Weinan E

Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text.…

Machine Learning · Computer Science 2023-07-17 Chen Qian , Huayi Tang , Zhirui Yang , Hong Liang , Yong Liu

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

Recently, 3D understanding has become popular to facilitate autonomous agents to perform further decisionmaking. However, existing 3D datasets and methods are often limited to specific tasks. On the other hand, recent progress in Large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingsheng Li , Xin Chen , Chi Zhang , Sijin Chen , Hongyuan Zhu , Fukun Yin , Gang Yu , Tao Chen

Structure-based drug design (SBDD) aims to generate 3D ligand molecules that bind to specific protein targets. Existing 3D deep generative models including diffusion models have shown great promise for SBDD. However, it is complex to…

Biomolecules · Quantitative Biology 2024-03-01 Zhilin Huang , Ling Yang , Zaixi Zhang , Xiangxin Zhou , Yu Bao , Xiawu Zheng , Yuwei Yang , Yu Wang , Wenming Yang

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain…

Machine Learning · Computer Science 2024-02-05 Chang Liao , Yemin Yu , Yu Mei , Ying Wei