English
Related papers

Related papers: 3D-MolT5: Leveraging Discrete Structural Informati…

200 papers

Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the current methods focus on…

Machine Learning · Computer Science 2019-09-04 Jordan Hoffmann , Louis Maestrati , Yoshihide Sawada , Jian Tang , Jean Michel Sellier , Yoshua Bengio

We present MeshLLM, a novel framework that leverages large language models (LLMs) to understand and generate text-serialized 3D meshes. Our approach addresses key limitations in existing methods, including the limited dataset scale when…

Latent representation alignment has become a foundational technique for constructing multimodal large language models (MLLM) by mapping embeddings from different modalities into a shared space, often aligned with the embedding space of…

Machine Learning · Computer Science 2025-03-06 Dong Shu , Bingbing Duan , Kai Guo , Kaixiong Zhou , Jiliang Tang , Mengnan Du

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this task, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Deepan Adak , Yogesh Singh Rawat , Shruti Vyas

Drug discovery can be viewed as a combinatorial search over an immense chemical space, motivating the development of deep generative models for de novo molecular design. Among these, GPT-based molecular language models (MLM) have shown…

Machine Learning · Computer Science 2026-02-02 Qianwei Yang , Dong Xu , Zhangfan Yang , Sisi Yuan , Zexuan Zhu , Jianqiang Li , Junkai Ji

Molecule discovery is a pivotal research field, impacting everything from medicine to materials. Recently, Large Language Models (LLMs) have been widely adopted in molecular understanding and generation, serving as a bridge between the…

Computation and Language · Computer Science 2026-04-29 Jiatong Li , Yunqing Liu , Wei Liu , Jingdi Le , Di Zhang , Wenqi Fan , Dongzhan Zhou , Yuqiang Li , Qing Li

We consider molecule generation in 3D space using language models (LMs), which requires discrete tokenization of 3D molecular geometries. Although tokenization of molecular graphs exists, that for 3D geometries is largely unexplored. Here,…

Artificial Intelligence · Computer Science 2024-08-20 Xiner Li , Limei Wang , Youzhi Luo , Carl Edwards , Shurui Gui , Yuchao Lin , Heng Ji , Shuiwang Ji

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain…

Machine Learning · Computer Science 2024-02-05 Chang Liao , Yemin Yu , Yu Mei , Ying Wei

Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse,…

Machine Learning · Computer Science 2024-10-04 Huaisheng Zhu , Teng Xiao , Vasant G Honavar

Large Language Models (LLMs) and Vision Language Models (VLMs) have recently shown promising capabilities in various scientific domain. In particular, these advances have opened new opportunities in drug discovery, where the ability to…

Artificial Intelligence · Computer Science 2026-05-13 Jueon Park , Wonjune Jang , Jiwoo Lee , Yein Park , Jaewoo Kang

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

Machine Learning · Computer Science 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

Most machine learning models for molecular property prediction rely on a single molecular representation (either a sequence, a graph, or a 3D structure) and treat molecular geometry as static. We present MolFM-Lite, a multi-modal model that…

Although instruction-tuned large language models (LLMs) have exhibited remarkable capabilities across various NLP tasks, their effectiveness on other data modalities beyond text has not been fully studied. In this work, we propose…

Computation and Language · Computer Science 2023-06-16 Chenyang Lyu , Minghao Wu , Longyue Wang , Xinting Huang , Bingshuai Liu , Zefeng Du , Shuming Shi , Zhaopeng Tu

Humans possess the capability to comprehend diverse modalities and seamlessly transfer information between them. In this work, we introduce ModaVerse, a Multi-modal Large Language Model (MLLM) capable of comprehending and transforming…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyu Wang , Bohan Zhuang , Qi Wu

Large language models (LLMs), especially Explicit Long Chain-of-Thought (CoT) reasoning models like DeepSeek-R1 and QWQ, have demonstrated powerful reasoning capabilities, achieving impressive performance in commonsense reasoning and…

Computation and Language · Computer Science 2025-08-13 Jiatong Li , Weida Wang , Qinggang Zhang , Junxian Li , Di Zhang , Changmeng Zheng , Shufei Zhang , Xiaoyong Wei , Qing Li

The equivalent nature of 3D coordinates has posed long term challenges in protein structure representation learning, alignment, and generation. Can we create a compact and invariant language that equivalently represents protein structures?…

Biomolecules · Quantitative Biology 2024-07-02 Zhangyang Gao , Cheng Tan , Stan Z. Li

Predicting the 3D structure of a macromolecule, such as a protein or an RNA molecule, is ranked top among the most difficult and attractive problems in bioinformatics and computational biology. Its importance comes from the relationship…

Biomolecules · Quantitative Biology 2016-12-14 Zhiyong Wang

Graph neural networks are emerging as promising methods for modeling molecular graphs, in which nodes and edges correspond to atoms and chemical bonds, respectively. Recent studies show that when 3D molecular geometries, such as bond…

Machine Learning · Computer Science 2021-10-06 Zhao Xu , Youzhi Luo , Xuan Zhang , Xinyi Xu , Yaochen Xie , Meng Liu , Kaleb Dickerson , Cheng Deng , Maho Nakata , Shuiwang Ji

While various models and computational tools have been proposed for structure and property analysis of molecules, generating molecules that conform to all desired structures and properties remains a challenge. Here, we introduce a…

Computation and Language · Computer Science 2024-10-11 Peng Zhou , Jianmin Wang , Chunyan Li , Zixu Wang , Yiping Liu , Siqi Sun , Jianxin Lin , Leyi Wei , Xibao Cai , Houtim Lai , Wei Liu , Longyue Wang , Yuansheng Liu , Xiangxiang Zeng

Large language models (LLMs) pretrained on vast source code have achieved prominent progress in code intelligence. However, existing code LLMs have two main limitations in terms of architecture and pretraining tasks. First, they often adopt…

Computation and Language · Computer Science 2023-05-23 Yue Wang , Hung Le , Akhilesh Deepak Gotmare , Nghi D. Q. Bui , Junnan Li , Steven C. H. Hoi