English
Related papers

Related papers: Tokenizing 3D Molecule Structure with Quantized Sp…

200 papers

Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular…

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Predicting bioactivity and physical properties of molecules is a longstanding challenge in drug design. Most approaches use molecular descriptors based on a 2D representation of molecules as a graph of atoms and bonds, abstracting away the…

Quantitative Methods · Quantitative Biology 2020-10-27 William McCorkindale , Carl Poelking , Alpha A. Lee

Ground-state 3D geometries of molecules are essential for many molecular analysis tasks. Modern quantum mechanical methods can compute accurate 3D geometries but are computationally prohibitive. Currently, an efficient alternative to…

Chemical Physics · Physics 2023-05-24 Zhao Xu , Yaochen Xie , Youzhi Luo , Xuan Zhang , Xinyi Xu , Meng Liu , Kaleb Dickerson , Cheng Deng , Maho Nakata , Shuiwang Ji

Tokenization is a promising path to multi-modal models capable of jointly understanding protein sequences, structure, and function. Existing protein structure tokenizers create tokens by pooling information from local neighborhoods, an…

Machine Learning · Computer Science 2026-02-09 Rohit Dilip , Ayush Varshney , David Van Valen

We present VoxBind, a new score-based generative model for 3D molecules conditioned on protein structures. Our approach represents molecules as 3D atomic density grids and leverages a 3D voxel-denoising network for learning and generation.…

Machine Learning · Computer Science 2024-07-03 Pedro O. Pinheiro , Arian Jamasb , Omar Mahmood , Vishnu Sresht , Saeed Saremi

Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for…

Artificial Intelligence · Computer Science 2026-04-08 Seohyeon Shin , HanJun Choi , Jun-Hyung Park , Hong Kook Kim , Mansu Kim

Geometric deep learning (GDL) has demonstrated huge power and enormous potential in molecular data analysis. However, a great challenge still remains for highly efficient molecular representations. Currently, covalent-bond-based molecular…

Computational Physics · Physics 2023-06-28 Cong Shen , Jiawei Luo , Kelin Xia

Molecules are graphs, but large language models~(LLMs) are usually asked to reason about them through linear strings. The most popular molecular representation, SMILES, compresses atoms, bonds, branches and rings into a compact sequence in…

Biomolecules · Quantitative Biology 2026-05-19 Zhiyuan Yan , Chen Liu , Boxuan Zhao , Kaiqing Lin , Jixiang Zhao , Yimi Wang , Liuzhenghao Lv , Hao Li , Shanzhuo Zhang , Li Yuan , Fanyang Mo

We propose a new score-based approach to generate 3D molecules represented as atomic densities on regular grids. First, we train a denoising neural network that learns to map from a smooth distribution of noisy molecules to the distribution…

Establishing the relationship between 3D structures and the energy states of molecular systems has proven to be a promising approach for learning 3D molecular representations. However, existing methods are limited to modeling the molecular…

Machine Learning · Computer Science 2025-02-27 Liang Wang , Shaozhen Liu , Yu Rong , Deli Zhao , Qiang Liu , Shu Wu , Liang Wang

We study a fundamental problem in structure-based drug design -- generating molecules that bind to specific protein binding sites. While we have witnessed the great success of deep generative models in drug design, the existing methods are…

Biomolecules · Quantitative Biology 2022-11-15 Shitong Luo , Jiaqi Guan , Jianzhu Ma , Jian Peng

De novo 3D molecule generation is a pivotal task in drug discovery. However, many recent geometric generative models struggle to produce high-quality 3D structures, even if they maintain 2D validity and topological stability. To tackle this…

Machine Learning · Computer Science 2025-05-27 Danny Reidenbach , Filipp Nikitin , Olexandr Isayev , Saee Paliwal

Tokenization is the first - and often underappreciated - layer of computation in language models. While Chain-of-Thought (CoT) prompting enables transformer models to approximate recurrent computation by externalizing intermediate steps, we…

Computation and Language · Computer Science 2025-05-21 Xiang Zhang , Juntai Cao , Jiaqi Wei , Yiwei Xu , Chenyu You

Foundation models have significantly enhanced 2D task performance, and recent works like Bridge3D have successfully applied these models to improve 3D scene understanding through knowledge distillation, marking considerable advancements.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Zhimin Chen , Liang Yang , Yingwei Li , Longlong Jing , Bing Li

Molecular function is largely determined by structure. Accurately aligning molecular structure with natural language is therefore essential for enabling large language models (LLMs) to reason about downstream chemical tasks. However, the…

Computation and Language · Computer Science 2026-05-11 Feiyang Cai , Guijuan He , Yi Hu , Jingjing Wang , Joshua Luo , Tianyu Zhu , Srikanth Pilla , Gang Li , Ling Liu , Feng Luo

Deep generative models have emerged as a powerful tool for learning useful molecular representations and designing novel molecules with desired properties, with applications in drug discovery and material design. However, most existing deep…

Efficient encoding and representation of large 3D molecular structures with high fidelity is critical for biomolecular design applications. Despite this, many representation learning approaches restrict themselves to modeling smaller…

Machine Learning · Computer Science 2025-04-10 Andrew Liu , Axel Elaldi , Nathan Russell , Olivia Viessmann

Recent advances in machine learning have enabled generative models for both optimization and de novo generation of drug candidates with desired properties. Previous generative models have focused on producing SMILES strings or 2D molecular…

Quantitative Methods · Quantitative Biology 2021-11-25 Michael Arcidiacono , David Ryan Koes

Shape-based virtual screening is widely employed in ligand-based drug design to search chemical libraries for molecules with similar 3D shapes yet novel 2D chemical structures compared to known ligands. 3D deep generative models have the…

Chemical Physics · Physics 2022-10-12 Keir Adams , Connor W. Coley