English
Related papers

Related papers: Tokenizing 3D Molecule Structure with Quantized Sp…

200 papers

Text-based foundation models have become an important part of scientific discovery, with molecular foundation models accelerating advancements in material science and molecular design.However, existing models are constrained by…

Machine Learning · Computer Science 2026-01-29 Alexius Wadell , Anoushka Bhutani , Venkatasubramanian Viswanathan

Deep generative models have achieved tremendous success in designing novel drug molecules in recent years. A new thread of works have shown the great potential in advancing the specificity and success rate of in silico drug design by…

Machine Learning · Computer Science 2025-07-14 Xingang Peng , Shitong Luo , Jiaqi Guan , Qi Xie , Jian Peng , Jianzhu Ma

Machine learning in drug discovery has been focused on virtual screening of molecular libraries using discriminative models. Generative models are an entirely different approach that learn to represent and optimize molecules in a continuous…

Quantitative Methods · Quantitative Biology 2020-11-17 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

Recent advances in 3D vision-language models (VLMs) highlight a strong potential for 3D scene understanding and reasoning. However, effectively tokenizing 3D scenes into holistic scene tokens, and leveraging these tokens across diverse 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yutao Tang , Cheng Zhao , Gaurav Mittal , Rohith Kukkala , Rama Chellappa , Cheng Peng , Mei Chen

We introduce G2T-LLM, a novel approach for molecule generation that uses graph-to-tree text encoding to transform graph-based molecular structures into a hierarchical text format optimized for large language models (LLMs). This encoding…

Machine Learning · Computer Science 2024-10-04 Zhaoning Yu , Xiangyang Xu , Hongyang Gao

Large language models have made remarkable progress in the field of molecular science, particularly in understanding and generating functional small molecules. This success is largely attributed to the effectiveness of molecular…

Biomolecules · Quantitative Biology 2025-03-14 Zicheng Ma , Chuanliu Fan , Zhicong Wang , Zhenyu Chen , Xiaohan Lin , Yanheng Li , Shihao Feng , Jun Zhang , Ziqiang Cao , Yi Qin Gao

Representation learning and \emph{de novo} generation of proteins are pivotal computational biology tasks. Whilst natural language processing (NLP) techniques have proven highly effective for protein sequence modelling, structure modelling…

Quantitative Methods · Quantitative Biology 2025-01-08 Benoit Gaujac , Jérémie Donà , Liviu Copoiu , Timothy Atkinson , Thomas Pierrot , Thomas D. Barrett

The application of large language models (LLMs) to chemistry is frequently hampered by a "tokenization bottleneck", where tokenizers tuned on general-domain text tend to fragment chemical representations such as SMILES into semantically…

Computation and Language · Computer Science 2025-11-19 Prathamesh Kalamkar , Ned Letcher , Meissane Chami , Sahger Lad , Shayan Mohanty , Prasanna Pendse

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

Machine Learning · Computer Science 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

Graph neural networks (GNNs) have been used extensively for addressing problems in drug design and discovery. Both ligand and target molecules are represented as graphs with node and edge features encoding information about atomic elements…

Machine Learning · Computer Science 2021-10-14 Dhananjay Bhaskar , Jackson D. Grady , Michael A. Perlmutter , Smita Krishnaswamy

Automating molecular design using deep reinforcement learning (RL) has the potential to greatly accelerate the search for novel materials. Despite recent progress on leveraging graph representations to design molecules, such methods are…

Machine Learning · Statistics 2021-06-08 Gregor N. C. Simm , Robert Pinsler , Gábor Csányi , José Miguel Hernández-Lobato

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph…

Machine Learning · Computer Science 2024-02-07 Chenqing Hua , Sitao Luan , Minkai Xu , Rex Ying , Jie Fu , Stefano Ermon , Doina Precup

Denoising diffusion models have shown great potential in multiple research areas. Existing diffusion-based generative methods on de novo 3D molecule generation face two major challenges. Since majority heavy atoms in molecules allow…

Machine Learning · Computer Science 2024-04-23 Can Xu , Haosen Wang , Weigang Wang , Pengfei Zheng , Hongyang Chen

Generating novel active molecules for a given protein is an extremely challenging task for generative models that requires an understanding of the complex physical interactions between the molecule and its environment. In this paper, we…

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Most current molecular language models transfer the masked language model or image-text generation model from natural language processing to molecular field. However, molecules are not solely characterized by atom/bond symbols; they…

Emerging Technologies · Computer Science 2024-11-26 Yifan Wu , Min Zeng , Yang Li , Yang Zhang , Min Li

The goal of structure-based drug discovery is to find small molecules that bind to a given target protein. Deep learning has been used to generate drug-like molecules with certain cheminformatic properties, but has not yet been applied to…

Quantitative Methods · Quantitative Biology 2022-01-27 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

Masked graph modeling excels in the self-supervised representation learning of molecular graphs. Scrutinizing previous studies, we can reveal a common scheme consisting of three key components: (1) graph tokenizer, which breaks a molecular…

Machine Learning · Computer Science 2024-01-17 Zhiyuan Liu , Yaorui Shi , An Zhang , Enzhi Zhang , Kenji Kawaguchi , Xiang Wang , Tat-Seng Chua

Molecule generation is a challenging open problem in cheminformatics. Currently, deep generative approaches addressing the challenge belong to two broad categories, differing in how molecules are represented. One approach encodes molecular…

Machine Learning · Statistics 2020-11-02 Marco Podda , Davide Bacciu , Alessio Micheli

Deep learning has proven to yield fast and accurate predictions of quantum-chemical properties to accelerate the discovery of novel molecules and materials. As an exhaustive exploration of the vast chemical space is still infeasible, we…

Machine Learning · Statistics 2020-01-10 Niklas W. A. Gebauer , Michael Gastegger , Kristof T. Schütt