English
Related papers

Related papers: Tokenizing 3D Molecule Structure with Quantized Sp…

200 papers

This paper investigates the impact of using morphologically-informed tokenizers to aid and streamline the interlinear gloss annotation of an audio corpus of Yolox\'ochitl Mixtec (YM) using a combination of ASR and text-based…

Computation and Language · Computer Science 2025-12-09 Chris Crawford

Identifying the chemical structure from a graphical representation, or image, of a molecule is a challenging pattern recognition task that would greatly benefit drug development. Yet, existing methods for chemical structure recognition do…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Martijn Oldenhof , Edward De Brouwer , Adam Arany , Yves Moreau

Vision-language models like CLIP can offer a promising foundation for 3D scene understanding when extended with 3D tokenizers. However, standard approaches, such as k-nearest neighbor or radius-based tokenization, struggle with cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guofeng Mei , Bin Ren , Juan Liu , Luigi Riz , Xiaoshui Huang , Xu Zheng , Yongshun Gong , Ming-Hsuan Yang , Nicu Sebe , Fabio Poiesi

Scaling large multimodal models (LMMs) to 3D understanding poses unique challenges: point cloud data is sparse and irregular, existing models rely on fragmented architectures with modality-specific encoders, and training pipelines often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yongyuan Liang , Xiyao Wang , Yuanchen Ju , Jianwei Yang , Furong Huang

Transformers have become methods of choice in many applications thanks to their ability to represent complex interactions between elements. However, extending the Transformer architecture to non-sequential data such as molecules and…

Machine Learning · Computer Science 2022-04-27 Yoni Choukroun , Lior Wolf

Aligning molecular sequence representations (e.g., SMILES notations) with textual descriptions is critical for applications spanning drug discovery, materials design, and automated chemical literature analysis. Existing methodologies…

Artificial Intelligence · Computer Science 2025-11-25 Letian Chen , Runhan Shi , Gufeng Yu , Yang Yang

Recent advances in machine learning for molecules exhibit great potential for facilitating drug discovery from in silico predictions. Most models for molecule generation rely on the decomposition of molecules into frequently occurring…

Chemical Physics · Physics 2023-11-08 Leon Hetzel , Johanna Sommer , Bastian Rieck , Fabian Theis , Stephan Günnemann

Structure-based drug design, i.e., finding molecules with high affinities to the target protein pocket, is one of the most critical tasks in drug discovery. Traditional solutions, like virtual screening, require exhaustively searching on a…

Biomolecules · Quantitative Biology 2023-02-16 Shuqi Lu , Lin Yao , Xi Chen , Hang Zheng , Di He , Guolin Ke

Pixel-wise capabilities are essential for building interactive intelligent systems. However, pixel-wise multi-modal LLMs (MLLMs) remain difficult to scale due to complex region-level encoders, specialized segmentation decoders, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yikang Zhou , Tao Zhang , Dengxian Gong , Yuanzheng Wu , Ye Tian , Haochen Wang , Haobo Yuan , Jiacong Wang , Lu Qi , Hao Fei , Anran Wang , Zhuochen Wang , Yujing Wang , Cheng Chen , Shunping Ji , Xiangtai Li

Molecular representation learning is crucial for the problem of molecular property prediction, where graph neural networks (GNNs) serve as an effective solution due to their structure modeling capabilities. Since labeled data is often…

Machine Learning · Computer Science 2023-09-26 Cameron Diao , Kaixiong Zhou , Zirui Liu , Xiao Huang , Xia Hu

Molecular structures are always depicted as 2D printed form in scientific documents like journal papers and patents. However, these 2D depictions are not machine-readable. Due to a backlog of decades and an increasing amount of these…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Youjun Xu , Jinchuan Xiao , Chia-Han Chou , Jianhang Zhang , Jintao Zhu , Qiwan Hu , Hemin Li , Ningsheng Han , Bingyu Liu , Shuaipeng Zhang , Jinyu Han , Zhen Zhang , Shuhao Zhang , Weilin Zhang , Luhua Lai , Jianfeng Pei

We introduce a new representation for 3D molecules based on their continuous atomic density fields. Using this representation, we propose a new model based on walk-jump sampling for unconditional 3D molecule generation in the continuous…

Machine Learning · Computer Science 2025-01-16 Matthieu Kirchmeyer , Pedro O. Pinheiro , Saeed Saremi

Molecular graph representation learning is a fundamental problem in modern drug and material discovery. Molecular graphs are typically modeled by their 2D topological structures, but it has been recently discovered that 3D geometric…

Machine Learning · Computer Science 2022-05-31 Shengchao Liu , Hanchen Wang , Weiyang Liu , Joan Lasenby , Hongyu Guo , Jian Tang

Effective representation of molecules is a crucial factor affecting the performance of artificial intelligence models. This study introduces a flexible, fragment-based, multiscale molecular representation framework called t-SMILES…

Machine Learning · Computer Science 2024-05-22 Juan-Ni Wu , Tong Wang , Yue Chen , Li-Juan Tang , Hai-Long Wu , Ru-Qin Yu

The development of novel pharmaceuticals represents a significant challenge in modern science, with substantial costs and time investments. Deep generative models have emerged as promising tools for accelerating drug discovery by…

Atomic Physics · Physics 2025-05-20 Adarsh Singh

We consider representation learning of 3D molecular graphs in which each atom is associated with a spatial position in 3D. This is an under-explored area of research, and a principled message passing framework is currently lacking. In this…

Machine Learning · Computer Science 2022-11-28 Yi Liu , Limei Wang , Meng Liu , Xuan Zhang , Bora Oztekin , Shuiwang Ji

Information delivery using chemical molecules is an integral part of biology at multiple distance scales and has attracted recent interest in bioengineering and communication theory. Potential applications include cooperative networks with…

Information Theory · Computer Science 2017-09-05 Yansha Deng , Adam Noel , Weisi Guo , Arumugam Nallanathan , Maged Elkashlan

Pretraining molecular representations from large unlabeled data is essential for molecular property prediction due to the high cost of obtaining ground-truth labels. While there exist various 2D graph-based molecular pretraining approaches,…

Machine Learning · Computer Science 2023-09-11 Sungjun Cho , Dae-Woong Jeong , Sung Moon Ko , Jinwoo Kim , Sehui Han , Seunghoon Hong , Honglak Lee , Moontae Lee

Deep generative models have recently been applied to molecule design. If the molecules are encoded in linear SMILES strings, modeling becomes convenient. However, models relying on string representations tend to generate invalid samples and…

Machine Learning · Computer Science 2020-10-20 Bo Pang , Tian Han , Ying Nian Wu

Designing molecules with specific properties is a long-lasting research problem and is central to advancing crucial domains such as drug discovery and material science. Recent advances in deep graph generative models treat molecule design…

Machine Learning · Computer Science 2022-03-02 Yuanqi Du , Xiaojie Guo , Amarda Shehu , Liang Zhao