English
Related papers

Related papers: From Tokens to Blocks: A Block-Diffusion Perspecti…

200 papers

The integration of molecular and natural language representations has emerged as a focal point in molecular science, with recent advancements in Language Models (LMs) demonstrating significant potential for comprehensive modeling of both…

Biomolecules · Quantitative Biology 2025-03-19 Qizhi Pei , Rui Yan , Kaiyuan Gao , Jinhua Zhu , Lijun Wu

Developing new drugs is laborious and costly, demanding extensive time investment. In this paper, we introduce a de-novo drug design strategy, which harnesses the capabilities of language models to devise targeted drugs for specific…

Biomolecules · Quantitative Biology 2025-05-20 Salma J. Ahmed , Emad A. Mohammed

Discrete tokenizers have emerged as indispensable components in modern machine learning systems, particularly within the context of autoregressive modeling and large language models (LLMs). These tokenizers serve as the critical interface…

Information Retrieval · Computer Science 2025-02-19 Jian Jia , Jingtong Gao , Ben Xue , Junhao Wang , Qingpeng Cai , Quan Chen , Xiangyu Zhao , Peng Jiang , Kun Gai

This study proposes MCEMOL (Multi-Constrained Evolutionary Molecular Design Framework), a molecular optimization approach integrating rule-based evolution with molecular crossover. MCEMOL employs dual-layer evolution: optimizing…

Neural and Evolutionary Computing · Computer Science 2026-01-16 Shanxian Lin , Wei Xia , Yuichi Nagata , Haichuan Yang

Generative tasks about molecules, including but not limited to molecule generation, are crucial for drug discovery and material design, and have consistently attracted significant attention. In recent years, diffusion models have emerged as…

Machine Learning · Computer Science 2025-02-14 Liang Wang , Chao Song , Zhiyuan Liu , Yu Rong , Qiang Liu , Shu Wu , Liang Wang

De novo generation of hit-like molecules is a challenging task in the drug discovery process. Most methods in previous studies learn the semantics and syntax of molecular structures by analyzing molecular graphs or simplified molecular…

Machine Learning · Computer Science 2025-04-18 Chen Li , Yoshihiro Yamanishi

Recent advances in machine learning for molecules exhibit great potential for facilitating drug discovery from in silico predictions. Most models for molecule generation rely on the decomposition of molecules into frequently occurring…

Chemical Physics · Physics 2023-11-08 Leon Hetzel , Johanna Sommer , Bastian Rieck , Fabian Theis , Stephan Günnemann

Rich data and powerful machine learning models allow us to design drugs for a specific protein target \textit{in silico}. Recently, the inclusion of 3D structures during targeted drug design shows superior performance to other target-free…

Biomolecules · Quantitative Biology 2023-03-08 Jiaqi Guan , Wesley Wei Qian , Xingang Peng , Yufeng Su , Jian Peng , Jianzhu Ma

Is there a unified model for generating molecules considering different conditions, such as binding pockets and chemical properties? Although target-aware generative models have made significant advances in drug design, they do not consider…

Artificial Intelligence · Computer Science 2023-02-15 Zhangyang Gao , Yuqi Hu , Cheng Tan , Stan Z. Li

The dominant approach to generating from language models subject to some constraint is locally constrained decoding (LCD), incrementally sampling tokens at each time step such that the constraint is never violated. Typically, this is…

The robustness of AI-content detection models against sophisticated adversarial strategies, such as paraphrasing or word switching, is a rising concern in natural language generation (NLG) applications. This study proposes ToBlend, a novel…

Computation and Language · Computer Science 2024-10-17 Fan Huang , Haewoon Kwak , Jisun An

Molecular optimization is a crucial yet complex and time-intensive process that often acts as a bottleneck for drug development. Traditional methods rely heavily on trial and error, making multi-objective optimization both time-consuming…

Biomolecules · Quantitative Biology 2025-03-06 Jiajun Yu , Yizhen Zheng , Huan Yee Koh , Shirui Pan , Tianyue Wang , Haishuai Wang

Recent advancements in deep learning-based modeling of molecules promise to accelerate in silico drug discovery. A plethora of generative models is available, building molecules either atom-by-atom and bond-by-bond or fragment-by-fragment.…

In the molecular domain, numerous studies have explored the use of multimodal large language models (LLMs) to construct a general-purpose, multi-task molecular model. However, these efforts are still far from achieving a truly universal…

Machine Learning · Computer Science 2025-10-31 Chengxin Hu , Hao Li , Yihe Yuan , Zezheng Song , Chenyang Zhao , Haixin Wang

Dialogue generation models face the challenge of producing generic and repetitive responses. Unlike previous augmentation methods that mostly focus on token manipulation and ignore the essential variety within a single sample using hard…

Computation and Language · Computer Science 2021-03-03 Yu Cao , Liang Ding , Zhiliang Tian , Meng Fang

Speculative Decoding (SD) is a key technique for accelerating Large Language Model (LLM) inference, but it typically requires training a draft model on a large dataset. We approach this problem from a data-centric perspective, finding that…

Computation and Language · Computer Science 2026-02-19 Jiaming Fan , Daming Cao , Xiangzhong Luo , Jiale Fu , Chonghan Liu , Xu Yang

Molecule design is a fundamental problem in molecular science and has critical applications in a variety of areas, such as drug discovery, material science, etc. However, due to the large searching space, it is impossible for human experts…

Machine Learning · Computer Science 2022-03-29 Yuanqi Du , Tianfan Fu , Jimeng Sun , Shengchao Liu

Language Models (LMs) have greatly influenced diverse domains. However, their inherent limitation in comprehending 3D molecular structures has considerably constrained their potential in the biomolecular domain. To bridge this gap, we focus…

Machine Learning · Computer Science 2024-03-19 Sihang Li , Zhiyuan Liu , Yanchen Luo , Xiang Wang , Xiangnan He , Kenji Kawaguchi , Tat-Seng Chua , Qi Tian

Large language models (LLMs) are increasingly recognized as powerful tools for scientific discovery, particularly in molecular science. A fundamental requirement for these models is the ability to accurately understand molecular structures,…

Machine Learning · Computer Science 2025-05-23 Yunhui Jang , Jaehyung Kim , Sungsoo Ahn

Text-guided molecular design is a key capability for AI-driven drug discovery, yet it remains challenging to map sequential natural-language instructions with non-linear molecular structures under strict chemical constraints. Most existing…

Artificial Intelligence · Computer Science 2026-04-23 Wengyu Zhang , Xiao-Yong Wei , Qing Li