English
Related papers

Related papers: From Tokens to Blocks: A Block-Diffusion Perspecti…

200 papers

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

The design of target-specific molecules such as small molecules, peptides, and antibodies is vital for biological research and drug discovery. Existing generative methods are restricted to single-domain molecules, failing to address…

Machine Learning · Computer Science 2025-05-27 Xiangzhe Kong , Zishen Zhang , Ziting Zhang , Rui Jiao , Jianzhu Ma , Wenbing Huang , Kai Liu , Yang Liu

Structure-based drug design (SBDD), which aims to generate molecules that can bind tightly to the target protein, is an essential problem in drug discovery, and previous approaches have achieved initial success. However, most existing…

Machine Learning · Computer Science 2024-04-04 Xinze Li , Penglei Wang , Tianfan Fu , Wenhao Gao , Chengtao Li , Leilei Shi , Junhong Liu

Deep learning has proven to yield fast and accurate predictions of quantum-chemical properties to accelerate the discovery of novel molecules and materials. As an exhaustive exploration of the vast chemical space is still infeasible, we…

Machine Learning · Statistics 2020-01-10 Niklas W. A. Gebauer , Michael Gastegger , Kristof T. Schütt

Data-driven generation of molecules with desired properties, also known as inverse molecular design (IMD), has attracted significant attention in recent years. Despite the significant progress in the accuracy and diversity of solutions,…

Chemical Physics · Physics 2024-02-28 Kevin Tirta Wijaya , Navid Ansari , Hans-Peter Seidel , Vahid Babaei

Traditional drug discovery programs are being transformed by the advent of machine learning methods. Among these, Generative AI methods (GM) have gained attention due to their ability to design new molecules and enhance specific properties…

Chain-of-Thought (CoT) reasoning enables Large Language Models (LLMs) to solve complex reasoning tasks by generating intermediate reasoning steps. However, most existing approaches focus on hard token decoding, which constrains reasoning…

Computation and Language · Computer Science 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel molecules. Discovering novel molecules requires accurate out-of-distribution (OOD) predictions,…

Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them,…

Materials Science · Physics 2025-03-04 Onur Boyar , Indra Priyadarsini , Seiji Takeda , Lisa Hamada

Diffusion Language Models (DLMs) enable fast generation, yet training large DLMs from scratch is costly. As a practical shortcut, adapting off-the-shelf Auto-Regressive (AR) model weights into a DLM could quickly equip the DLM with strong…

Computation and Language · Computer Science 2026-02-02 Yuchuan Tian , Yuchen Liang , Shuo Zhang , Yingte Shu , Guangwen Yang , Wei He , Sibo Fang , Tianyu Guo , Kai Han , Chao Xu , Hanting Chen , Xinghao Chen , Yunhe Wang

Human cognition typically involves thinking through abstract, fluid concepts rather than strictly using discrete linguistic tokens. Current reasoning models, however, are constrained to reasoning within the boundaries of human language,…

Computation and Language · Computer Science 2025-05-22 Zhen Zhang , Xuehai He , Weixiang Yan , Ao Shen , Chenyang Zhao , Shuohang Wang , Yelong Shen , Xin Eric Wang

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

Machine Learning · Computer Science 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou

Generative models, especially diffusion models (DMs), have achieved promising results for generating feature-rich geometries and advancing foundational science problems such as molecule design. Inspired by the recent huge success of Stable…

Machine Learning · Computer Science 2023-05-03 Minkai Xu , Alexander Powers , Ron Dror , Stefano Ermon , Jure Leskovec

AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the…

Machine Learning · Computer Science 2024-01-17 Xiuyuan Hu , Guoqing Liu , Yang Zhao , Hao Zhang

The strict selectivity of the blood-brain barrier (BBB) represents one of the most formidable challenges to successful central nervous system (CNS) drug delivery. Computational methods to generate BBB permeable drugs in silico may be…

Biomolecules · Quantitative Biology 2024-07-02 Ayush Noori , Iñaki Arango , William E. Byrd , Nada Amin

While multimodal fusion has been extensively studied in Multimodal Sentiment Analysis (MSA), the role of fusion depth and multimodal capacity allocation remains underexplored. In this work, we position fusion depth, scalability, and…

Computation and Language · Computer Science 2025-04-16 Efthymios Georgiou , Vassilis Katsouros , Yannis Avrithis , Alexandros Potamianos

Diffusion language models (DLMs) have strong theoretical efficiency but are limited by fixed-length decoding and incompatibility with key-value (KV) caches. Block diffusion mitigates these issues, yet still enforces a fixed block size and…

Computation and Language · Computer Science 2025-09-30 Yangzhou Liu , Yue Cao , Hao Li , Gen Luo , Zhe Chen , Weiyun Wang , Xiaobo Liang , Biqing Qi , Lijun Wu , Changyao Tian , Yanting Zhang , Yuqiang Li , Tong Lu , Yu Qiao , Jifeng Dai , Wenhai Wang

Self-supervised neural language models have recently found wide applications in generative design of organic molecules and protein sequences as well as representation learning for downstream structure classification and functional…

Materials Science · Physics 2022-09-21 Lai Wei , Nihang Fu , Yuqi Song , Qian Wang , Jianjun Hu

There will be a paradigm shift in chemical and biological research, to be enabled by autonomous, closed-loop, real-time self-directed decision-making experimentation. Spectrum-to-structure correlation, which is to elucidate molecular…

Chemical Physics · Physics 2026-01-21 Xinyu Lu , Hao Ma , Hui Li , Jia Li , Yi Rong , Yuqiang Li , Tong Zhu , Guokun Liu , Bin Ren

The integration of Large Language Models (LLMs) into the drug discovery and development field marks a significant paradigm shift, offering novel methodologies for understanding disease mechanisms, facilitating drug discovery, and optimizing…

Quantitative Methods · Quantitative Biology 2024-09-10 Yizhen Zheng , Huan Yee Koh , Maddie Yang , Li Li , Lauren T. May , Geoffrey I. Webb , Shirui Pan , George Church