English
Related papers

Related papers: From Tokens to Blocks: A Block-Diffusion Perspecti…

200 papers

Understanding and designing biomolecules, such as proteins and small molecules, is central to advancing drug discovery, synthetic biology and enzyme engineering. Recent breakthroughs in artificial intelligence have revolutionized…

Computation and Language · Computer Science 2025-07-28 Xiang Zhuang , Keyan Ding , Tianwen Lyu , Yinuo Jiang , Xiaotong Li , Zhuoyi Xiang , Zeyuan Wang , Ming Qin , Kehua Feng , Jike Wang , Qiang Zhang , Huajun Chen

Multimodal protein language models (PLMs) integrate sequence and token-based structural information, serving as a powerful foundation for protein modeling, generation, and design. However, the reliance on tokenizing 3D structures into…

Machine Learning · Computer Science 2025-06-13 Cheng-Yen Hsieh , Xinyou Wang , Daiheng Zhang , Dongyu Xue , Fei Ye , Shujian Huang , Zaixiang Zheng , Quanquan Gu

Model compression is essential for serving large deep neural nets on devices with limited resources or applications that require real-time responses. As a case study, a state-of-the-art neural language model usually consists of one or more…

Computation and Language · Computer Science 2018-06-20 Patrick H. Chen , Si Si , Yang Li , Ciprian Chelba , Cho-jui Hsieh

Recent advancements in large language models (LLMs) have demonstrated impressive performance in molecular generation, which offers potential to accelerate drug discovery. However, the current LLMs overlook a critical requirement for drug…

Machine Learning · Computer Science 2025-02-18 Hyosoon Jang , Yunhui Jang , Jaehyung Kim , Sungsoo Ahn

Molecule design is a multifaceted approach that leverages computational methods and experiments to optimize molecular properties, fast-tracking new drug discoveries, innovative material development, and more efficient chemical processes.…

Computation and Language · Computer Science 2024-08-23 Sakhinana Sagar Srinivas , Venkataramana Runkana

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

Computation and Language · Computer Science 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

Structure-based drug design has seen significant advancements with the integration of artificial intelligence (AI), particularly in the generation of hit and lead compounds. However, most AI-driven approaches neglect the importance of…

Machine Learning · Computer Science 2025-11-10 Xinheng He , Yijia Zhang , Haowei Lin , Xingang Peng , Xiangzhe Kong , Mingyu Li , Jianzhu Ma

Molecule generation, especially generating 3D molecular geometries from scratch (i.e., 3D \textit{de novo} generation), has become a fundamental task in drug designs. Existing diffusion-based 3D molecule generation methods could suffer from…

Machine Learning · Computer Science 2022-09-14 Lei Huang , Hengtong Zhang , Tingyang Xu , Ka-Chun Wong

Machine learning for molecules holds great potential for efficiently exploring the vast chemical space and thus streamlining the drug discovery process by facilitating the design of new therapeutic molecules. Deep generative models have…

Machine Learning · Computer Science 2023-07-03 Johanna Sommer , Leon Hetzel , David Lüdke , Fabian Theis , Stephan Günnemann

Machine learning has the potential to automate molecular design and drastically accelerate the discovery of new functional compounds. Towards this goal, generative models and reinforcement learning (RL) using string and graph…

Machine Learning · Computer Science 2022-02-02 Daniel Flam-Shepherd , Alexander Zhigalin , Alán Aspuru-Guzik

Deep generative models have achieved tremendous success in designing novel drug molecules in recent years. A new thread of works have shown the great potential in advancing the specificity and success rate of in silico drug design by…

Machine Learning · Computer Science 2025-07-14 Xingang Peng , Shitong Luo , Jiaqi Guan , Qi Xie , Jian Peng , Jianzhu Ma

Drug targets are the main focus of drug discovery due to their key role in disease pathogenesis. Computational approaches are widely applied to drug development because of the increasing availability of biological molecular datasets.…

Machine Learning · Computer Science 2022-12-06 Junde Li , Collin Beaudoin , Swaroop Ghosh

Recent advances in generative deep learning have transformed small molecule design, but most methods lack biological systems context, focusing narrowly on specific protein pockets. We introduce a non-differentiable diffusion guidance method…

Biomolecules · Quantitative Biology 2024-10-15 Vincent D. Zaballa , Elliot E. Hui

Generative modeling of three-dimensional (3D) molecules is a fundamental yet challenging problem in drug discovery and materials science. Existing approaches typically represent molecules as 3D graphs and co-generate discrete atom types…

Machine Learning · Statistics 2026-03-16 Yuchen Hua , Xingang Peng , Jianzhu Ma , Muhan Zhang

Large Language Models (LLMs) employ three popular training approaches: Masked Language Models (MLM), Causal Language Models (CLM), and Sequence-to-Sequence Models (seq2seq). However, each approach has its strengths and limitations, and…

Machine Learning · Computer Science 2025-02-18 Xuefeng Liu , Songhao Jiang , Bo Li , Rick Stevens

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Predicting whether a molecule can cross the blood-brain barrier (BBB) is a key step in early-stage neuro-pharmaceutical design, directly influencing the efficiency and success rate of drug development. Traditional methods based on…

Quantitative Methods · Quantitative Biology 2026-03-16 Zihan Yang , Yuchen Xiao

Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this…

Machine Learning · Computer Science 2024-07-01 Matan Halfon , Eyal Rozenberg , Ehud Rivlin , Daniel Freedman

Drug discovery is a time-consuming and expensive process, with traditional high-throughput and docking-based virtual screening hampered by low success rates and limited scalability. Recent advances in generative modelling, including…

Artificial Intelligence · Computer Science 2026-03-12 Junkai Ji , Zhangfan Yang , Dong Xu , Ruibin Bai , Jianqiang Li , Tingjun Hou , Zexuan Zhu

Molecular relational learning (MRL) is crucial for understanding the interaction behaviors between molecular pairs, a critical aspect of drug discovery and development. However, the large feasible model space of MRL poses significant…

Machine Learning · Computer Science 2024-10-22 Sizhe Liu , Jun Xia , Lecheng Zhang , Yuchen Liu , Yue Liu , Wenjie Du , Zhangyang Gao , Bozhen Hu , Cheng Tan , Hongxin Xiang , Stan Z. Li