English
Related papers

Related papers: From Tokens to Blocks: A Block-Diffusion Perspecti…

200 papers

Structure-based drug design (SBDD) is crucial for developing specific and effective therapeutics against protein targets but remains challenging due to complex protein-ligand interactions and vast chemical space. Although language models…

Biomolecules · Quantitative Biology 2024-08-20 Cong Fu , Xiner Li , Blake Olson , Heng Ji , Shuiwang Ji

Molecules play a crucial role in biomedical research and discovery, particularly in the field of small molecule drug development. Given the rapid advancements in large language models, especially the recent emergence of reasoning models, it…

Artificial Intelligence · Computer Science 2025-12-12 Chenyang Zuo , Siqi Fan , Zaiqing Nie

In the scope of drug discovery, the molecular design aims to identify novel compounds from the chemical space where the potential drug-like molecules are estimated to be in the order of 10^60 - 10^100. Since this search task is…

Machine Learning · Computer Science 2022-10-25 Wenlu Wang , Ye Wang , Honggang Zhao , Simone Sciabola

Goal-directed molecular generation requires satisfying heterogeneous constraints such as protein--ligand compatibility and multi-objective drug-like properties, yet existing methods often optimize these constraints in isolation, failing to…

Machine Learning · Computer Science 2026-04-14 Yanting Li , Zhuoyang Jiang , Enyan Dai , Lei Wang , Wen-Cai Ye , Li Liu

Diffusion models have shown promise in text generation, but often struggle with generating long, coherent, and contextually accurate text. Token-level diffusion doesn't model word-order dependencies explicitly and operates on short, fixed…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Georgi Karadzhov , Chenxi Whitehouse , Andreas Vlachos

Diffusion models have demonstrated strong potential in language modeling, offering various advantages over traditional autoregressive approaches. Their ability to generate and revise entire responses in parallel enables faster generation…

Machine Learning · Computer Science 2026-03-03 Michael Hersche , Samuel Moor-Smith , Thomas Hofmann , Abbas Rahimi

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

Generating high-fidelity synthetic GPS trajectories is increasingly important for applications in transportation, urban planning, and what-if scenario simulation, especially as privacy concerns limit access to real-world mobility data.…

Machine Learning · Computer Science 2026-05-12 Wilson Wongso , Lihuan Li , Arian Prabowo , Xiachong Lin , Baiyu Chen , Hao Xue , Flora D. Salim

Obtaining 3D conformations of realistic polyatomic molecules at the quantum chemistry level remains challenging, and although recent machine learning advances offer promise, predicting large-molecule structures still requires substantial…

Chemical Physics · Physics 2025-11-18 Yifei Zhu , Jiahui Zhang , Jiawei Peng , Mengge Li , Chao Xu , Zhenggang Lan

Large Language Models demonstrate substantial promise for advancing scientific discovery, yet their deployment in disciplines demanding factual precision and specialized domain constraints presents significant challenges. Within molecular…

Machine Learning · Computer Science 2026-02-23 Malikussaid , Hilal Hudan Nuha , Isman Kurniawan

The molecular large language models have garnered widespread attention due to their promising potential on molecular applications. However, current molecular large language models face significant limitations in understanding molecules due…

Biomolecules · Quantitative Biology 2025-10-23 Zaifei Yang , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context…

Information Retrieval · Computer Science 2025-02-04 Xiaohao Liu , Jie Wu , Zhulin Tao , Yunshan Ma , Yinwei Wei , Tat-seng Chua

AI models for drug discovery and chemical literature mining must interpret molecular images and generate outputs consistent with 3D geometry and stereochemistry. Most molecular language models rely on strings or graphs, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jing Lan , Hexiao Ding , Hongzhao Chen , Yufeng Jiang , Nga-Chun Ng , Gwing Kei Yip , Gerald W. Y. Cheng , Yunlin Mao , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Recent large language models (LLMs) have demonstrated promising capabilities in modeling real-world knowledge and enhancing knowledge-based generation tasks. In this paper, we further explore the potential of using LLMs to aid in the design…

Robotics · Computer Science 2024-11-04 Weicheng Ma , Luyang Zhao , Chun-Yi She , Yitao Jiang , Alan Sun , Bo Zhu , Devin Balkcom , Soroush Vosoughi

Scientific databases aggregate vast amounts of quantitative data alongside descriptive text. In biochemistry, molecule screening assays evaluate candidate molecules' functional responses against disease targets. Unstructured text that…

Machine Learning · Computer Science 2025-11-18 Yifan Deng , Spencer S. Ericksen , Anthony Gitter

Synthetic tabular data generation has attracted growing attention due to its importance for data augmentation, foundation models, and privacy. However, real-world tabular datasets increasingly contain free-form text fields (e.g., reviews or…

Machine Learning · Computer Science 2026-05-13 Donghong Cai , Jiarui Feng , Yanbo Wang , Da Zheng , Yixin Chen , Muhan Zhang

Structure-based molecular ML (SBML) models can be highly sensitive to input geometries and give predictions with large variance. We present an approach to mitigate the challenge of selecting conformations for such models by generating…

Machine Learning · Computer Science 2023-11-08 Michael Maser , Natasa Tagasovska , Jae Hyeon Lee , Andrew Watkins

We propose a novel molecular fingerprint-based variational autoencoder applied for molecular generation on real-world drug molecules. We define more suitable and pharma-relevant baseline metrics and tests, focusing on the generation of…

Machine Learning · Computer Science 2022-11-17 Ruslan N. Tazhigulov , Joshua Schiller , Jacob Oppenheim , Max Winston

Machine learning accelerates molecular property prediction, yet state-of-the-art Large Language Models and Graph Neural Networks operate as black boxes. In drug discovery, where safety is critical, this opacity risks masking false…

Machine Learning · Computer Science 2026-03-03 Oscar Rivera , Ziqing Wang , Matthieu Dagommer , Abhishek Pandey , Kaize Ding

Large Language Models (LLMs) struggle with complex reasoning due to limited diversity and inefficient search. We propose Soft Reasoning, an embedding-based search framework that optimises the embedding of the first token to guide…

Computation and Language · Computer Science 2025-09-16 Qinglin Zhu , Runcong Zhao , Hanqi Yan , Yulan He , Yudong Chen , Lin Gui