English
Related papers

Related papers: Test-Time Training Scaling Laws for Chemical Explo…

200 papers

Large Language Models (LLMs) have the potential to accelerate small molecule drug design due to their ability to reason about information from diverse sources and formats. However, their practical utility remains unclear due to the lack of…

Scaling large language models (LLMs) has driven significant advancements, yet it faces diminishing returns and escalating energy demands. This work explores how test-time compute (TTC) can serve as an energy-efficient complement to…

Machine Learning · Computer Science 2025-11-11 Yunho Jin , Gu-Yeon Wei , David Brooks

Scaling test time compute has shown remarkable success in improving the reasoning abilities of large language models (LLMs). In this work, we conduct the first systematic exploration of applying test-time scaling methods to language agents…

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Chemical language models, combined with reinforcement learning (RL), have shown significant promise to efficiently traverse large chemical spaces for drug discovery. However, the performance of various RL algorithms and their best practices…

Machine Learning · Computer Science 2025-11-06 Morgan Thomas , Albert Bou , Jose Carlos Gómez-Tamayo , Gary Tresadern , Mazen Ahmad , Gianni De Fabritiis

Large Language Models (LLMs) employ three popular training approaches: Masked Language Models (MLM), Causal Language Models (CLM), and Sequence-to-Sequence Models (seq2seq). However, each approach has its strengths and limitations, and…

Machine Learning · Computer Science 2025-02-18 Xuefeng Liu , Songhao Jiang , Bo Li , Rick Stevens

Recently, the impressive performance of large language models (LLMs) on a wide range of tasks has attracted an increasing number of attempts to apply LLMs in drug discovery. However, molecule optimization, a critical task in the drug…

Quantitative Methods · Quantitative Biology 2024-01-22 Geyan Ye , Xibao Cai , Houtim Lai , Xing Wang , Junhong Huang , Longyue Wang , Wei Liu , Xiangxiang Zeng

Large Language Models (LLMs) possess strong representation and reasoning capabilities, but their application to structure-based drug design (SBDD) is limited by insufficient understanding of protein structures and unpredictable molecular…

Machine Learning · Computer Science 2026-01-27 Xuanning Hu , Anchen Li , Qianli Xing , Jinglong Ji , Hao Tuo , Bo Yang

Test-time scaling (TTS) has become an effective approach for improving large language model performance by allocating additional computation during inference. However, existing TTS strategies are largely hand-crafted: researchers manually…

Computation and Language · Computer Science 2026-05-13 Tong Zheng , Haolin Liu , Chengsong Huang , Huiwen Bao , Sheng Zhang , Rui Liu , Runpeng Dai , Ruibo Chen , Chenxi Liu , Tianyi Xiong , Xidong Wu , Hongming Zhang , Heng Huang

Molecule discovery plays a crucial role in various scientific fields, advancing the design of tailored materials and drugs. However, most of the existing methods heavily rely on domain experts, require excessive computational cost, or…

Computation and Language · Computer Science 2024-05-10 Jiatong Li , Yunqing Liu , Wenqi Fan , Xiao-Yong Wei , Hui Liu , Jiliang Tang , Qing Li

Reinforcement learning (RL) over text representations can be effective for finding high-value policies that can search over graphs. However, RL requires careful structuring of the search space and algorithm design to be effective in this…

Machine Learning · Computer Science 2023-10-05 Raj Ghugare , Santiago Miret , Adriana Hugessen , Mariano Phielipp , Glen Berseth

Test-time scaling (TTS) -- the dynamic allocation of compute during inference -- is a promising direction for improving reasoning in large language models (LLMs). However, a systematic comparison of well-known TTS strategies under identical…

Computation and Language · Computer Science 2025-12-02 Aradhye Agarwal , Ayan Sengupta , Tanmoy Chakraborty

Recent advancements in reasoning-focused language models such as OpenAI's O1 and DeepSeek-R1 have shown that scaling test-time computation-through chain-of-thought reasoning and iterative exploration-can yield substantial improvements on…

Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for their vast knowledge…

Quantitative Methods · Quantitative Biology 2024-06-11 Junfeng Fang , Shuai Zhang , Chang Wu , Zhengyi Yang , Zhiyuan Liu , Sihang Li , Kun Wang , Wenjie Du , Xiang Wang

Large Language Models (LLMs) offer promising capabilities for tackling complex reasoning tasks, including optimization problems. However, existing methods either rely on prompt engineering, which leads to poor generalization across problem…

Machine Learning · Computer Science 2025-10-23 Dong Li , Xujiang Zhao , Linlin Yu , Yanchi Liu , Wei Cheng , Zhengzhang Chen , Zhong Chen , Feng Chen , Chen Zhao , Haifeng Chen

Lead optimization in drug discovery requires improving therapeutic properties while ensuring that molecular modifications correspond to feasible synthetic routes. Existing approaches either prioritize property scores without enforcing…

Machine Learning · Computer Science 2026-05-04 Tao Li , Kaiyuan Hou , Tuan Vinh , Monika Raj , Zhichun Guo , Carl Yang

As enthusiasm for scaling computation (data and parameters) in the pretraining era gradually diminished, test-time scaling (TTS), also referred to as ``test-time computing'' has emerged as a prominent research focus. Recent studies…

Computation and Language · Computer Science 2025-05-06 Qiyuan Zhang , Fuyuan Lyu , Zexu Sun , Lei Wang , Weixu Zhang , Wenyue Hua , Haolun Wu , Zhihan Guo , Yufei Wang , Niklas Muennighoff , Irwin King , Xue Liu , Chen Ma

Advances in large language models (LLMs) have recently opened new and promising avenues for small-molecule drug discovery. Yet existing LLM-based approaches for molecular generation often suffer from high rates of invalid and low-quality…

Machine Learning · Computer Science 2026-05-15 Andrew Y. Zhou , Sharvaree Vadgama , Sumanth Varambally , Peter Eckmann , Michael K. Gilson , Rose Yu

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

Artificial Intelligence · Computer Science 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, existing approaches mainly rely on imitation learning and struggle to achieve effective test-time scaling. While reinforcement…

Machine Learning · Computer Science 2025-06-16 Zhenyu Hou , Xin Lv , Rui Lu , Jiajie Zhang , Yujiang Li , Zijun Yao , Juanzi Li , Jie Tang , Yuxiao Dong
‹ Prev 1 2 3 10 Next ›