English
Related papers

Related papers: Budget-aware Test-time Scaling via Discriminative …

200 papers

For large software applications, running the whole test suite after each code change is time- and resource-intensive. Regression test selection techniques aim at reducing test execution time by selecting only the tests that are affected by…

Software Engineering · Computer Science 2025-04-29 Sijia Gu , Ali Mesbah

Most active learning research has focused on methods which perform well when many labels are available, but can be dramatically worse than random selection when label budgets are small. Other methods have focused on the low-budget regime,…

Machine Learning · Computer Science 2025-02-28 Wonho Bae , Gabriel L. Oliveira , Danica J. Sutherland

Test-time compute methods can significantly improve the reasoning capabilities and problem-solving accuracy of large language models (LLMs). However, these approaches require substantially more computational resources, with most compute…

Computation and Language · Computer Science 2026-01-28 Xianzhi Li , Ethan Callanan , Abdellah Ghassel , Xiaodan Zhu

Incremental learning is useful if an AI agent needs to integrate data from a stream. The problem is non trivial if the agent runs on a limited computational budget and has a bounded memory of past data. In a deep learning approach, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Eden Belouadah , Adrian Popescu

Reinforcement learning improves the reasoning ability of large language models but remains costly and sample-inefficient, as many rollouts provide weak learning signals. Difficulty-aware data selection methods attempt to address this by…

Machine Learning · Computer Science 2026-05-12 Yang Zhou , Can Jin , Zihan Dong , Zhepeng Wang , Yanting Yang , Shiyu Zhao , Lei Li , Runxue Bao , Yaochen Xie , Dimitris N. Metaxas

Recent advancements in large language models (LLMs) have shifted focus toward scaling inference-time compute, improving performance without retraining the model. A common approach is to sample multiple outputs in parallel, and select one of…

Computation and Language · Computer Science 2025-06-26 Ammar Khairi , Daniel D'souza , Ye Shen , Julia Kreutzer , Sara Hooker

Frontier AI models have achieved remarkable progress, yet recent studies suggest they struggle with compositional reasoning, often performing at or below random chance on established benchmarks. We revisit this problem and show that widely…

Artificial Intelligence · Computer Science 2026-04-27 Yinglun Zhu , Jiancheng Zhang , Fuzhi Tang

Inference-time computation is a powerful paradigm to enhance the performance of large language models (LLMs), with Best-of-N sampling being a widely used technique. However, this method is computationally expensive, requiring both (1) an…

Computation and Language · Computer Science 2024-10-04 Rohin Manvi , Anikait Singh , Stefano Ermon

As large language models (LLMs) evolve into autonomous agents that execute long-horizon workflows, invoking a high-capability model at every step becomes economically unsustainable. While model routing is effective for single-turn queries,…

Computation and Language · Computer Science 2026-02-26 Caiqi Zhang , Menglin Xia , Xuchao Zhang , Daniel Madrigal , Ankur Mallick , Samuel Kessler , Victor Ruehle , Saravan Rajmohan

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning ability of Large Language Models (LLMs) by allocating additional computation at inference, yet its application to multimodal systems such as…

We present a governance-aware hybrid fine-tuning framework for multilingual, low-resource adaptation of large language models. The core algorithm combines gradient-aligned low-rank updates with structured orthogonal transformations through…

Computation and Language · Computer Science 2025-12-22 Haomin Qi , Chengbo Huang , Zihan Dai , Yunkai Gao

We study the reasoning behavior of large language models (LLMs) under limited computation budgets. In such settings, producing useful partial solutions quickly is often more practical than exhaustive reasoning, which incurs high inference…

Computation and Language · Computer Science 2026-04-21 Xuanming Zhang , Shwan Ashrafi , Aziza Mirsaidova , Amir H. Rezaeian , Miguel Ballesteros , Lydia B. Chilton , Zhou Yu , Dan Roth

Recent advances in block diffusion language models have demonstrated competitive performance and strong scalability on reasoning tasks. However, existing BDLMs have limited exploration under the test-time scaling setting and face more…

Computation and Language · Computer Science 2026-02-12 Yi Lu , Deyang Kong , Jianing Wang , Linsen Guo , Xue Wang , Qi Guo , Tao Gui , Xuanjing Huang , Wei Ye , Shikun Zhang , Wei Wang

This research introduces a new strategy in cluster ensemble selection by using Independency and Diversity metrics. In recent years, Diversity and Quality, which are two metrics in evaluation procedure, have been used for selecting basic…

Machine Learning · Statistics 2016-10-11 Muhammad Yousefnezhad , Ali Reihanian , Daoqiang Zhang , Behrouz Minaei-Bidgoli

Imbalanced classification remains a pervasive challenge in machine learning, particularly when minority samples are too scarce to provide a robust discriminative boundary. In such extreme scenarios, conventional models often suffer from…

Machine Learning · Computer Science 2026-04-29 Hongfei Wu , Ruijian Han , Yancheng Yuan

While inference-time scaling through search has revolutionized Large Language Models, translating these gains to image generation has proven difficult. Recent attempts to apply search strategies to continuous diffusion models show limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Erik Riise , Mehmet Onurcan Kaya , Dim P. Papadopoulos

Large Language Models have achieved impressive performance on reasoning-intensive tasks, yet optimizing their reasoning efficiency remains an open challenge. While Test-Time Scaling (TTS) improves reasoning quality, it often leads to…

Computation and Language · Computer Science 2026-05-26 Hang Yan , Fangzhi Xu , Rongman Xu , Yifei Li , Jian Zhang , Haoran Luo , Xiaobao Wu , Luu Anh Tuan , Haiteng Zhao , Qika Lin , Jun Liu

Large Language Models (LLMs) achieve strong performance on standard knowledge evaluation benchmarks, yet recent work shows that their knowledge capabilities remain brittle under question variants that test the same knowledge in different…

Computation and Language · Computer Science 2026-05-13 Xiaoyuan Li , Yuzhe Wang , Moxin Li , Keqin Bao , Rui Men , Yichang Zhang , Dayiheng Liu , Wenjie Wang , Fuli Feng

Large language models (LLMs) now exhibit strong multi-step reasoning abilities, but existing inference-time scaling methods remain computationally expensive, often relying on extensive sampling or external evaluators. We propose a…

Artificial Intelligence · Computer Science 2026-03-10 Nicolas Legrand , Kenneth Enevoldsen , Márton Kardos , Kristoffer Nielbo

Screening tasks that aim to identify a small subset of top alternatives from a large pool are common in business decision-making processes. These tasks often require substantial human effort to evaluate each alternative's performance,…

Machine Learning · Statistics 2025-04-28 Zaile Li , Weiwei Fan , L. Jeff Hong