English
Related papers

Related papers: Test-Time Compute Games

200 papers

Test-time scaling (TTS) has recently emerged as a promising direction to exploit the hidden reasoning capabilities of pre-trained large language models (LLMs). However, existing scaling methods narrowly focus on the compute-optimal…

Performance · Computer Science 2025-09-25 Youpeng Zhao , Jinpeng LV , Di Wu , Jun Wang , Christopher Gooley

Today's large language models (LLMs) are trained to align with user preferences through methods such as reinforcement learning. Yet models are beginning to be deployed not merely to satisfy users, but also to generate revenue for the…

Artificial Intelligence · Computer Science 2026-04-10 Addison J. Wu , Ryan Liu , Shuyue Stella Li , Yulia Tsvetkov , Thomas L. Griffiths

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, measuring, and scaling test-time compute suggest new…

Machine Learning · Computer Science 2025-06-26 Mahdi Sabbaghi , Paul Kassianik , George Pappas , Yaron Singer , Amin Karbasi , Hamed Hassani

Efficient and fair spectrum allocation is a central challenge in 6G networks, where massive connectivity and heterogeneous services continuously compete for limited radio resources. We investigate the use of Large Language Models (LLMs) as…

Computer Science and Game Theory · Computer Science 2026-04-28 Ismail Lotfi , Ali Ghrayeb

High-demand LLM inference services (e.g., ChatGPT and BARD) support a wide range of requests from short chat conversations to long document reading. To ensure that all client requests are processed fairly, most major LLM inference services…

Artificial Intelligence · Computer Science 2024-06-06 Ying Sheng , Shiyi Cao , Dacheng Li , Banghua Zhu , Zhuohan Li , Danyang Zhuo , Joseph E. Gonzalez , Ion Stoica

Large Language Models (LLMs) with reasoning capabilities have achieved state-of-the-art performance on a wide range of tasks. Despite its empirical success, the tasks and model scales at which reasoning becomes effective, as well as its…

Computation and Language · Computer Science 2025-09-29 Nicolas Boizard , Hippolyte Gisserot-Boukhlef , Kevin El-Haddad , Céline Hudelot , Pierre Colombo

Recent advances in large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated the effectiveness of test-time scaling, where extended reasoning processes substantially enhance model performance. Despite this, current…

Computation and Language · Computer Science 2025-03-26 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yunjie Ji , Yiping Peng , Han Zhao , Xiangang Li

We examine the reasoning and planning capabilities of large language models (LLMs) in solving complex tasks. Recent advances in inference-time techniques demonstrate the potential to enhance LLM reasoning without additional training by…

Artificial Intelligence · Computer Science 2025-02-19 Shubham Parashar , Blake Olson , Sambhav Khurana , Eric Li , Hongyi Ling , James Caverlee , Shuiwang Ji

Test-time scaling (TTS) has been shown to improve the performance of large language models (LLMs) by sampling and aggregating diverse reasoning paths. However, existing research has overlooked a critical issue: selection bias of reasoning…

Artificial Intelligence · Computer Science 2025-09-24 Zongqian Wu , Baoduo Xu , Tianyu Li , Zhu Sun , Xiaofeng Zhu , Lei Feng

As the use of Large Language Models (LLMs) by students, lecturers and researchers becomes more prevalent, universities - like other organizations - are pressed to develop coherent AI strategies. LLMs as-a-Service (LLMaaS) offer accessible…

Computers and Society · Computer Science 2025-05-16 Leon Hannig , Annika Bush , Meltem Aksoy , Steffen Becker , Greta Ontrup

Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation. In this paper, we reveal a novel provider bias in LLMs: without…

Software Engineering · Computer Science 2025-10-24 Xiaoyu Zhang , Juan Zhai , Shiqing Ma , Qingshuang Bao , Weipeng Jiang , Qian Wang , Chao Shen , Yang Liu

Unlike Business-to-Consumer e-commerce platforms (e.g., Amazon), inexperienced individual sellers on Consumer-to-Consumer platforms (e.g., eBay) often face significant challenges in setting prices for their second-hand products efficiently.…

Computation and Language · Computer Science 2025-10-13 Hairu Wang , Sheng You , Qiheng Zhang , Xike Xie , Shuguang Han , Yuchen Wu , Fei Huang , Jufeng Chen

Compared to classical machine learning (ML) models, generative models offer a new usage paradigm where (i) a single model can be used for many different tasks out-of-the-box; (ii) users interact with this model over a series of natural…

Computer Science and Game Theory · Computer Science 2024-11-06 Rafid Mahmood

Economic experiments offer a controlled setting for researchers to observe human decision-making and test diverse theories and hypotheses; however, substantial costs and efforts are incurred to gather many individuals as experimental…

Computer Science and Game Theory · Computer Science 2025-09-22 Ayato Kitadai , Sinndy Dayana Rico Lugo , Yudai Tsurusaki , Yusuke Fukasawa , Nariaki Nishino

In the field of computational advertising, the integration of ads into the outputs of large language models (LLMs) presents an opportunity to support these services without compromising content integrity. This paper introduces novel auction…

Computer Science and Game Theory · Computer Science 2025-06-16 MohammadTaghi Hajiaghayi , Sébastien Lahaie , Keivan Rezaei , Suho Shin

Large reasoning models (LRMs) have exhibited the capacity of enhancing reasoning performance via internal test-time scaling. Building upon this, a promising direction is to further scale test-time compute to unlock even greater reasoning…

Artificial Intelligence · Computer Science 2025-06-10 Jian Wang , Boyan Zhu , Chak Tou Leong , Yongqi Li , Wenjie Li

In the rapidly evolving landscape of eCommerce, Artificial Intelligence (AI) based pricing algorithms, particularly those utilizing Reinforcement Learning (RL), are becoming increasingly prevalent. This rise has led to an inextricable…

Machine Learning · Computer Science 2024-06-06 Michael Schlechtinger , Damaris Kosack , Franz Krause , Heiko Paulheim

LLM-as-a-Judge refers to the automatic modeling of preferences for responses generated by Large Language Models (LLMs), which is of significant importance for both LLM evaluation and reward modeling. Although generative LLMs have made…

Computation and Language · Computer Science 2026-01-13 Hui Huang , Yancheng He , Hongli Zhou , Rui Zhang , Wei Liu , Weixun Wang , Jiaheng Liu , Wenbo Su

Standardized math assessments require expensive human pilot studies to establish the difficulty of test items. We investigate the predictive value of open-source large language models (LLMs) for evaluating the difficulty of multiple-choice…

Computation and Language · Computer Science 2026-04-22 Christabel Acquaye , Yi Ting Huang , Marine Carpuat , Rachel Rudinger

Recent deployments of large language models (LLMs) as autonomous trading agents raise questions about whether financial decision-making competence generalizes beyond specific market patterns and how it should be trained and evaluated in…

Machine Learning · Computer Science 2026-04-21 Yuchen Pan , Soung Chang Liew