English
Related papers

Related papers: Inference-Time Rethinking with Latent Thought Vect…

200 papers

Inference-time scaling through multiple sample generation in combination with Process- or Outcome-Reward Model (PRM or ORM) re-ranking has proven effective for text-based reasoning in large language models. This paper investigates whether…

Computation and Language · Computer Science 2025-10-20 Minghan Wang , Thuy-Trang Vu , Ehsan Shareghi , Gholamreza Haffari

Many of the recent capabilities demonstrated by Large Language Models (LLMs) arise primarily from their ability to exploit contextual information. In this paper, we explore ways to improve reasoning capabilities of LLMs through (1)…

Test-time scaling has emerged as an effective approach for improving language model performance by utilizing additional compute at inference time. Recent studies have shown that overriding end-of-thinking tokens (e.g., replacing "</think>"…

Computation and Language · Computer Science 2026-05-14 Liran Ringel , Elad Tolochinsky , Yaniv Romano

Recent studies on transformer-based language models show that they can answer questions by reasoning over knowledge provided as part of the context (i.e., in-context reasoning). However, since the available knowledge is often not filtered…

Computation and Language · Computer Science 2023-11-07 Zeming Chen , Gail Weiss , Eric Mitchell , Asli Celikyilmaz , Antoine Bosselut

Large language models (LLMs) have been routinely used to solve various tasks using step-by-step reasoning. However, the structure of intermediate reasoning steps, or thoughts, is rigid and unidirectional, such as chains, trees, or…

Artificial Intelligence · Computer Science 2024-12-30 Sijia Chen , Baochun Li

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Many large language models (LLMs) use reasoning to generate responses but do not reveal their full reasoning traces (a.k.a. chains of thought), instead outputting only final answers and brief reasoning summaries. To demonstrate that hiding…

Cryptography and Security · Computer Science 2026-05-14 Tingwei Zhang , John X. Morris , Vitaly Shmatikov

Assessing the quality of outputs generated by generative models, such as large language models and vision language models, presents notable challenges. Traditional methods for evaluation typically rely on either human assessments, which are…

Computation and Language · Computer Science 2024-10-10 Yaswanth Narsupalli , Abhranil Chandra , Sreevatsa Muppirala , Manish Gupta , Pawan Goyal

Recent advances in large language models (LLMs) have leveraged explicit Chain-of-Thought (CoT) prompting to improve reasoning accuracy. However, most existing methods primarily focus on compressing verbose reasoning outputs. These…

Computation and Language · Computer Science 2025-12-01 Canhui Wu , Qiong Cao , Chao Xue , Wei Xi , Xiaodong He

We present a novel approach for controllable mathematical reasoning that leverages self-optimizing thought vectors with entropy minimization. Our method introduces learnable thought vectors that dynamically modulate the internal reasoning…

Artificial Intelligence · Computer Science 2025-10-28 Xuying LI

Large language models (LLMs) empowered by chain-of-thought reasoning have achieved impressive accuracy on complex tasks but suffer from excessive inference costs and latency when applied uniformly to all problems. We propose SABER…

Computation and Language · Computer Science 2025-08-15 Kai Zhao , Yanjun Zhao , Jiaming Song , Shien He , Lusheng Zhang , Qiang Zhang , Tianjiao Li

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Test-time scaling has enabled Large Language Models (LLMs) to tackle complex reasoning, yet the limitations of current Chain-of-Thought (CoT) evaluation obscures whether performance gains stem from genuine reasoning or mere verbosity. To…

Artificial Intelligence · Computer Science 2026-01-08 Zhizhang Fu , Yuancheng Gu , Chenkai Hu , Hanmeng Liu , Yue Zhang

Expert-level scientific reasoning remains challenging for large language models, particularly on benchmarks such as Humanity's Last Exam (HLE), where rigid tool pipelines, brittle multi-agent coordination, and inefficient test-time scaling…

Artificial Intelligence · Computer Science 2026-02-05 Zhentao Tang , Yuqi Cui , Shixiong Kai , Wenqian Zhao , Ke Ye , Xing Li , Anxin Tian , Zehua Pei , Hui-Ling Zhen , Shoubo Hu , Xiaoguang Li , Yunhe Wang , Mingxuan Yuan

Document reranking is a key component in information retrieval (IR), aimed at refining initial retrieval results to improve ranking quality for downstream tasks. Recent studies--motivated by large reasoning models (LRMs)--have begun…

Information Retrieval · Computer Science 2025-10-13 Xuan Lu , Haohang Huang , Rui Meng , Yaohui Jin , Wenjun Zeng , Xiaoyu Shen

Reasoning large language models (LLMs) have demonstrated superior capacities in solving complicated problems by generating long chain-of-thoughts (CoT), but such a lengthy CoT incurs high inference costs. Previous methods on inference-stage…

Computation and Language · Computer Science 2026-05-19 Minjia Mao , Bowen Yin , Yu Zhu , Xiao Fang

Self-correction in language models remains elusive. In this work, we explore whether language models can explicitly localize errors in incorrect reasoning, as a path toward building AI systems that can effectively correct themselves. We…

Latent reasoning has been recently proposed as a reasoning paradigm and performs multi-step reasoning through generating steps in the latent space instead of the textual space. This paradigm enables reasoning beyond discrete language tokens…

Artificial Intelligence · Computer Science 2026-02-27 Yingqian Cui , Zhenwei Dai , Bing He , Zhan Shi , Hui Liu , Rui Sun , Zhiji Liu , Yue Xing , Jiliang Tang , Benoit Dumoulin

Reasoning models have demonstrated remarkable progress in solving complex and logic-intensive tasks by generating extended Chain-of-Thoughts (CoTs) prior to arriving at a final answer. Yet, the emergence of this "slow-thinking" paradigm,…

Computation and Language · Computer Science 2025-09-30 Sicheng Feng , Gongfan Fang , Xinyin Ma , Xinchao Wang

Language models generate responses by producing a series of tokens in immediate succession: the $(K+1)^{th}$ token is an outcome of manipulating $K$ hidden vectors per layer, one vector per preceding token. What if instead we were to let…

Computation and Language · Computer Science 2024-04-23 Sachin Goyal , Ziwei Ji , Ankit Singh Rawat , Aditya Krishna Menon , Sanjiv Kumar , Vaishnavh Nagarajan