English
Related papers

Related papers: Critical Tokens Matter: Token-Level Contrastive Es…

200 papers

The most common training pipeline for large language models includes pretraining, finetuning and aligning phases, with their respective resulting models, such as the pretrained model and the finetuned model. Finetuned and aligned models…

Computation and Language · Computer Science 2024-02-29 Lifeng Jin , Baolin Peng , Linfeng Song , Haitao Mi , Ye Tian , Dong Yu

Large Language Models (LLMs) have reshaped natural language processing with their impressive capabilities. However, their ever-increasing size has raised concerns about their effective deployment and the need for LLM compression. This study…

Since the inception of Large Language Models (LLMs), the quest to efficiently train them for superior reasoning capabilities has been a pivotal challenge. The dominant training paradigm for LLMs is based on next token prediction (NTP).…

Computation and Language · Computer Science 2025-02-21 Pengxiao Lin , Zhongwang Zhang , Zhi-Qin John Xu

Large language models (LLMs) such as GPT-5 and Gemini 3 have pushed the frontier of automated reasoning and code generation. Yet current benchmarks emphasize accuracy and output quality, neglecting a critical dimension: efficiency of token…

Computation and Language · Computer Science 2026-02-25 Zheng Du , Hao Kang , Song Han , Tushar Krishna , Ligeng Zhu

Reasoning is critical for large language models (LLMs) to excel in a wide range of tasks. While methods like Chain-of-Thought (CoT) reasoning and enhance LLM performance by decomposing problems into intermediate steps, they also incur…

Computation and Language · Computer Science 2025-06-03 Tingxu Han , Zhenting Wang , Chunrong Fang , Shiyu Zhao , Shiqing Ma , Zhenyu Chen

While LLMs demonstrate impressive reasoning capabilities, they remain fragile in multi-step logical deduction, where a single transition error can propagate through the entire reasoning chain, leading to unstable performance. In this work,…

Computation and Language · Computer Science 2026-04-23 Seunghyun Park , Yuanyuan Lei

Large Language Models (LLMs) perform well on reasoning benchmarks but often fail when inputs alter slightly, raising concerns about the extent to which their success relies on memorization. This issue is especially acute in Chain-of-Thought…

Computation and Language · Computer Science 2025-08-22 Huihan Li , You Chen , Siyuan Wang , Yixin He , Ninareh Mehrabi , Rahul Gupta , Xiang Ren

Chain-of-thought prompting has emerged as a powerful technique for enabling large language models (LLMs) to solve complex reasoning tasks. However, these reasoning chains can be verbose, raising concerns about efficiency. In response,…

Computation and Language · Computer Science 2025-04-02 Ayeong Lee , Ethan Che , Tianyi Peng

Large language models (LLMs) have recently demonstrated remarkable success in mathematical reasoning. Despite progress in methods like chain-of-thought prompting and self-consistency sampling, these advances often focus on final correctness…

Estimating uncertainty in Large Language Models (LLMs) is important for properly evaluating LLMs, and ensuring safety for users. However, prior approaches to uncertainty estimation focus on the final answer in generated text, ignoring…

Computation and Language · Computer Science 2024-12-12 Eric Bigelow , Ari Holtzman , Hidenori Tanaka , Tomer Ullman

In this paper, we investigate the phenomena of "selection biases" in Large Language Models (LLMs), focusing on problems where models are tasked with choosing the optimal option from an ordered sequence. We delve into biases related to…

Computation and Language · Computer Science 2024-06-06 Sheng-Lun Wei , Cheng-Kuang Wu , Hen-Hsen Huang , Hsin-Hsi Chen

Large language models (LLMs) have achieved unprecedented success in the field of natural language processing. However, the black-box nature of their internal mechanisms has brought many concerns about their trustworthiness and…

Computation and Language · Computer Science 2024-09-24 Zhibo Zhang , Wuxia Bai , Yuxi Li , Mark Huasong Meng , Kailong Wang , Ling Shi , Li Li , Jun Wang , Haoyu Wang

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi

Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appropriate underlying mechanisms and risking confirmation bias. We introduce a simple,…

Computation and Language · Computer Science 2026-04-01 Zoë Prins , Samuele Punzo , Frank Wildenburg , Giovanni Cinà , Sandro Pezzelle

Large reasoning models (LRMs) have demonstrated impressive capabilities in complex problem-solving, yet their internal reasoning mechanisms remain poorly understood. In this paper, we investigate the reasoning trajectories of LRMs from an…

Artificial Intelligence · Computer Science 2025-06-05 Chen Qian , Dongrui Liu , Haochen Wen , Zhen Bai , Yong Liu , Jing Shao

Eliciting explicit, step-by-step reasoning traces from large language models (LLMs) has emerged as a dominant paradigm for enhancing model capabilities. Although such reasoning strategies were originally designed for problems requiring…

Computation and Language · Computer Science 2026-03-23 Xinyu Guo , Yazhou Zhang , Jing Qin

Relevance judgments are crucial for evaluating information retrieval systems, but traditional human-annotated labels are time-consuming and expensive. As a result, many researchers turn to automatic alternatives to accelerate method…

Information Retrieval · Computer Science 2025-07-15 Naghmeh Farzi , Laura Dietz

Direct Preference Optimization (DPO) has been widely adopted for preference alignment of Large Language Models (LLMs) due to its simplicity and effectiveness. However, DPO is derived as a bandit problem in which the whole response is…

Computation and Language · Computer Science 2025-04-16 Aiwei Liu , Haoping Bai , Zhiyun Lu , Yanchao Sun , Xiang Kong , Simon Wang , Jiulong Shan , Albin Madappally Jose , Xiaojiang Liu , Lijie Wen , Philip S. Yu , Meng Cao

Evaluating the abilities of large language models (LLMs) for tasks that require long-term memory and thus long-context reasoning, for example in conversational settings, is hampered by the existing benchmarks, which often lack narrative…

Computation and Language · Computer Science 2026-02-24 Mohammad Tavakoli , Alireza Salemi , Carrie Ye , Mohamed Abdalla , Hamed Zamani , J Ross Mitchell

Inference-time scaling via chain-of-thought (CoT) reasoning is a major driver of state-of-the-art LLM performance, but it comes with substantial latency and compute costs. We address a fundamental theoretical question: how many reasoning…

Artificial Intelligence · Computer Science 2026-05-29 Kiran Tomlinson , Tobias Schnabel , Adith Swaminathan , Jennifer Neville