English
Related papers

Related papers: Reliability-Aware Adaptive Self-Consistency for Ef…

200 papers

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Outcome-reward reinforcement learning (RL) is a common and increasingly significant way to refine the step-by-step reasoning of multimodal large language models (MLLMs). In the multiple-choice setting - a dominant format for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiahao Wang , Weiye Xu , Aijun Yang , Wengang Zhou , Lewei Lu , Houqiang Li , Xiaohua Wang , Jinguo Zhu

Large Language Models~(LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary,…

Retrieval Augmented Generation (RAG) improves correctness of Question Answering (QA) and addresses hallucinations in Large Language Models (LLMs), yet greatly increase computational costs. Besides, RAG is not always needed as may introduce…

Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge but incurs significant inference costs due to lengthy retrieved contexts. While context compression mitigates this issue, existing methods…

Computation and Language · Computer Science 2025-09-25 Shuyu Guo , Shuo Zhang , Zhaochun Ren

Retrieval-augmented generation (RAG) improves large language models (LLMs) by incorporating external evidence, but it also introduces knowledge conflicts when retrieved contextual knowledge (CK) and parametric knowledge (PK) disagree or are…

Information Retrieval · Computer Science 2026-05-20 Xi Zhu , Ziqi Wang , Kai Mei , Wujiang Xu , Minghao Guo , Bangji Yang , Jiajun Fan , Dimitris N. Metaxas

Recent advances in large language models (LLMs) have predominantly focused on maximizing accuracy and reasoning capabilities, often overlooking crucial computational efficiency considerations. While this approach has yielded impressive…

Machine Learning · Computer Science 2024-12-24 Marwan AbdElhameed , Pavly Halim

Recent advancements in large language models (LLMs) integrating explicit reasoning, such as OpenAI's o3-mini, DeepSeek-R1, and QWQ-32B, enable smaller models to solve complex tasks by generating intermediate reasoning steps prior to…

Machine Learning · Computer Science 2025-03-25 Jaeyeon Lee , Guantong Qi , Matthew Brady Neeley , Zhandong Liu , Hyun-Hwan Jeong

Large Reasoning Language Models (LRLMs or LRMs) demonstrate remarkable capabilities in complex reasoning tasks, but suffer from significant computational inefficiencies due to overthinking phenomena. Existing efficient reasoning methods…

Artificial Intelligence · Computer Science 2025-10-13 Dongqi Zheng

Test-time scaling seeks to improve the reasoning performance of large language models (LLMs) by adding computational resources. A prevalent approach within the field is sampling-based test-time scaling methods, which enhance reasoning by…

Machine Learning · Computer Science 2025-10-20 Zhi Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Lan-Zhe Guo , Yu-Feng Li , Xiaoxing Ma

To enhance the reasoning capabilities of large language models (LLMs), self-consistency has become a popular approach, combining multiple samplings with majority voting. However, current methods are computationally expensive and…

Computation and Language · Computer Science 2025-11-05 Jiace Zhu , Yuanzhe Huang , Yingtao Shen , Jie Zhao , An Zou

Self-consistency (SC) is a popular technique for improving the reasoning accuracy of large language models by aggregating multiple sampled outputs, but it comes at a high computational cost due to extensive sampling. We introduce a hybrid…

Computation and Language · Computer Science 2026-04-21 Raman Saparkhan , Majd Hawasly , Md Rizwan Parvez , Mohammad Raza

Self-consistency improves reasoning by aggregating diverse stochastic samples, yet the dynamics behind its efficacy remain underexplored. We reframe self-consistency as a dynamic distributional alignment problem, revealing that decoding…

Computation and Language · Computer Science 2025-06-12 Yiwei Li , Ji Zhang , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Jiayi Shi , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Existing research on Retrieval-Augmented Generation (RAG) primarily focuses on improving overall question-answering accuracy, often overlooking the quality of sub-claims within generated responses. Recent methods that attempt to improve RAG…

Information Retrieval · Computer Science 2025-06-27 Naihe Feng , Yi Sui , Shiyi Hou , Jesse C. Cresswell , Ga Wu

Self-consistency with chain-of-thought prompting (CoT) has demonstrated remarkable performance gains on various challenging tasks, by utilizing multiple reasoning paths sampled from large language models (LLMs). However, self-consistency…

Computation and Language · Computer Science 2023-11-30 Xinyun Chen , Renat Aksitov , Uri Alon , Jie Ren , Kefan Xiao , Pengcheng Yin , Sushant Prakash , Charles Sutton , Xuezhi Wang , Denny Zhou

Self-consistency (SC) has been a widely used decoding strategy for chain-of-thought reasoning. Despite bringing significant performance improvements across a variety of multi-step reasoning tasks, it is a high-cost method that requires…

Computation and Language · Computer Science 2024-01-22 Yiwei Li , Peiwen Yuan , Shaoxiong Feng , Boyuan Pan , Xinglin Wang , Bin Sun , Heda Wang , Kan Li

Large language models (LLMs) demonstrate exceptional performance in numerous tasks but still heavily rely on knowledge stored in their parameters. Moreover, updating this knowledge incurs high training costs. Retrieval-augmented generation…

Computation and Language · Computer Science 2024-06-07 Yanming Liu , Xinyue Peng , Xuhong Zhang , Weihao Liu , Jianwei Yin , Jiannan Cao , Tianyu Du

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

Computation and Language · Computer Science 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time…

Computation and Language · Computer Science 2026-03-24 Vinay Sharma , Manish Jain

The newly released OpenAI-o1 and DeepSeek-R1 have demonstrated that test-time scaling can significantly improve model performance, especially in complex tasks such as logical reasoning. Common test-time scaling methods involve generating…

Computation and Language · Computer Science 2025-10-01 Zhendong Tan , Xingjun Zhang , Chaoyi Hu , Yancheng Pan , Shaoxun Wang