English
Related papers

Related papers: KAM-CoT: Knowledge Augmented Multimodal Chain-of-T…

200 papers

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang

Vision Language Models (VLMs) have achieved remarkable success in a wide range of vision applications of increasing complexity and scales, yet choosing the right VLM model size involves a trade-off between response quality and cost. While…

Large vision-language models (LVLMs) have demonstrated remarkable capabilities by integrating pre-trained vision encoders with large language models (LLMs). Similar to single-modal LLMs, chain-of-thought (CoT) prompting has been adapted for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation and understanding, yet their reliance on implicit, unstructured knowledge often leads to factual inaccuracies and limited interpretability. Knowledge…

Computation and Language · Computer Science 2025-06-17 Qinggang Zhang

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Compressing long chains of thought (CoT) into compact latent tokens is crucial for efficient reasoning with large language models (LLMs). Recent studies employ autoencoders to achieve this by reconstructing textual CoT from latent tokens,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xiaoshu Chen , Sihang Zhou , Ke Liang , Taichun Zhou , Xinwang Liu

Chain-of-thought (CoT), tree-of-thought (ToT), and related techniques work surprisingly well in practice for some complex reasoning tasks with Large Language Models (LLMs), but why? This work seeks the underlying reasons by conducting…

Artificial Intelligence · Computer Science 2024-06-19 Liwei Kang , Zirui Zhao , David Hsu , Wee Sun Lee

Chain of thought (CoT) fine-tuning aims to endow large language models (LLMs) with reasoning capabilities by training them on curated reasoning traces. It leverages both supervised and reinforced fine-tuning to cultivate human-like…

Computation and Language · Computer Science 2026-03-24 Xiaoshu Chen , Sihang Zhou , Ke Liang , Duanyang Yuan , Haoyuan Chen , Xiaoyu Sun , Lingyuan Meng , Xinwang Liu

Large Language Models (LLMs) are typically trained to reflect a relatively uniform set of values, which limits their applicability to tasks that require understanding of nuanced human perspectives. Recent research has underscored the…

Computation and Language · Computer Science 2025-10-07 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

Machine Learning · Computer Science 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

Computation and Language · Computer Science 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

We present chain-of-knowledge (CoK), a novel framework that augments large language models (LLMs) by dynamically incorporating grounding information from heterogeneous sources. It results in more factual rationales and reduced hallucination…

Computation and Language · Computer Science 2024-02-22 Xingxuan Li , Ruochen Zhao , Yew Ken Chia , Bosheng Ding , Shafiq Joty , Soujanya Poria , Lidong Bing

Large Language Models (LLMs) demonstrate strong performance on mathematical problems when prompted with Chain-of-Thought (CoT), yet it remains unclear whether this success stems from search, rote procedures, or rule-consistent reasoning. To…

Artificial Intelligence · Computer Science 2026-03-03 Yuanhe Zhang , Ilja Kuzborskij , Jason D. Lee , Chenlei Leng , Fanghui Liu

Large Language Models (LLMs), such as \texttt{ChatGPT}, greatly empower dialogue systems with strong language understanding and generation capabilities. However, most of the previous works prompt the LLMs to directly generate a response…

Computation and Language · Computer Science 2023-10-17 Hongru Wang , Rui Wang , Fei Mi , Yang Deng , Zezhong Wang , Bin Liang , Ruifeng Xu , Kam-Fai Wong

Large language models (LLMs) have shown impressive capabilities in handling complex tasks through long-chain reasoning. However, the extensive reasoning steps involved can significantly increase computational costs, posing challenges for…

Computation and Language · Computer Science 2025-05-28 Yunhao Wang , Yuhao Zhang , Tinghao Yu , Can Xu , Feng Zhang , Fengzong Lian

In this paper, we investigate whether Large Language Models (LLMs) actively recall or retrieve their internal repositories of factual knowledge when faced with reasoning tasks. Through an analysis of LLMs' internal factual recall at each…

Computation and Language · Computer Science 2024-10-02 Yifei Wang , Yuheng Chen , Wanting Wen , Yu Sheng , Linjing Li , Daniel Dajun Zeng

Implicit Chain-of-Thought (CoT) methods offer a token-efficient alternative to explicit CoT reasoning in Large Language Models (LLMs), but a persistent performance gap has limited their adoption. We identify a core latent instability issue…

Computation and Language · Computer Science 2025-09-26 Xilin Wei , Xiaoran Liu , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Jiaqi Wang , Xipeng Qiu , Dahua Lin

Large language models (LLMs) excel in many tasks but struggle to accurately quantify uncertainty in their generated responses. This limitation makes it challenging to detect misinformation and ensure reliable decision-making. Existing…

Computation and Language · Computer Science 2025-06-04 Boxuan Zhang , Ruqi Zhang

This position paper argues that large language model (LLM) reasoning should be studied as latent-state trajectory formation rather than as faithful surface chain-of-thought (CoT). This matters because claims about faithfulness,…

Artificial Intelligence · Computer Science 2026-04-20 Wenshuo Wang

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang