English
Related papers

Related papers: Measuring and Mitigating Post-hoc Rationalization …

200 papers

Semi-structured explanation depicts the implicit process of a reasoner with an explicit representation. This explanation highlights how available information in a specific query is utilised and supplemented with information a reasoner…

Computation and Language · Computer Science 2024-01-25 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

While Chain-of-Thought (CoT) significantly enhances the performance of Large Language Models (LLMs), explicit reasoning chains introduce substantial computational redundancy. Recent latent reasoning methods attempt to mitigate this by…

Computation and Language · Computer Science 2026-02-02 Fanmeng Wang , Haotian Liu , Guojiang Zhao , Hongteng Xu , Zhifeng Gao

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Retrieval-Augmented Generation (RAG) systems are increasingly diverse, yet many suffer from monolithic designs that tightly couple core functions like query reformulation, retrieval, reasoning, and verification. This limits their…

Computation and Language · Computer Science 2025-06-03 Ruofan Wu , Youngwon Lee , Fan Shu , Danmei Xu , Seung-won Hwang , Zhewei Yao , Yuxiong He , Feng Yan

This paper primarily demonstrates a method to quantitatively assess the alignment between multi-step, structured reasoning in large language models and human preferences. We introduce the Alignment Score, a semantic-level metric that…

Artificial Intelligence · Computer Science 2026-04-22 Boxuan Wang , Zhuoyun Li , Xinmiao Huang , Xiaowei Huang , Yi Dong

The deployment of Large Reasoning Models (LRMs) in high-stakes decision-making pipelines has introduced a novel and opaque attack surface: reasoning backdoors. In these attacks, the model's intermediate Chain-of-Thought (CoT) is manipulated…

Cryptography and Security · Computer Science 2026-03-04 Zhen Guo , Shanghao Shi , Hao Li , Shamim Yazdani , Ning Zhang , Reza Tourani

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Reasoning models are evaluated on single-turn benchmarks but deployed in multi-turn dialogue, where users push back on correct answers. Under sustained adversarial pressure we find a previously undocumented failure mode: the…

Artificial Intelligence · Computer Science 2026-05-29 Yubo Li , Ramayya Krishnan , Rema Padman

Although chain-of-thought reasoning and reinforcement learning (RL) have driven breakthroughs in NLP, their integration into generative vision models remains underexplored. We introduce ReasonGen-R1, a two-stage framework that first imbues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yu Zhang , Yunqi Li , Yifan Yang , Rui Wang , Yuqing Yang , Dai Qi , Jianmin Bao , Dongdong Chen , Chong Luo , Lili Qiu

Most reward models for visual generation reduce rich human judgments to a single unexplained score, discarding the reasoning that underlies preference. We show that teaching reward models to produce explicit, multi-dimensional critiques…

Artificial Intelligence · Computer Science 2026-04-15 Haozhe Wang , Cong Wei , Weiming Ren , Jiaming Liu , Fangzhen Lin , Wenhu Chen

Sequential recommendation systems aim to capture users' evolving preferences from their interaction histories. Recent reasoningenhanced methods have shown promise by introducing deliberate, chain-of-thought-like processes with intermediate…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou

Recent research enhances language model reasoning by scaling test-time compute via longer chain-of-thought traces. This often improves accuracy but also introduces redundancy and high computational cost, especially for small language models…

Machine Learning · Computer Science 2025-05-26 Xuechen Zhang , Zijian Huang , Chenshun Ni , Ziyang Xiong , Jiasi Chen , Samet Oymak

Different types of reasoning impose different structural demands on representational systems, yet no systematic account of these demands exists across psychology, AI, and philosophy of mind. I propose a framework identifying four structural…

Artificial Intelligence · Computer Science 2026-04-03 Yiling Wu

Large Reasoning Models (LRMs) often suffer from overthinking, generating verbose reasoning traces that compromise both computational efficiency and interpretability. Unlike prior efforts that rely on global length-based rewards, we propose…

Artificial Intelligence · Computer Science 2026-01-07 Jialiang Hong , Taihang Zhen , Kai Chen , Jiaheng Liu , Junlan Feng , Wenpeng Zhu , Jing Huo , Yang Gao , Depeng Wang , Haitao Wan , Xi Yang , Boyan Wang , Fanyu Meng , Yuyao Zhang

Recent advances in reasoning-focused Large Language Models (LLMs) have introduced Chain-of-Thought (CoT) traces - intermediate reasoning steps generated before a final answer. These traces, as in DeepSeek R1, guide inference and train…

Computation and Language · Computer Science 2026-04-20 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Reinforcement learning from human feedback (RLHF) has become a powerful post-training paradigm for aligning large language models with human preferences. A core challenge in RLHF is constructing accurate reward signals, where the…

Machine Learning · Computer Science 2025-05-23 Ilgee Hong , Changlong Yu , Liang Qiu , Weixiang Yan , Zhenghao Xu , Haoming Jiang , Qingru Zhang , Qin Lu , Xin Liu , Chao Zhang , Tuo Zhao

Specialized reasoning language models (RLMs) have demonstrated that scaling test-time computation through detailed reasoning traces significantly enhances performance. Although these traces effectively facilitate knowledge distillation into…

Computation and Language · Computer Science 2025-07-16 Philip Lippmann , Jie Yang

Subjective evaluation of LLM behavior -- empathy, restraint, calibrated emotional tone -- is hard. Human inter-rater agreement on such qualities saturates near rho ~ 0.45, and an LLM-as-judge proxy alone risks circularity: a judge sharing…

Computation and Language · Computer Science 2026-05-28 Yuming , Huang , Yao Liu , Lei Wang , Junchen Wan

Chain-of-Thought (CoT) prompting enables complex reasoning in large language models (LLMs), including applications in information retrieval (IR). However, it often leads to overthinking, where models produce excessively long and…

Information Retrieval · Computer Science 2025-05-30 Dohyeon Lee , Yeonseok Jeong , Seung-won Hwang

Referring Expression Comprehension (REC) is one of the most important tasks in visual reasoning that requires a model to detect the target object referred by a natural language expression. Among the proposed pipelines, the one-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Zhipeng Zhang , Zhimin Wei , Zhongzhen Huang , Rui Niu , Peng Wang