English
Related papers

Related papers: The First Impression Problem: Internal Bias Trigge…

200 papers

Cognitive biases are systematic deviations in thinking that lead to irrational judgments and problematic decision-making, extensively studied across various fields. Recently, large language models (LLMs) have shown advanced understanding…

Computation and Language · Computer Science 2024-10-10 Nuo Chen , Jiqun Liu , Xiaoyu Dong , Qijiong Liu , Tetsuya Sakai , Xiao-Ming Wu

The long chain-of-thought (LongCoT) capability is central to the recent breakthroughs achieved by large language models in complex reasoning tasks. However, the accompanying issue of ''underthinking'', where models exhibit shallow reasoning…

Computation and Language · Computer Science 2025-10-23 Xichen Zhang , Sitong Wu , Haoru Tan , Shaozuo Yu , Yinghao Zhu , Ziyi He , Jiaya Jia

Hierarchical reasoning model (HRM) achieves extraordinary performance on various reasoning tasks, significantly outperforming large language model-based reasoners. To understand the strengths and potential failure modes of HRM, we conduct a…

Artificial Intelligence · Computer Science 2026-03-24 Zirui Ren , Ziming Liu

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks, aided by techniques like chain-of-thought prompting that elicits verbalized reasoning. However, LLMs often generate text with obvious…

Artificial Intelligence · Computer Science 2024-12-06 Zhihui Xie , Jizhou Guo , Tong Yu , Shuai Li

While existing evaluations of large language models (LLMs) measure deception rates, the underlying conditions that give rise to deceptive behavior are poorly understood. We investigate this question using a novel dataset of realistic moral…

With resurgent interest in individual differences in perception, cognition and behavioural control, as early indicators of disease, endophenotypes, or a means to relate brain structure to function, behavioural tasks are increasingly being…

Neurons and Cognition · Quantitative Biology 2013-09-16 Frederic Boy , Petroc Sumner

Vision Language Models (VLMs) are increasingly deployed across downstream tasks, yet their training data often encode social biases that surface in outputs. Unlike humans, who interpret images through contextual and social cues, VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Adit Desai , Sudipta Roy , Mohna Chakraborty

Large reasoning models (LRMs) have demonstrated impressive performance across a range of reasoning tasks, yet little is known about their internal reasoning processes in multilingual settings. We begin with a critical question: {\it In…

Computation and Language · Computer Science 2025-05-26 Zhi Rui Tam , Cheng-Kuang Wu , Yu Ying Chiu , Chieh-Yen Lin , Yun-Nung Chen , Hung-yi Lee

Large Language Models exhibit sycophancy: prioritizing agreeableness over correctness. Current remedies evaluate reasoning outcomes: RLHF rewards correct answers, self-correction critiques outputs. All require ground truth, which is often…

Computation and Language · Computer Science 2026-01-09 Edward Y. Chang

Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intelligent conversational agents. Researchers typically evaluate…

Computation and Language · Computer Science 2020-02-27 Sashank Santhanam , Alireza Karduni , Samira Shaikh

There is a clear desire to model and comprehend human behavior. Trends in research covering this topic show a clear assumption that many view human reasoning as the presupposed standard in artificial reasoning. As such, topics such as game…

Artificial Intelligence · Computer Science 2022-05-16 Andrew Fuchs , Andrea Passarella , Marco Conti

Large Reasoning Models (LRMs) achieve explicit chain-of-thought expansion by imitating deep thinking behaviors of humans, demonstrating excellent performance in complex task scenarios. However, the deep-thinking mode often leads to…

Machine Learning · Computer Science 2026-01-30 Qian Wan , Ziao Xu , Luona Wei , Xiaoxuan Shen , Jianwen Sun

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Reasoning is a key component of language understanding in Large Language Models. While Chain-of-Thought prompting enhances performance via explicit intermediate steps, it suffers from sufficient token overhead and a fixed reasoning…

Computation and Language · Computer Science 2025-11-18 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Haoyue Bai , Nanxu Gong , Sixun Dong , Kunpeng Liu , Yanjie Fu

Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we…

Computation and Language · Computer Science 2022-11-28 Erik Jones , Jacob Steinhardt

The internal model principle, originally proposed in the theory of control of linear systems, nowadays represents a more general class of results in control theory and cybernetics. The central claim of these results is that, under suitable…

Optimization and Control · Mathematics 2025-04-22 Manuel Baltieri , Martin Biehl , Matteo Capucci , Nathaniel Virgo

Research on reasoning in language models (LMs) predominantly focuses on improving the correctness of their outputs. But some important applications require modeling reasoning patterns that are incorrect. For example, automated systems that…

Machine Learning · Computer Science 2025-10-14 Alexis Ross , Jacob Andreas

Recent large language models have demonstrated relevant capabilities in solving problems that require logical reasoning; however, the corresponding internal mechanisms remain largely unexplored. In this paper, we show that a small language…

Artificial Intelligence · Computer Science 2025-10-13 Davide Maltoni , Matteo Ferrara

Metacognition -- assessing the quality of one's own cognitive performance -- guides adaptive behavior across species. Substantial research demonstrates that confidence signals can be extracted from language model outputs, yet a fundamental…

Machine Learning · Computer Science 2026-05-20 Dharshan Kumaran , Nathaniel Daw , Simon Osindero , Petar Veličković , Viorica Patraucean

Reinforcement learning with verifiable rewards improves LLM reasoning but often induces overthinking, where models generate unnecessarily long reasoning traces. Existing methods mainly rely on length penalties or early-exit strategies;…

Artificial Intelligence · Computer Science 2026-05-11 Chen Wang , Hexuan Deng , Yining Zhang , Yuchen Zhang , Jionghao Bai , Zhaochun Li , Ge Lan , Yue Wang