English
Related papers

Related papers: Inducing Overthink: Hierarchical Genetic Algorithm…

200 papers

Recent Large Reasoning Models (LRMs) have shown substantially improved reasoning capabilities over traditional Large Language Models (LLMs) by incorporating extended thinking processes prior to producing final responses. However,…

Computation and Language · Computer Science 2025-05-22 Lingjie Jiang , Xun Wu , Shaohan Huang , Qingxiu Dong , Zewen Chi , Li Dong , Xingxing Zhang , Tengchao Lv , Lei Cui , Furu Wei

Thinking LLMs solve complex tasks at the expense of increased compute and overthinking on simpler problems, while non-thinking LLMs are faster and cheaper but underthink on harder reasoning problems. This has led to the development of…

Computation and Language · Computer Science 2025-10-07 Pranjal Aggarwal , Seungone Kim , Jack Lanchantin , Sean Welleck , Jason Weston , Ilia Kulikov , Swarnadeep Saha

While reasoning large language models (LLMs) demonstrate remarkable performance across various tasks, they also contain notable security vulnerabilities. Recent research has uncovered a "thinking-stopped" vulnerability in DeepSeek-R1, where…

Cryptography and Security · Computer Science 2025-04-30 Yu Cui , Yujun Cai , Yiwei Wang

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

Computation and Language · Computer Science 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as…

Cryptography and Security · Computer Science 2024-10-01 Zeguan Xiao , Yan Yang , Guanhua Chen , Yun Chen

Large Language Models (LLMs), despite their impressive capabilities across domains, have been shown to be vulnerable to backdoor attacks. Prior backdoor strategies predominantly operate at the token level, where an injected trigger causes…

Cryptography and Security · Computer Science 2026-04-17 Vu Tuan Truong , Long Bao Le

Large Language Models (LLMs) demonstrate impressive capabilities across a wide range of tasks, yet their safety mechanisms remain susceptible to adversarial attacks that exploit cognitive biases -- systematic deviations from rational…

Computation and Language · Computer Science 2025-11-18 Xikang Yang , Biyu Zhou , Xuehai Tang , Jizhong Han , Songlin Hu

Large Reasoning Models (LRMs) employ reasoning to address complex tasks. Such explicit reasoning requires extended context lengths, resulting in substantially higher resource consumption. Prior work has shown that adversarially crafted…

Artificial Intelligence · Computer Science 2026-02-10 Ziwei Wang , Yuanhe Zhang , Jing Chen , Zhenhong Zhou , Ruichao Liang , Ruiying Du , Ju Jia , Cong Wu , Yang Liu

Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although recent progress in Large Reasoning Models (LRMs) has boosted…

Artificial Intelligence · Computer Science 2026-03-05 Nanxu Gong , Haotian Li , Sixun Dong , Jianxun Lian , Yanjie Fu , Xing Xie

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning tasks, yet they often struggle with problems involving missing information, exhibiting issues such as incomplete responses, factual errors, and…

Artificial Intelligence · Computer Science 2025-12-12 Yuxin Liu , Chaojie Gu , Yihang Zhang , Bin Qian , Shibo He

Large Language Models face an emerging and critical threat known as latency attacks. Because LLM inference is inherently expensive, even modest slowdowns can translate into substantial operating costs and severe availability risks.…

Cryptography and Security · Computer Science 2026-02-10 Tianyi Wang , Huawei Fan , Yuanchao Shu , Peng Cheng , Cong Wang

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi

Large Reasoning Models (LRMs) have achieved remarkable performance on complex tasks by engaging in extended reasoning before producing final answers, yet this strength introduces the risk of overthinking, where excessive token generation…

Computation and Language · Computer Science 2025-06-25 Shu Yang , Junchao Wu , Xuansheng Wu , Derek Wong , Ninhao Liu , Di Wang

Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to…

Artificial Intelligence · Computer Science 2026-02-05 Zicheng Xu , Xiuyi Lou , Guanchu Wang , Yu-Neng Chuang , Feng Luo , Guangyao Zheng , Alexander S. Szalay , Zirui Liu , Vladimir Braverman

Large Reasoning Models (LRMs) have recently extended their powerful reasoning capabilities to safety checks-using chain-of-thought reasoning to decide whether a request should be answered. While this new approach offers a promising route…

Computation and Language · Computer Science 2025-02-28 Martin Kuo , Jianyi Zhang , Aolin Ding , Qinsi Wang , Louis DiValentin , Yujia Bao , Wei Wei , Hai Li , Yiran Chen

Contemporary progress in large language models (LLMs) has revealed notable inferential capacities via reinforcement learning (RL) employing verifiable reward, facilitating the development of O1 and R1-like reasoning models. Directly…

Machine Learning · Computer Science 2025-10-21 Zexu Sun , Yongcheng Zeng , Erxue Min , Heyang Gao , Bokai Ji , Xu Chen

Hierarchical reasoning model (HRM) achieves extraordinary performance on various reasoning tasks, significantly outperforming large language model-based reasoners. To understand the strengths and potential failure modes of HRM, we conduct a…

Artificial Intelligence · Computer Science 2026-03-24 Zirui Ren , Ziming Liu

Although Large Reasoning Models (LRMs) have progressed in solving complex problems, their chain-of-thought (CoT) reasoning often contains harmful content that can persist even when the final responses appear safe. We show that this issue…

Artificial Intelligence · Computer Science 2026-03-03 Yichi Zhang , Yue Ding , Jingwen Yang , Tianwei Luo , Dongbai Li , Ranjie Duan , Qiang Liu , Hang Su , Yinpeng Dong , Jun Zhu

With the rapid rise of personalized AI, customized large language models (LLMs) equipped with Chain of Thought (COT) reasoning now power millions of AI agents. However, their complex reasoning processes introduce new and largely unexplored…

Cryptography and Security · Computer Science 2025-11-25 Zhen Guo , Shanghao Shi , Shamim Yazdani , Ning Zhang , Reza Tourani

Large Language Models (LLMs) with chains-of-thought have demonstrated strong performance on an increasing range of tasks, particularly those involving complex logical reasoning. However, excessively long chains can lead to overthinking,…

Artificial Intelligence · Computer Science 2025-08-22 Yekun Zhu , Guang Chen , Chengjun Mao