English
Related papers

Related papers: Inducing Overthink: Hierarchical Genetic Algorithm…

200 papers

Emerging Large Reasoning Models (LRMs) consistently excel in mathematical and reasoning tasks, showcasing remarkable capabilities. However, the enhancement of reasoning abilities and the exposure of internal reasoning processes introduce…

Cryptography and Security · Computer Science 2025-10-24 Jingyuan Ma , Rui Li , Zheng Li , Junfeng Liu , Heming Xia , Lei Sha , Zhifang Sui

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

Large reasoning models (LRMs), such as OpenAI o1 and DeepSeek-R1, have significantly enhanced their reasoning capabilities by generating longer chains of thought, demonstrating outstanding performance across a variety of tasks. However,…

Computation and Language · Computer Science 2025-10-31 Haoran Zhao , Yuchen Yan , Yongliang Shen , Haolei Xu , Wenqi Zhang , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

While recent success of large reasoning models (LRMs) significantly advanced LLMs' reasoning capability by optimizing the final answer accuracy using reinforcement learning, they may also drastically increase the output length due to…

Artificial Intelligence · Computer Science 2025-05-29 Sohyun An , Ruochen Wang , Tianyi Zhou , Cho-Jui Hsieh

This project reproduces and extends the recently proposed ``Recursive Language Models'' (RLMs) framework by Zhang et al. (2026). This framework enables Large Language Models (LLMs) to process near-infinite contexts by offloading the prompt…

Computation and Language · Computer Science 2026-03-04 Daren Wang

Retrieval-augmented generation (RAG) systems can effectively mitigate the hallucination problem of large language models (LLMs),but they also possess inherent vulnerabilities. Identifying these weaknesses before the large-scale real-world…

Information Retrieval · Computer Science 2025-05-23 Hongru Song , Yu-an Liu , Ruqing Zhang , Jiafeng Guo , Yixing Fan

Recent advancements in large reasoning models (LRMs) have significantly enhanced language models' capabilities in complex problem-solving by emulating human-like deliberative thinking. However, these models often exhibit overthinking (i.e.,…

Artificial Intelligence · Computer Science 2025-06-19 Weixiang Zhao , Jiahe Guo , Yang Deng , Xingyu Sui , Yulin Hu , Yanyan Zhao , Wanxiang Che , Bing Qin , Tat-Seng Chua , Ting Liu

Large reasoning models (LRMs) have achieved impressive performance in complex tasks, often outperforming conventional large language models (LLMs). However, the prevalent issue of overthinking severely limits their computational efficiency.…

Computation and Language · Computer Science 2025-05-29 Zhiyuan Li , Yi Chang , Yuan Wu

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Large Reasoning Models (LRMs) often suffer from overthinking, generating verbose reasoning traces that compromise both computational efficiency and interpretability. Unlike prior efforts that rely on global length-based rewards, we propose…

Artificial Intelligence · Computer Science 2026-01-07 Jialiang Hong , Taihang Zhen , Kai Chen , Jiaheng Liu , Junlan Feng , Wenpeng Zhu , Jing Huo , Yang Gao , Depeng Wang , Haitao Wan , Xi Yang , Boyan Wang , Fanyu Meng , Yuyao Zhang

Recent studies empirically reveal that large reasoning models (LRMs) can automatically allocate more reasoning strengths (i.e., the number of reasoning tokens) for harder problems, exhibiting difficulty-awareness for better task…

Artificial Intelligence · Computer Science 2026-02-10 Leheng Sheng , An Zhang , Zijian Wu , Weixiang Zhao , Changshuo Shen , Yi Zhang , Xiang Wang , Tat-Seng Chua

Neural ranking models (NRMs) have been shown to be highly effective in terms of retrieval performance. Unfortunately, they have also displayed a higher degree of sensitivity to attacks than previous generation models. To help expose and…

Information Retrieval · Computer Science 2024-12-30 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Current literature, aiming to surpass the "Chain-of-Thought" approach, often resorts to external modi operandi involving halting, modifying, and then resuming the generation process to boost Large Language Models' (LLMs) reasoning…

Computation and Language · Computer Science 2024-06-04 Bilgehan Sel , Ahmad Al-Tawaha , Vanshaj Khattar , Ruoxi Jia , Ming Jin

Large Reasoning Models (LRMs) improve task performance through extended inference-time reasoning. Although previous studies suggest that longer reasoning should lead to more robust safety behavior, we find evidence to the contrary:…

Artificial Intelligence · Computer Science 2026-05-26 Jianli Zhao , Tingchen Fu , Rylan Schaeffer , Mrinank Sharma , Fazl Barez

Large Reasoning Models (LRMs) achieve strong performance through explicit chain-of-thought reasoning but suffer from \textit{overthinking}: generating excessive reasoning tokens even for trivial queries. {Beyond inflating cost, overthinking…

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore sufficient reasoning paths…

Artificial Intelligence · Computer Science 2026-04-03 Yulin Li , Tengyao Tu , Li Ding , Junjie Wang , Huiling Zhen , Yixin Chen , Yong Li , Zhuotao Tian

Large Reasoning Models (LRMs) have demonstrated strong capabilities in generating step-by-step reasoning chains alongside final answers, enabling their deployment in high-stakes domains such as healthcare and education. While prior…

Machine Learning · Computer Science 2026-04-20 Zehao Wang , Lanjun Wang

Large language models (LLMs) are increasingly optimized for long reasoning, under the assumption that more reasoning leads to better performance. However, emerging evidence suggests that longer responses can sometimes degrade accuracy…

Computation and Language · Computer Science 2025-05-02 Jinyan Su , Jennifer Healey , Preslav Nakov , Claire Cardie

Large Reasoning Models (LRMs) have significantly advanced beyond traditional Large Language Models (LLMs) with their exceptional logical reasoning capabilities, yet these improvements introduce heightened safety risks. When subjected to…

Cryptography and Security · Computer Science 2025-06-04 Yang Yao , Xuan Tong , Ruofan Wang , Yixu Wang , Lujundong Li , Liang Liu , Yan Teng , Yingchun Wang

Listwise reranking utilizing Large Language Models (LLMs) has achieved state-of-the-art retrieval effectiveness. Recently, reasoning-enhanced models have further pushed these boundaries by employing Chain-of-Thought (CoT) to perform deep…

Information Retrieval · Computer Science 2026-05-15 Danyang Liu , Kan Li