English
Related papers

Related papers: Inducing Overthink: Hierarchical Genetic Algorithm…

200 papers

In recent years, large language models (LLMs) have witnessed remarkable advancements, with the test-time scaling law consistently enhancing the reasoning capabilities. Through systematic evaluation and exploration of a diverse spectrum of…

Computation and Language · Computer Science 2025-11-03 Chenyang Shao , Sijian Ren , Fengli Xu , Yong Li

Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning. Recent work explores using Small Reasoning Models (SRMs) to…

Artificial Intelligence · Computer Science 2026-04-17 Yi Zhao , Yajuan Peng , Cam-Tu Nguyen , Zuchao Li , Xiaoliang Wang , Xiaoming Fu , Hai Zhao

Large language models (LLMs) have been serving as effective backbones for retrieval systems, including Retrieval-Augmentation-Generation (RAG), Dense Information Retriever (IR), and Agent Memory Retrieval. Recent studies have demonstrated…

Cryptography and Security · Computer Science 2026-05-18 Jiate Li , Defu Cao , Li Li , Wei Yang , Yuehan Qin , Chenxiao Yu , Tiannuo Yang , Ryan A. Rossi , Yan Liu , Xiyang Hu , Yue Zhao

Large Reasoning Language Models (LRLMs) demonstrate impressive capabilities on complex tasks by utilizing long Chain-of-Thought reasoning. However, they are prone to overthinking, which generates redundant reasoning steps that degrade both…

Computation and Language · Computer Science 2026-03-17 Weixin Guan , Liang Li , Jiapeng Liu , Bing Li , Peng Fu , Chengyang Fang , Xiaoshuai Hao , Can Ma , Weiping Wang

Large language models (LLMs), designed to provide helpful and safe responses, often rely on alignment techniques to align with user intent and social guidelines. Unfortunately, this alignment can be exploited by malicious actors seeking to…

Computation and Language · Computer Science 2024-08-06 Raz Lapid , Ron Langberg , Moshe Sipper

The rapid development of large reasoning models (LRMs), such as OpenAI-o3 and DeepSeek-R1, has led to significant improvements in complex reasoning over non-reasoning large language models~(LLMs). However, their enhanced capabilities,…

Computers and Society · Computer Science 2025-11-18 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Shreedhar Jangam , Jayanth Srinivasa , Gaowen Liu , Dawn Song , Xin Eric Wang

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge, making them adaptable and cost-effective for various applications. However, the growing reliance on these systems also…

Cryptography and Security · Computer Science 2024-10-31 Yucheng Zhang , Qinfeng Li , Tianyu Du , Xuhong Zhang , Xinkui Zhao , Zhengwen Feng , Jianwei Yin

Retrieval-Augmented Generation (RAG) systems enhance response credibility and traceability by displaying reference contexts, but this transparency simultaneously introduces a novel black-box attack vector. Existing document poisoning…

Computation and Language · Computer Science 2026-01-27 Runqi Sui

Recent Large Reasoning Models (LRMs), such as DeepSeek-R1 and OpenAI o1, have demonstrated strong performance gains by scaling up the length of Chain-of-Thought (CoT) reasoning during inference. However, a growing concern lies in their…

Large Language Models (LLMs) excel at problem solving by generating chain of thoughts in natural language, but such verbal thinking is computationally costly and prone to overthinking. A recent work instead proposes a latent thinking…

Computation and Language · Computer Science 2026-02-25 Hanwen Du , Yuxin Dong , Xia Ning

Modern large language model (LLM) developers typically conduct a safety alignment to prevent an LLM from generating unethical or harmful content. Recent studies have discovered that the safety alignment of LLMs can be bypassed by…

Cryptography and Security · Computer Science 2024-06-14 Xuan Chen , Yuzhou Nie , Lu Yan , Yunshu Mao , Wenbo Guo , Xiangyu Zhang

Large Reasoning Models (LRMs) solve complex tasks by generating long Chain-of-Thought (CoT) sequences; however, the emergent dynamics governing reasoning trajectories are not well understood and can lead to inconsistencies and reasoning…

Artificial Intelligence · Computer Science 2026-05-29 G M Shahariar , Erfan Shayegani , Ali Nazari , Nael Abu-Ghazaleh

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Recent advances in Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in solving complex tasks such as mathematics and coding. However, these models frequently exhibit a phenomenon known as overthinking during…

Machine Learning · Computer Science 2025-11-18 Yao Huang , Huanran Chen , Shouwei Ruan , Yichi Zhang , Xingxing Wei , Yinpeng Dong

This paper explores the system 1 thinking capability of Large Reasoning Models (LRMs), the intuitive ability to respond efficiently with minimal token usage. While existing LRMs rely on long-chain reasoning and excel at complex tasks, their…

Computation and Language · Computer Science 2026-05-04 Wenyuan Zhang , Shuaiyi Nie , Xinghua Zhang , Zefeng Zhang , Tingwen Liu

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

Cryptography and Security · Computer Science 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

Reasoning Large Language Models (RLLMs) have demonstrated impressive performance on complex tasks, largely due to the adoption of Long Chain-of-Thought (Long CoT) reasoning. However, they often exhibit overthinking -- performing unnecessary…

Computation and Language · Computer Science 2025-05-30 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Dacheng Tao

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while…

Artificial Intelligence · Computer Science 2026-01-07 Shengjia Zhang , Junjie Wu , Jiawei Chen , Changwang Zhang , Zhe Li , Xingyu Lou , Wangchunshu Zhou , Sheng Zhou , Can Wang , Jun Wang

Large Language Models (LLMs) have become integral to automated code analysis, enabling tasks such as vulnerability detection and code comprehension. However, their integration introduces novel attack surfaces. In this paper, we identify and…

Cryptography and Security · Computer Science 2025-07-23 Yue Li , Xiao Li , Hao Wu , Yue Zhang , Fengyuan Xu , Xiuzhen Cheng , Sheng Zhong