English
Related papers

Related papers: HauntAttack: When Attack Follows Reasoning as a Sh…

200 papers

Large reasoning models (LRMs) have attracted much attention due to their exceptional performance. However, their performance mainly stems from thinking, a long Chain of Thought (CoT), which significantly increase computational overhead. To…

Artificial Intelligence · Computer Science 2026-01-09 Siyuan Gan , Jiaheng Liu , Boyan Wang , Tianpei Yang , Runqing Miao , Yuyao Zhang , Fanyu Meng , Junlan Feng , Linjian Meng , Jing Huo , Yang Gao

Large language models (LLMs) are vital for a wide range of applications yet remain susceptible to jailbreak threats, which could lead to the generation of inappropriate responses. Conventional defenses, such as refusal and adversarial…

Cryptography and Security · Computer Science 2026-01-29 Xianglin Yang , Gelei Deng , Jieming Shi , Tianwei Zhang , Jin Song Dong

The rapid expansion of the Internet of Things (IoT) is reshaping communication and operational practices across industries, but it also broadens the attack surface and increases susceptibility to security breaches. Artificial Intelligence…

Cryptography and Security · Computer Science 2025-11-11 Seif Ikbarieh , Kshitiz Aryal , Maanak Gupta

Large reasoning models (LRMs) achieve strong performance on mathematical reasoning tasks, often attributed to their capability to generate explicit chain-of-thought (CoT) explanations. However, recent work shows that LRMs often arrive at…

Computation and Language · Computer Science 2026-04-20 Yihong Liu , Raoyuan Zhao , Hinrich Schütze , Michael A. Hedderich

Large language models (LLMs) are increasingly used to help security analysts manage the surge of cyber threats, automating tasks from vulnerability assessment to incident response. Yet in operational CTI workflows, reliability gaps remain…

Cryptography and Security · Computer Science 2026-05-29 Yuqiao Meng , Luoxi Tang , Feiyang Yu , Jinyuan Jia , Guanhua Yan , Ping Yang , Zhaohan Xi

Jailbreak attacks aim to bypass the LLMs' safeguards. While researchers have proposed different jailbreak attacks in depth, they have done so in isolation -- either with unaligned settings or comparing a limited range of methods. To fill…

Cryptography and Security · Computer Science 2025-05-27 Junjie Chu , Yugeng Liu , Ziqing Yang , Xinyue Shen , Michael Backes , Yang Zhang

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

Computation and Language · Computer Science 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in the model's main responses, we argue that it is also…

Machine Learning · Computer Science 2025-10-20 Yongchan Kwon , Shang Zhu , Federico Bianchi , Kaitlyn Zhou , James Zou

Large language models (LLMs) achieve high performance on mathematical reasoning, but these results can be inflated by training data leakage or superficial pattern matching rather than genuine reasoning. To this end, an adversarial…

Computation and Language · Computer Science 2026-02-03 Xinyuan Li , Murong Xu , Wenbiao Tao , Hanlun Zhu , Yike Zhao , Jipeng Zhang , Yunshi Lan

While Large Language Models (LLMs) have shown impressive capabilities in math problem-solving tasks, their robustness to noisy inputs is not well-studied. We propose ArithmAttack to examine how robust the LLMs are when they encounter noisy…

Computation and Language · Computer Science 2026-03-17 Zain Ul Abedin , Shahzeb Qamar , Lucie Flek , Akbar Karimi

Despite the recent success of large language models (LLMs) in reasoning such as DeepSeek, we for the first time identify a key dilemma in reasoning robustness and generalization: significant performance degradation on novel or incomplete…

Artificial Intelligence · Computer Science 2025-03-07 Tong Yu , Yongcheng Jing , Xikun Zhang , Wentao Jiang , Wenjie Wu , Yingjie Wang , Wenbin Hu , Bo Du , Dacheng Tao

Large Reasoning Models (LRMs) introduce new opportunities for safety monitoring through their Chain of Thought (CoT) reasoning. However, CoT is not always faithful to the model's final output, undermining its reliability as a monitoring…

Computation and Language · Computer Science 2026-05-19 Maciej Chrabąszcz , Aleksander Szymczyk , Marcin Sendera , Tomasz Trzciński , Sebastian Cygert

Jailbreak attacks represent one of the most sophisticated threats to the security of large language models (LLMs). To deal with such risks, we introduce an innovative framework that can help evaluate the effectiveness of jailbreak attacks…

Computation and Language · Computer Science 2025-03-19 Dong Shu , Chong Zhang , Mingyu Jin , Zihao Zhou , Lingyao Li , Yongfeng Zhang

Despite the remarkable proficiency of \textit{Large Reasoning Models} (LRMs) in handling complex reasoning tasks, their reliability in safety-critical scenarios remains uncertain. Existing evaluations primarily assess response-level safety,…

Artificial Intelligence · Computer Science 2025-05-27 Baihui Zheng , Boren Zheng , Kerui Cao , Yingshui Tan , Zhendong Liu , Weixun Wang , Jiaheng Liu , Jian Yang , Wenbo Su , Xiaoyong Zhu , Bo Zheng , Kaifu Zhang

Large language models (LLMs) showcase impressive reasoning capabilities when coupled with Chain-of-Thought (CoT) prompting. However, the robustness of this approach warrants further investigation. In this paper, we introduce a novel…

Computation and Language · Computer Science 2024-06-03 Rongwu Xu , Zehan Qi , Wei Xu

LLMs have made significant progress in the field of mathematical reasoning, but whether they have true the mathematical understanding ability is still controversial. To explore this issue, we propose a new perturbation framework to evaluate…

Artificial Intelligence · Computer Science 2025-11-12 Zhishen Sun , Guang Dai , Ivor Tsang , Haishan Ye

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, but their security vulnerabilities can be exploited by attackers to generate harmful content, causing adverse impacts across various societal…

Cryptography and Security · Computer Science 2025-12-17 Fan Yang

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

Computation and Language · Computer Science 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

Large Reasoning Models (LRMs) have demonstrated remarkable performance on tasks such as mathematics and code generation. Motivated by these strengths, recent work has empirically demonstrated the effectiveness of LRMs as guard models in…

Cryptography and Security · Computer Science 2025-09-29 Jiawei Zhao , Yuang Qi , Weiming Zhang , Nenghai Yu , Kejiang Chen

Recent advances in Large Language Models (LLMs) have driven interest in automating cybersecurity penetration testing workflows, offering the promise of faster and more consistent vulnerability assessment for enterprise systems. Existing LLM…

Cryptography and Security · Computer Science 2025-11-19 Katsuaki Nakano , Reza Fayyazi , Shanchieh Jay Yang , Michael Zuzak