中文
相关论文

相关论文: When Safety Fails Before the Answer: Benchmarking …

200 篇论文

Large Reasoning Models (LRMs) introduce a new generation paradigm of explicitly reasoning before answering, leading to remarkable improvements in complex tasks. However, they pose great safety risks against harmful queries and adversarial…

人工智能 · 计算机科学 2025-11-18 Kaiwen Zhou , Xuandong Zhao , Gaowen Liu , Jayanth Srinivasa , Aosong Feng , Dawn Song , Xin Eric Wang

Large Language Models (LLMs) are increasingly described as possessing strong reasoning capabilities, supported by high performance on mathematical, logical, and planning benchmarks. However, most existing evaluations rely on aggregate…

计算与语言 · 计算机科学 2026-04-16 Md. Fahad Ullah Utsho , Mohd. Ruhul Ameen , Akif Islam , Md. Golam Rashed , Dipankar Das

The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in the model's main responses, we argue that it is also…

机器学习 · 计算机科学 2025-10-20 Yongchan Kwon , Shang Zhu , Federico Bianchi , Kaitlyn Zhou , James Zou

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

Evaluating aligned large language models' (LLMs) ability to recognize and reject unsafe user requests is crucial for safe, policy-compliant deployments. Existing evaluation efforts, however, face three limitations that we address with…

Large Reasoning Models (LRMs) have demonstrated remarkable performance on tasks such as mathematics and code generation. Motivated by these strengths, recent work has empirically demonstrated the effectiveness of LRMs as guard models in…

密码学与安全 · 计算机科学 2025-09-29 Jiawei Zhao , Yuang Qi , Weiming Zhang , Nenghai Yu , Kejiang Chen

Thinking mode has always been regarded as one of the most valuable modes in LLMs. However, we uncover a surprising and previously overlooked phenomenon: LLMs with thinking mode are more easily broken by Jailbreak attack. We evaluate 9 LLMs…

计算与语言 · 计算机科学 2025-08-15 Fan Yang

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about their security. While jailbreak attacks highlight failures under overtly harmful queries, they overlook a critical risk: incorrectly…

密码学与安全 · 计算机科学 2025-06-10 Yukai Zhou , Sibei Yang , Wenjie Wang

Reasoning is central to a wide range of intellectual activities, and while the capabilities of large language models (LLMs) continue to advance, their performance in reasoning tasks remains limited. The processes and mechanisms underlying…

人工智能 · 计算机科学 2024-10-07 Ippei Fujisawa , Sensho Nobe , Hiroki Seto , Rina Onda , Yoshiaki Uchida , Hiroki Ikoma , Pei-Chun Chien , Ryota Kanai

Health, Safety, and Environment (HSE) compliance assessment demands dynamic real-time decision-making under complicated regulations and complex human-machine-environment interactions. While large language models (LLMs) hold significant…

计算与语言 · 计算机科学 2025-05-30 Jianwei Wang , Mengqi Wang , Yinsi Zhou , Zhenchang Xing , Qing Liu , Xiwei Xu , Wenjie Zhang , Liming Zhu

Recent reasoning large language models (LLMs) have demonstrated remarkable improvements in mathematical reasoning capabilities through long Chain-of-Thought. The reasoning tokens of these models enable self-correction within reasoning…

人工智能 · 计算机科学 2025-04-02 Yu Cui , Bryan Hooi , Yujun Cai , Yiwei Wang

Large Reasoning Models (LRMs) have recently extended their powerful reasoning capabilities to safety checks-using chain-of-thought reasoning to decide whether a request should be answered. While this new approach offers a promising route…

计算与语言 · 计算机科学 2025-02-28 Martin Kuo , Jianyi Zhang , Aolin Ding , Qinsi Wang , Louis DiValentin , Yujia Bao , Wei Wei , Hai Li , Yiran Chen

Currently, many large language models (LLMs) are utilized for software engineering tasks such as code generation. The emergence of more advanced models known as large reasoning models (LRMs), such as OpenAI's o3, DeepSeek R1, and Qwen3.…

软件工程 · 计算机科学 2025-09-18 Kevin Halim , Sin G. Teo , Ruitao Feng , Zhenpeng Chen , Yang Gu , Chong Wang , Yang Liu

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Large language models (LLMs) increasingly rely on knowledge editing to support knowledge-intensive reasoning, but this flexibility also introduces critical safety risks: adversaries can inject malicious or misleading knowledge that corrupts…

人工智能 · 计算机科学 2026-05-12 Qinghua Mao , Xi Lin , Jinze Gu , Jun Wu , Siyuan Li , Yuliang Chen

Large Language Models (LLMs) have gained considerable popularity and protected by increasingly sophisticated safety mechanisms. However, jailbreak attacks continue to pose a critical security threat by inducing models to generate…

密码学与安全 · 计算机科学 2025-12-23 Zehao Liu , Xi Lin

Chain-of-Thought (CoT) reasoning has emerged as a key technique for eliciting complex reasoning in Large Language Models (LLMs). Although interpretable, its dependence on natural language limits the model's expressive bandwidth. Continuous…

人工智能 · 计算机科学 2026-04-28 Sharan Ramjee

The deployment of Large Reasoning Models (LRMs) in high-stakes decision-making pipelines has introduced a novel and opaque attack surface: reasoning backdoors. In these attacks, the model's intermediate Chain-of-Thought (CoT) is manipulated…

密码学与安全 · 计算机科学 2026-03-04 Zhen Guo , Shanghao Shi , Hao Li , Shamim Yazdani , Ning Zhang , Reza Tourani

Multimodal Large Language Models (MLLMs) excel at recognizing individual visual elements and reasoning over simple linear diagrams. However, when faced with complex topological structures involving branching paths, converging flows, and…

人工智能 · 计算机科学 2026-04-24 Qiang Xu , Shengyuan Bai , Yu Wang , He Cao , Leqing Chen , Yuanyuan Liu , Bin Feng , Zijing Liu , Yu Li

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged--Reasoning Hallucination--where logically coherent but…

人工智能 · 计算机科学 2025-05-20 Zhongxiang Sun , Qipeng Wang , Haoyu Wang , Xiao Zhang , Jun Xu