中文
相关论文

相关论文: When Safe Unimodal Inputs Collide: Optimizing Reas…

200 篇论文

Large Language Models (LLMs) are vulnerable to jailbreak attacks that exploit weaknesses in traditional safety alignment, which often relies on rigid refusal heuristics or representation engineering to block harmful outputs. While they are…

计算与语言 · 计算机科学 2025-10-01 Yuyou Zhang , Miao Li , William Han , Yihang Yao , Zhepeng Cen , Ding Zhao

As large language models (LLMs) are increasingly adopted in safety-critical and regulated sectors, the retention of sensitive or prohibited knowledge introduces escalating risks, ranging from privacy leakage to regulatory non-compliance to…

机器学习 · 计算机科学 2025-12-19 Taozhao Chen , Linghan Huang , Kim-Kwang Raymond Choo , Huaming Chen

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process…

机器人学 · 计算机科学 2025-06-09 Jiawei Zhang , Xuan Yang , Taiqi Wang , Yu Yao , Aleksandr Petiushko , Bo Li

Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities that increasingly influence various aspects of our daily lives, constantly defining the new boundary of Artificial General Intelligence (AGI). Image modalities,…

密码学与安全 · 计算机科学 2024-08-13 Yihe Fan , Yuxin Cao , Ziyu Zhao , Ziyao Liu , Shaofeng Li

Large language models (LLMs) excel in diverse applications but face dual challenges: generating harmful content under jailbreak attacks and over-refusal of benign queries due to rigid safety mechanisms. These issues are further complicated…

人工智能 · 计算机科学 2025-11-04 Yifan Xia , Guorui Chen , Wenqian Yu , Zhijiang Li , Philip Torr , Jindong Gu

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

密码学与安全 · 计算机科学 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Large Language Models (LLMs) are susceptible to adversarial attacks such as jailbreaking, which can elicit harmful or unsafe behaviors. This vulnerability is exacerbated in multilingual settings, where multilingual safety-aligned data is…

计算与语言 · 计算机科学 2025-09-29 Yahan Yang , Soham Dan , Shuo Li , Dan Roth , Insup Lee

While explicit Chain-of-Thought (CoT) empowers large reasoning models (LRMs), it enables the generation of riskier final answers. Current alignment paradigms primarily rely on externally enforced compliance, optimizing models to detect…

人工智能 · 计算机科学 2026-05-12 Yi Zhang , Yuxin Chen , Leheng Sheng , Dongcheng Zhang , Chaochao Lu , Xiang Wang , An Zhang

Large Language Models (LLMs) are increasingly adopted in high-stakes scenarios, yet their safety mechanisms often remain fragile. Simple jailbreak prompts or even benign fine-tuning can bypass these protocols, underscoring the need to…

机器学习 · 计算机科学 2025-02-04 Ching-Chia Kao , Chia-Mu Yu , Chun-Shien Lu , Chu-Song Chen

As large reasoning models (LRMs) grow more capable, chain-of-thought (CoT) reasoning introduces new safety challenges. Existing SFT-based safety alignment studies dominantly focused on filtering prompts with safe, high-quality responses,…

计算与语言 · 计算机科学 2026-03-31 Raj Vardhan Tomar , Preslav Nakov , Yuxia Wang

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically…

密码学与安全 · 计算机科学 2026-03-17 Yu Pan , Wenlong Yu , Tiejun Wu , Xiaohu Ye , Qiannan Si , Guangquan Xu , Bin Wu

Large Language Models (LLMs) have demonstrated remarkable success across various NLP benchmarks. However, excelling in complex tasks that require nuanced reasoning and precise decision-making demands more than raw language proficiency--LLMs…

计算与语言 · 计算机科学 2025-02-24 Ang Li , Yichuan Mo , Mingjie Li , Yifei Wang , Yisen Wang

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single…

密码学与安全 · 计算机科学 2026-04-28 Xu Zhang , Hao Li , Zhichao Lu

Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term this phenomenon Structural Cognitive Overload (SCO), a byproduct of the contention between…

人工智能 · 计算机科学 2026-05-26 Yang Luo , Xinran Liu , Tiantian Ji , Zhiyi Yin , Lingyun Peng , Shuyu Li

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

计算与语言 · 计算机科学 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

The rapid development of large reasoning models (LRMs), such as OpenAI-o3 and DeepSeek-R1, has led to significant improvements in complex reasoning over non-reasoning large language models~(LLMs). However, their enhanced capabilities,…

计算机与社会 · 计算机科学 2025-11-18 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Shreedhar Jangam , Jayanth Srinivasa , Gaowen Liu , Dawn Song , Xin Eric Wang

Large Reasoning Models (LRMs) have achieved tremendous success with their chain-of-thought (CoT) reasoning, yet also face safety issues similar to those of basic language models. In particular, while algorithms are designed to guide them to…

机器学习 · 计算机科学 2026-02-05 Zeming Wei , Qiaosheng Zhang , Xia Hu , Xingcheng Xu

Large Multimodal Reasoning Models (LMRMs) are moving into real applications, where they must be both useful and safe. Safety is especially challenging in multimodal settings: images and text can be combined to bypass guardrails, and single…

人工智能 · 计算机科学 2025-10-07 Yizhuo Ding , Mingkang Chen , Qiuhua Liu , Fenghua Weng , Wanying Qu , Yue Yang , Yugang Jiang , Zuxuan Wu , Yanwei Fu , Wenqi Shao

Recent studies reveal that integrating new modalities into Large Language Models (LLMs), such as Vision-Language Models (VLMs), creates a new attack surface that bypasses existing safety training techniques like Supervised Fine-tuning (SFT)…

Multimodal Large Language Models (MLLMs) are showing strong safety concerns (e.g., generating harmful outputs for users), which motivates the development of safety evaluation benchmarks. However, we observe that existing safety benchmarks…

密码学与安全 · 计算机科学 2024-10-25 Zonghao Ying , Aishan Liu , Siyuan Liang , Lei Huang , Jinyang Guo , Wenbo Zhou , Xianglong Liu , Dacheng Tao