中文
相关论文

相关论文: Exploring the Secondary Risks of Large Language Mo…

200 篇论文

Large language models (LLMs) are increasingly deployed in medical contexts, raising critical concerns about safety, alignment, and susceptibility to adversarial manipulation. While prior benchmarks assess model refusal capabilities for…

计算与语言 · 计算机科学 2025-05-19 Sijia Chen , Xiaomin Li , Mengxue Zhang , Eric Hanchen Jiang , Qingcheng Zeng , Chen-Hsiang Yu

Large language model (LLM) safety is a critical issue, with numerous studies employing red team testing to enhance model security. Among these, jailbreak methods explore potential vulnerabilities by crafting malicious prompts that induce…

计算与语言 · 计算机科学 2025-03-07 Honglin Mu , Han He , Yuxin Zhou , Yunlong Feng , Yang Xu , Libo Qin , Xiaoming Shi , Zeming Liu , Xudong Han , Qi Shi , Qingfu Zhu , Wanxiang Che

Large language models (LLMs) have demonstrated remarkable capabilities across various applications, highlighting the urgent need for comprehensive safety evaluations. In particular, the enhanced Chinese language proficiency of LLMs,…

计算与语言 · 计算机科学 2025-02-27 Shuyi Liu , Simiao Cui , Haoran Bu , Yuming Shang , Xi Zhang

Large language models (LLMs) have become increasingly integrated with various applications. To ensure that LLMs do not generate unsafe responses, they are aligned with safeguards that specify what content is restricted. However, such…

计算与语言 · 计算机科学 2024-05-08 Hongyu Cai , Arjun Arunasalam , Leo Y. Lin , Antonio Bianchi , Z. Berkay Celik

Large Language Model (LLM) safety is inherently pluralistic, reflecting variations in moral norms, cultural expectations, and demographic contexts. Yet, existing alignment datasets such as ANTHROPIC-HH and DICES rely on demographically…

计算与语言 · 计算机科学 2026-02-10 Usman Naseem , Gautam Siddharth Kashyap , Sushant Kumar Ray , Rafiq Ali , Ebad Shabbir , Abdullah Mohammad

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

机器学习 · 计算机科学 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Safety mechanisms for large language models (LLMs) remain predominantly English-centric, creating systematic vulnerabilities in multilingual deployment. Prior work shows that translating malicious prompts into other languages can…

计算与语言 · 计算机科学 2026-04-29 Shirin Alanova , Bogdan Minko , Sabrina Sadiekh , Evgeniy Kokuykin

Multimodal large language models (MLLMs) enable interaction over both text and images, but their safety behavior can be driven by unimodal shortcuts instead of true joint intent understanding. We introduce CSR-Bench, a benchmark for…

人工智能 · 计算机科学 2026-02-04 Yuxuan Liu , Yuntian Shi , Kun Wang , Haoting Shen , Kun Yang

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

计算与语言 · 计算机科学 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

As large language models (LLMs) are increasingly deployed as agents, their integration into interactive environments and tool use introduce new safety challenges beyond those associated with the models themselves. However, the absence of…

计算与语言 · 计算机科学 2025-05-21 Zhexin Zhang , Shiyao Cui , Yida Lu , Jingzhuo Zhou , Junxiao Yang , Hongning Wang , Minlie Huang

Large language models (LLMs), such as ChatGPT, have emerged with astonishing capabilities approaching artificial general intelligence. While providing convenience for various societal needs, LLMs have also lowered the cost of generating…

计算与语言 · 计算机科学 2023-08-28 Zhenhua Wang , Wei Xie , Kai Chen , Baosheng Wang , Zhiwen Gui , Enze Wang

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Despite the remarkable performance of Large Language Models (LLMs), they remain vulnerable to jailbreak attacks, which can compromise their safety mechanisms. Existing studies often rely on brute-force optimization or manual design, failing…

计算与语言 · 计算机科学 2025-06-30 Haoming Yang , Ke Ma , Xiaojun Jia , Yingfei Sun , Qianqian Xu , Qingming Huang

Large language models (LLMs) are increasingly deployed in cost-sensitive and on-device scenarios, and safety guardrails have advanced mainly in English. However, real-world Chinese malicious queries typically conceal intent via homophones,…

计算与语言 · 计算机科学 2026-01-06 Zhenhong Zhou , Shilinlu Yan , Chuanpu Liu , Qiankun Li , Kun Wang , Zhigang Zeng

Although safely enhanced Large Language Models (LLMs) have achieved remarkable success in tackling various complex tasks in a zero-shot manner, they remain susceptible to jailbreak attacks, particularly the unknown jailbreak attack. To…

计算与语言 · 计算机科学 2024-06-12 Fan Liu , Zhao Xu , Hao Liu

Large language model (LLM) benchmarks inform LLM use decisions (e.g., "is this LLM safe to deploy for my use case and context?"). However, benchmarks may be rendered unreliable by various failure modes that impact benchmark bias, variance,…

Current jailbreaking work on large language models (LLMs) aims to elicit unsafe outputs from given prompts. However, it only focuses on single-turn jailbreaking targeting one specific query. On the contrary, the advanced LLMs are designed…

计算与语言 · 计算机科学 2025-08-12 Xianjun Yang , Liqiang Xiao , Shiyang Li , Faisal Ladhak , Hyokun Yun , Linda Ruth Petzold , Yi Xu , William Yang Wang

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

计算与语言 · 计算机科学 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

This work identifies a critical failure mode in frontier large language models (LLMs), which we term Internal Safety Collapse (ISC): under certain task conditions, models enter a state in which they continuously generate harmful content…

计算与语言 · 计算机科学 2026-03-26 Yutao Wu , Xiao Liu , Yifeng Gao , Xiang Zheng , Hanxun Huang , Yige Li , Cong Wang , Bo Li , Xingjun Ma , Yu-Gang Jiang