中文
相关论文

相关论文: Exposing Long-Tail Safety Failures in Large Langua…

200 篇论文

The increasing number of Distributed Denial of Service (DDoS) attacks poses a major threat to the Internet, highlighting the importance of DDoS mitigation. Most existing approaches require complex training methods to learn data features,…

密码学与安全 · 计算机科学 2025-01-14 Zhenyu Yin , Shang Liu , Guangyuan Xu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet they pose significant security risks that threaten their safe deployment in critical domains. Current security alignment methodologies…

密码学与安全 · 计算机科学 2025-07-22 Pengfei Du

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

计算与语言 · 计算机科学 2024-12-05 Long Mai , Julie Carson-Berndsen

Backdoor unalignment attacks against Large Language Models (LLMs) enable the stealthy compromise of safety alignment using a hidden trigger while evading normal safety auditing. These attacks pose significant threats to the applications of…

密码学与安全 · 计算机科学 2025-06-23 Biao Yi , Tiansheng Huang , Sishuo Chen , Tong Li , Zheli Liu , Zhixuan Chu , Yiming Li

Data Distribution Service (DDS) is an innovative approach towards communication in ICS/IoT infrastructure and robotics. Being based on the cross-platform and cross-language API to be applicable in any computerised device, it offers the…

机器学习 · 计算机科学 2021-06-15 Stanislav Abaimov

Refusal on harmful prompts is a key safety behaviour in instruction-tuned large language models (LLMs), yet the internal causes of this behaviour remain poorly understood. We study two public instruction-tuned models, Gemma-2-2B-IT and…

计算与语言 · 计算机科学 2026-04-29 Nirmalendu Prakash , Yeo Wei Jie , Amir Abdullah , Ranjan Satapathy , Erik Cambria , Roy Ka Wei Lee

Jailbreaking techniques pose a significant threat to the safety of Large Language Models (LLMs). Existing defenses typically focus on single-turn attacks, lack coverage across languages, and rely on limited taxonomies that either fail to…

计算与语言 · 计算机科学 2026-02-05 Francesco Giarrusso , Olga E. Sorokoletova , Vincenzo Suriani , Daniele Nardi

The proliferation of jailbreak attacks against large language models (LLMs) highlights the need for robust security measures. However, in multi-round dialogues, malicious intentions may be hidden in interactions, leading LLMs to be more…

密码学与安全 · 计算机科学 2025-05-26 Weiyang Guo , Jing Li , Wenya Wang , YU LI , Daojing He , Jun Yu , Min Zhang

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

密码学与安全 · 计算机科学 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

Current safety alignment for large language models(LLMs) continues to present vulnerabilities, given that adversarial prompting can effectively bypass their safety measures.Our investigation shows that these safety mechanisms predominantly…

密码学与安全 · 计算机科学 2025-08-28 Chao Huang , Zefeng Zhang , Juewei Yue , Quangang Li , Chuang Zhang , Tingwen Liu

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

计算与语言 · 计算机科学 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

Recent advances in large language models (LLMs) have demonstrated the effectiveness of Iterative Self-Improvement (ISI) techniques. However, continuous training on self-generated data leads to reduced output diversity, a limitation…

计算与语言 · 计算机科学 2025-01-03 Yiwei Qin , Yixiu Liu , Pengfei Liu

Evaluating large language models (LLMs) today rests on fixed benchmarks that apply the same set of items to any model, producing ceiling and floor effects that mask capability gaps. We argue that the most informative evaluation signal lies…

人工智能 · 计算机科学 2026-05-27 Haoxiang Wang , Da Yu , Huishuai Zhang

Despite their strong performance, large language models (LLMs) face challenges in real-world application of lexical simplification (LS), particularly in privacy-sensitive and resource-constrained environments. Moreover, since vulnerable…

计算与语言 · 计算机科学 2025-09-30 Akio Hayakawa , Stefan Bott , Horacio Saggion

Ensuring the safety of large language model (LLM) applications is essential for developing trustworthy artificial intelligence. Current LLM safety benchmarks have two limitations. First, they focus solely on either discriminative or…

计算与语言 · 计算机科学 2024-10-30 Yutao Mou , Shikun Zhang , Wei Ye

Prepending model inputs with safety prompts is a common practice for safeguarding large language models (LLMs) against queries with harmful intents. However, the underlying working mechanisms of safety prompts have not been unraveled yet,…

机器学习 · 计算机科学 2024-06-04 Chujie Zheng , Fan Yin , Hao Zhou , Fandong Meng , Jie Zhou , Kai-Wei Chang , Minlie Huang , Nanyun Peng

Large language models (LLMs) have demonstrated impressive capabilities in code generation, achieving high scores on benchmarks such as HumanEval and MBPP. However, these benchmarks primarily assess functional correctness and neglect broader…

软件工程 · 计算机科学 2025-08-21 Scott Blyth , Sherlock A. Licorish , Christoph Treude , Markus Wagner

The robustness and security of large language models (LLMs) has become a prominent research area. One notable vulnerability is the ability to bypass LLM safeguards by translating harmful queries into rare or underrepresented languages, a…

计算与语言 · 计算机科学 2025-09-16 Hongliang Li , Jinan Xu , Gengping Cui , Changhao Guan , Fengran Mo , Kaiyu Huang

Vulnerability detection is crucial to protect software security. Nowadays, deep learning (DL) is the most promising technique to automate this detection task, leveraging its superior ability to extract patterns and representations within…

软件工程 · 计算机科学 2026-02-13 Yuejun Guo , Qiang Hu , Qiang Tang , Yves Le Traon

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

机器学习 · 计算机科学 2025-01-27 Bolian Li , Ruqi Zhang