English
Related papers

Related papers: Exposing Long-Tail Safety Failures in Large Langua…

200 papers

The increasing number of Distributed Denial of Service (DDoS) attacks poses a major threat to the Internet, highlighting the importance of DDoS mitigation. Most existing approaches require complex training methods to learn data features,…

Cryptography and Security · Computer Science 2025-01-14 Zhenyu Yin , Shang Liu , Guangyuan Xu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet they pose significant security risks that threaten their safe deployment in critical domains. Current security alignment methodologies…

Cryptography and Security · Computer Science 2025-07-22 Pengfei Du

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

Computation and Language · Computer Science 2024-12-05 Long Mai , Julie Carson-Berndsen

Backdoor unalignment attacks against Large Language Models (LLMs) enable the stealthy compromise of safety alignment using a hidden trigger while evading normal safety auditing. These attacks pose significant threats to the applications of…

Cryptography and Security · Computer Science 2025-06-23 Biao Yi , Tiansheng Huang , Sishuo Chen , Tong Li , Zheli Liu , Zhixuan Chu , Yiming Li

Data Distribution Service (DDS) is an innovative approach towards communication in ICS/IoT infrastructure and robotics. Being based on the cross-platform and cross-language API to be applicable in any computerised device, it offers the…

Machine Learning · Computer Science 2021-06-15 Stanislav Abaimov

Refusal on harmful prompts is a key safety behaviour in instruction-tuned large language models (LLMs), yet the internal causes of this behaviour remain poorly understood. We study two public instruction-tuned models, Gemma-2-2B-IT and…

Computation and Language · Computer Science 2026-04-29 Nirmalendu Prakash , Yeo Wei Jie , Amir Abdullah , Ranjan Satapathy , Erik Cambria , Roy Ka Wei Lee

Jailbreaking techniques pose a significant threat to the safety of Large Language Models (LLMs). Existing defenses typically focus on single-turn attacks, lack coverage across languages, and rely on limited taxonomies that either fail to…

Computation and Language · Computer Science 2026-02-05 Francesco Giarrusso , Olga E. Sorokoletova , Vincenzo Suriani , Daniele Nardi

The proliferation of jailbreak attacks against large language models (LLMs) highlights the need for robust security measures. However, in multi-round dialogues, malicious intentions may be hidden in interactions, leading LLMs to be more…

Cryptography and Security · Computer Science 2025-05-26 Weiyang Guo , Jing Li , Wenya Wang , YU LI , Daojing He , Jun Yu , Min Zhang

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

Cryptography and Security · Computer Science 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

Current safety alignment for large language models(LLMs) continues to present vulnerabilities, given that adversarial prompting can effectively bypass their safety measures.Our investigation shows that these safety mechanisms predominantly…

Cryptography and Security · Computer Science 2025-08-28 Chao Huang , Zefeng Zhang , Juewei Yue , Quangang Li , Chuang Zhang , Tingwen Liu

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

Computation and Language · Computer Science 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

Recent advances in large language models (LLMs) have demonstrated the effectiveness of Iterative Self-Improvement (ISI) techniques. However, continuous training on self-generated data leads to reduced output diversity, a limitation…

Computation and Language · Computer Science 2025-01-03 Yiwei Qin , Yixiu Liu , Pengfei Liu

Evaluating large language models (LLMs) today rests on fixed benchmarks that apply the same set of items to any model, producing ceiling and floor effects that mask capability gaps. We argue that the most informative evaluation signal lies…

Artificial Intelligence · Computer Science 2026-05-27 Haoxiang Wang , Da Yu , Huishuai Zhang

Despite their strong performance, large language models (LLMs) face challenges in real-world application of lexical simplification (LS), particularly in privacy-sensitive and resource-constrained environments. Moreover, since vulnerable…

Computation and Language · Computer Science 2025-09-30 Akio Hayakawa , Stefan Bott , Horacio Saggion

Ensuring the safety of large language model (LLM) applications is essential for developing trustworthy artificial intelligence. Current LLM safety benchmarks have two limitations. First, they focus solely on either discriminative or…

Computation and Language · Computer Science 2024-10-30 Yutao Mou , Shikun Zhang , Wei Ye

Prepending model inputs with safety prompts is a common practice for safeguarding large language models (LLMs) against queries with harmful intents. However, the underlying working mechanisms of safety prompts have not been unraveled yet,…

Machine Learning · Computer Science 2024-06-04 Chujie Zheng , Fan Yin , Hao Zhou , Fandong Meng , Jie Zhou , Kai-Wei Chang , Minlie Huang , Nanyun Peng

Large language models (LLMs) have demonstrated impressive capabilities in code generation, achieving high scores on benchmarks such as HumanEval and MBPP. However, these benchmarks primarily assess functional correctness and neglect broader…

Software Engineering · Computer Science 2025-08-21 Scott Blyth , Sherlock A. Licorish , Christoph Treude , Markus Wagner

The robustness and security of large language models (LLMs) has become a prominent research area. One notable vulnerability is the ability to bypass LLM safeguards by translating harmful queries into rare or underrepresented languages, a…

Computation and Language · Computer Science 2025-09-16 Hongliang Li , Jinan Xu , Gengping Cui , Changhao Guan , Fengran Mo , Kaiyu Huang

Vulnerability detection is crucial to protect software security. Nowadays, deep learning (DL) is the most promising technique to automate this detection task, leveraging its superior ability to extract patterns and representations within…

Software Engineering · Computer Science 2026-02-13 Yuejun Guo , Qiang Hu , Qiang Tang , Yves Le Traon

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

Machine Learning · Computer Science 2025-01-27 Bolian Li , Ruqi Zhang