中文
相关论文

相关论文: A Framework for Real-time Safeguarding the Text Ge…

200 篇论文

As Large Language Models (LLMs) become increasingly integrated into many technological ecosystems across various domains and industries, identifying which model is deployed or being interacted with is critical for the security and…

密码学与安全 · 计算机科学 2025-07-09 Saeif Alhazbi , Ahmed Mohamed Hussain , Gabriele Oligeri , Panos Papadimitratos

The code generation capabilities of large language models(LLMs) have emerged as a critical dimension in evaluating their overall performance. However, prior research has largely overlooked the security risks inherent in the generated code.…

密码学与安全 · 计算机科学 2025-06-23 Xinghang Li , Jingzhe Ding , Chao Peng , Bing Zhao , Xiang Gao , Hongwan Gao , Xinchen Gu

Large language models (LLMs) are increasingly deployed in high-stakes domains, yet a unified treatment of their overlapping safety challenges remains lacking. We present SafeLM, a framework that jointly addresses four pillars of LLM safety:…

密码学与安全 · 计算机科学 2026-04-21 Noor Islam S. Mohammad , Uluğ Bayazıt

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Large Language Models (LLMs) can translate natural language requirements into code, yet empirical analyses of representative models reveal that semantic errors-programs that compile but behave incorrectly-constitute the majority of observed…

软件工程 · 计算机科学 2025-09-30 Qinglin Wang , Zhihong Sun , Ruyun Wang , Tao Huang , Zhi Jin , Ge Li , Chen Lyu

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

计算与语言 · 计算机科学 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Large Language Models (LLMs) have rapidly become integral to numerous applications in critical domains where reliability is paramount. Despite significant advances in safety frameworks and guardrails, current protective measures exhibit…

密码学与安全 · 计算机科学 2025-04-15 Bibek Upadhayay , Vahid Behzadan , Ph. D

As Large Language Models (LLMs) grow increasingly powerful, ensuring their safety and alignment with human values remains a critical challenge. Ideally, LLMs should provide informative responses while avoiding the disclosure of harmful or…

计算与语言 · 计算机科学 2024-10-04 Lingrui Mei , Shenghua Liu , Yiwei Wang , Baolong Bi , Ruibin Yuan , Xueqi Cheng

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Large language models (LLMs) commonly risk copyright infringement by reproducing protected content verbatim or with insufficient transformative modifications, posing significant ethical, legal, and practical concerns. Current inference-time…

As Large Language Models (LLMs) become more integrated into our daily lives, it is crucial to identify and mitigate their risks, especially when the risks can have profound impacts on human users and societies. Guardrails, which filter the…

计算与语言 · 计算机科学 2024-05-30 Yi Dong , Ronghui Mu , Gaojie Jin , Yi Qi , Jinwei Hu , Xingyu Zhao , Jie Meng , Wenjie Ruan , Xiaowei Huang

Language model detoxification aims to minimize the risk of generating offensive or harmful content in pretrained language models (PLMs) for safer deployment. Existing methods can be roughly categorized as finetuning-based and…

计算与语言 · 计算机科学 2023-10-17 Chak Tou Leong , Yi Cheng , Jiashuo Wang , Jian Wang , Wenjie Li

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

计算与语言 · 计算机科学 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

Recent advances in LLMs have enhanced AI capabilities, but also increased the risk posed by malicious requests, highlighting the need for effective LLM safeguards to detect such queries. Existing approaches largely rely on classifier-based…

计算与语言 · 计算机科学 2025-10-14 Zhuowei Chen , Bowei Zhang , Nankai Lin , Tian Hou , Lianxi Wang

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

机器学习 · 计算机科学 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng

We introduce Llama Guard, an LLM-based input-output safeguard model geared towards Human-AI conversation use cases. Our model incorporates a safety risk taxonomy, a valuable tool for categorizing a specific set of safety risks found in LLM…

The security issue of large language models (LLMs) has gained wide attention recently, with various defense mechanisms developed to prevent harmful output, among which safeguards based on text embedding models serve as a fundamental…

计算与语言 · 计算机科学 2025-05-20 Haoyu Liang , Youran Sun , Yunfeng Cai , Jun Zhu , Bo Zhang

As Large Language Models (LLMs) achieve remarkable success across a wide range of applications, such as chatbots and code copilots, concerns surrounding the generation of harmful content have come increasingly into focus. Despite…

计算与语言 · 计算机科学 2025-09-30 Wenjie Fu , Huandong Wang , Junyao Gao , Guoan Wan , Tao Jiang

Backdoor attacks pose a significant threat to Large Language Models (LLMs), where adversaries can embed hidden triggers to manipulate LLM's outputs. Most existing defense methods, primarily designed for classification tasks, are ineffective…

密码学与安全 · 计算机科学 2025-11-12 Zihan Wang , Rui Zhang , Hongwei Li , Wenshu Fan , Wenbo Jiang , Qingchuan Zhao , Guowen Xu