中文
相关论文

相关论文: Unveiling Safety Vulnerabilities of Large Language…

200 篇论文

As generative large model capabilities advance, safety concerns become more pronounced in their outputs. To ensure the sustainable growth of the AI ecosystem, it's imperative to undertake a holistic evaluation and refinement of associated…

人工智能 · 计算机科学 2023-12-01 Jiawen Deng , Jiale Cheng , Hao Sun , Zhexin Zhang , Minlie Huang

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

计算与语言 · 计算机科学 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

As large language models (LLMs) expose systemic security challenges in high risk applications, including privacy leaks, bias amplification, and malicious abuse, there is an urgent need for a dynamic risk assessment and collaborative defence…

密码学与安全 · 计算机科学 2026-02-05 Xiaoyan Zhang , Dongyang Lyu , Xiaoqi Li

Large Language Models (LLMs) transform artificial intelligence, driving advancements in natural language understanding, text generation, and autonomous systems. The increasing complexity of their development and deployment introduces…

密码学与安全 · 计算机科学 2025-02-19 Shenao Wang , Yanjie Zhao , Zhao Liu , Quanchen Zou , Haoyu Wang

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

Large Language Models (LLMs) have transformed natural language processing (NLP) by enabling robust text generation and understanding. However, their deployment in sensitive domains like healthcare, finance, and legal services raises…

人工智能 · 计算机科学 2024-12-09 Georgios Feretzakis , Vassilios S. Verykios

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

计算与语言 · 计算机科学 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

As large language models (LLMs) permeate more and more applications, an assessment of their associated security risks becomes increasingly necessary. The potential for exploitation by malicious actors, ranging from disinformation to data…

密码学与安全 · 计算机科学 2024-09-24 Erik Derner , Kristina Batistič , Jan Zahálka , Robert Babuška

Large Language Models (LLMs) are deployed in interactive contexts with direct user engagement, such as chatbots and writing assistants. These deployments are vulnerable to prompt injection and jailbreaking (collectively, prompt hacking), in…

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

计算与语言 · 计算机科学 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine translation, and conversational systems. Despite their transformative potential, these models…

密码学与安全 · 计算机科学 2025-08-05 Kang Chen , Xiuze Zhou , Yuanguo Lin , Jinhe Su , Yuanhui Yu , Li Shen , Fan Lin

Despite the rapid progress of Large Vision-Language Models (LVLMs), the integration of visual modalities introduces new safety vulnerabilities that adversaries can exploit to elicit biased or malicious outputs. In this paper, we demonstrate…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Chenxi Li , Xianggan Liu , Dake Shen , Yaosong Du , Zhibo Yao , Hao Jiang , Linyi Jiang , Chengwei Cao , Jingzhe Zhang , RanYi Peng , Peiling Bai , Xiande Huang

With the rapid evolution of large language models (LLMs), new and hard-to-predict harmful capabilities are emerging. This requires developers to be able to identify risks through the evaluation of "dangerous capabilities" in order to…

计算与语言 · 计算机科学 2023-09-06 Yuxia Wang , Haonan Li , Xudong Han , Preslav Nakov , Timothy Baldwin

This paper introduces RiskCards, a framework for structured assessment and documentation of risks associated with an application of language models. As with all language, text generated by language models can be harmful, or used to bring…

Large language models (LLMs) have demonstrated impressive results on natural language tasks, and security researchers are beginning to employ them in both offensive and defensive systems. In cyber-security, there have been multiple research…

密码学与安全 · 计算机科学 2024-03-05 Jiacen Xu , Jack W. Stokes , Geoff McDonald , Xuesong Bai , David Marshall , Siyue Wang , Adith Swaminathan , Zhou Li

In this paper, we introduce SecQA, a novel dataset tailored for evaluating the performance of Large Language Models (LLMs) in the domain of computer security. Utilizing multiple-choice questions generated by GPT-4 based on the "Computer…

计算与语言 · 计算机科学 2023-12-27 Zefang Liu

Most prior safety research of large language models (LLMs) has focused on enhancing the alignment of LLMs to better suit the safety requirements of humans. However, internalizing such safeguard features into larger models brought challenges…

计算与语言 · 计算机科学 2025-01-24 Ohjoon Kwon , Donghyeon Jeon , Nayoung Choi , Gyu-Hwung Cho , Changbong Kim , Hyunwoo Lee , Inho Kang , Sun Kim , Taiwoo Park

The growing use of large language models (LLMs) has raised concerns regarding their safety. While many studies have focused on English, the safety of LLMs in Arabic, with its linguistic and cultural complexities, remains under-explored.…

计算与语言 · 计算机科学 2025-02-11 Yasser Ashraf , Yuxia Wang , Bin Gu , Preslav Nakov , Timothy Baldwin

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

人工智能 · 计算机科学 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

As Large Language Models (LLMs) are increasingly deployed in sensitive domains, traditional data privacy measures prove inadequate for protecting information that is implicit, contextual, or inferable - what we define as semantic privacy.…

密码学与安全 · 计算机科学 2025-07-17 Baihe Ma , Yanna Jiang , Xu Wang , Guangsheng Yu , Qin Wang , Caijun Sun , Chen Li , Xuelei Qi , Ying He , Wei Ni , Ren Ping Liu