中文
相关论文

相关论文: Large Language Models Are Involuntary Truth-Teller…

200 篇论文

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

密码学与安全 · 计算机科学 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interactions. In this paper, we…

计算与语言 · 计算机科学 2025-12-19 Stephen Obadinma , Xiaodan Zhu

Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing…

计算与语言 · 计算机科学 2025-01-29 Yue Huang , Jingyu Tang , Dongping Chen , Bingda Tang , Yao Wan , Lichao Sun , Philip S. Yu , Xiangliang Zhang

The rapid progress of Large Language Models (LLMs) has opened up new opportunities across various domains and applications; yet it also presents challenges related to potential misuse. To mitigate such risks, red teaming has been employed…

密码学与安全 · 计算机科学 2025-06-10 Yifan Jiang , Kriti Aggarwal , Tanmay Laud , Kashif Munir , Jay Pujara , Subhabrata Mukherjee

Large Language Models (LLMs) are implicit troublemakers. While they provide valuable insights and assist in problem-solving, they can also potentially serve as a resource for malicious activities. Implementing safety alignment could…

密码学与安全 · 计算机科学 2024-08-27 Haoyu Wang , Bingzhe Wu , Yatao Bian , Yongzhe Chang , Xueqian Wang , Peilin Zhao

Despite the outstanding performance of Large language Models (LLMs) in diverse tasks, they are vulnerable to jailbreak attacks, wherein adversarial prompts are crafted to bypass their security mechanisms and elicit unexpected responses.…

密码学与安全 · 计算机科学 2025-04-25 Zeqing He , Zhibo Wang , Zhixuan Chu , Huiyu Xu , Wenhui Zhang , Qinglong Wang , Rui Zheng

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

计算与语言 · 计算机科学 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

密码学与安全 · 计算机科学 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

计算与语言 · 计算机科学 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Large Language Models (LLMs) are now widely used in various applications, making it crucial to align their ethical standards with human values. However, recent jail-breaking methods demonstrate that this alignment can be undermined using…

密码学与安全 · 计算机科学 2023-12-11 Zhuo Zhang , Guangyu Shen , Guanhong Tao , Siyuan Cheng , Xiangyu Zhang

Large Language Models (LLMs) are effective at deceiving, when prompted to do so. But under what conditions do they deceive spontaneously? Models that demonstrate better performance on reasoning tasks are also better at prompted deception.…

计算与语言 · 计算机科学 2025-04-02 Samuel M. Taylor , Benjamin K. Bergen

Large language models (LLMs) have been increasingly applied to various domains, which triggers increasing concerns about LLMs' safety on specialized domains, e.g. medicine. Despite prior explorations on general jailbreaking attacks, there…

计算与语言 · 计算机科学 2025-06-10 Shangqing Tu , Zhuoran Pan , Wenxuan Wang , Zhexin Zhang , Yuliang Sun , Jifan Yu , Hongning Wang , Lei Hou , Juanzi Li

Mechanistic approaches to deception in large language models (LLMs) often rely on "lie detectors", that is, truth probes trained to identify internal representations of model outputs as false. The lie detector approach to LLM deception…

计算与语言 · 计算机科学 2026-03-12 Tom-Felix Berger

As Large Language Models (LLMs) of Prompt Jailbreaking are getting more and more attention, it is of great significance to raise a generalized research paradigm to evaluate attack strengths and a basic model to conduct subtler experiments.…

密码学与安全 · 计算机科学 2024-04-15 Tianyu Zhang , Zixuan Zhao , Jiaqi Huang , Jingyu Hua , Sheng Zhong

The widespread adoption of Large Language Models (LLMs) has heightened concerns about their security, particularly their vulnerability to jailbreak attacks that leverage crafted prompts to generate malicious outputs. While prior research…

密码学与安全 · 计算机科学 2025-06-13 Haoyang Li , Huan Gao , Zhiyuan Zhao , Zhiyu Lin , Junyu Gao , Xuelong Li

In recent years, large language models (LLMs) have demonstrated notable success across various tasks, but the trustworthiness of LLMs is still an open problem. One specific threat is the potential to generate toxic or harmful responses.…

密码学与安全 · 计算机科学 2024-06-11 Tong Liu , Yingjie Zhang , Zhe Zhao , Yinpeng Dong , Guozhu Meng , Kai Chen

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulnerabilities.…

计算与语言 · 计算机科学 2024-06-27 Ziqiu Wang , Jun Liu , Shengkai Zhang , Yang Yang

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

人工智能 · 计算机科学 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li

Large language models (LLMs) are improving at an exceptional rate. However, these models are still susceptible to jailbreak attacks, which are becoming increasingly dangerous as models become increasingly powerful. In this work, we…

Large Language Models (LLMs) remain vulnerable to jailbreak attacks that bypass their safety mechanisms. Existing attack methods are fixed or specifically tailored for certain models and cannot flexibly adjust attack strength, which is…

密码学与安全 · 计算机科学 2024-10-08 Yiting Dong , Guobin Shen , Dongcheng Zhao , Xiang He , Yi Zeng