中文
相关论文

相关论文: Efficient Detection of Toxic Prompts in Large Lang…

200 篇论文

Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content…

计算与语言 · 计算机科学 2025-07-08 Chinnappa Guggilla , Budhaditya Roy , Trupti Ramdas Chavan , Abdul Rahman , Edward Bowen

With the expanding application of Large Language Models (LLMs) in various domains, it becomes imperative to comprehensively investigate their unforeseen behaviors and consequent outcomes. In this study, we introduce and systematically…

计算与语言 · 计算机科学 2024-04-22 Yuxi Li , Yi Liu , Gelei Deng , Ying Zhang , Wenjia Song , Ling Shi , Kailong Wang , Yuekang Li , Yang Liu , Haoyu Wang

Recent advances in natural language processing (NLP) have led to the development of large language models (LLMs) such as ChatGPT. This paper proposes a methodology for developing and evaluating ChatGPT detectors for French text, with a…

计算与语言 · 计算机科学 2023-06-12 Wissam Antoun , Virginie Mouilleron , Benoît Sagot , Djamé Seddah

Large language models (LLMs) have shown incredible capabilities and transcended the natural language processing (NLP) community, with adoption throughout many services like healthcare, therapy, education, and customer service. Since users…

计算与语言 · 计算机科学 2023-04-12 Ameet Deshpande , Vishvak Murahari , Tanmay Rajpurohit , Ashwin Kalyan , Karthik Narasimhan

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

软件工程 · 计算机科学 2025-03-20 Priscylla Silva , Evandro Costa

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

计算与语言 · 计算机科学 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

The rapid growth of social media platforms has raised significant concerns regarding online content toxicity. When Large Language Models (LLMs) are used for toxicity detection, two key challenges emerge: 1) the absence of domain-specific…

计算与语言 · 计算机科学 2025-06-03 Yibo Zhao , Jiapeng Zhu , Can Xu , Yao Liu , Xiang Li

Large language models (LLMs) have demonstrated remarkable capability to generate fluent responses to a wide variety of user queries. However, this has also raised concerns about the potential misuse of such texts in journalism, education,…

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's…

Software vulnerability detection is generally supported by automated static analysis tools, which have recently been reinforced by deep learning (DL) models. However, despite the superior performance of DL-based approaches over rule-based…

软件工程 · 计算机科学 2024-05-03 Yanjing Yang , Xin Zhou , Runfeng Mao , Jinwei Xu , Lanxin Yang , Yu Zhangm , Haifeng Shen , He Zhang

Large Language Models (LLMs) have performed exceptionally in various text-generative tasks, including question answering, translation, code completion, etc. However, the over-assistance of LLMs has raised the challenge of "jailbreaking",…

密码学与安全 · 计算机科学 2024-09-02 Sibo Yi , Yule Liu , Zhen Sun , Tianshuo Cong , Xinlei He , Jiaxing Song , Ke Xu , Qi Li

With the rapid popularity of large language models such as ChatGPT and GPT-4, a growing amount of attention is paid to their safety concerns. These models may generate insulting and discriminatory content, reflect incorrect social values,…

计算与语言 · 计算机科学 2023-04-21 Hao Sun , Zhexin Zhang , Jiawen Deng , Jiale Cheng , Minlie Huang

Large Language Models (LLMs) are seeing significant adoption in every type of organization due to their exceptional generative capabilities. However, LLMs are found to be vulnerable to various adversarial attacks, particularly prompt…

密码学与安全 · 计算机科学 2024-10-30 Md. Ahsan Ayub , Subhabrata Majumdar

Large Language Models (LLMs) have gained significant attention but also raised concerns due to the risk of misuse. Jailbreak prompts, a popular type of adversarial attack towards LLMs, have appeared and constantly evolved to breach the…

人机交互 · 计算机科学 2024-07-04 Zhihua Jin , Shiyi Liu , Haotian Li , Xun Zhao , Huamin Qu

Large Language Models (LLMs) are redefining offensive cybersecurity by allowing the generation of harmful machine code with minimal human intervention. While attackers take advantage of dark LLMs such as XXXGPT and WolfGPT to produce…

密码学与安全 · 计算机科学 2026-04-14 Ricardo Bessa , Rui Claro , João Trindade , João Lourenço

Enterprise security faces escalating threats from sophisticated malware, compounded by expanding digital operations. This paper presents the first systematic evaluation of large language models (LLMs) to proactively identify indicators of…

密码学与安全 · 计算机科学 2026-01-15 Aniesh Chawla , Udbhav Prasad

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

计算与语言 · 计算机科学 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

计算与语言 · 计算机科学 2024-10-08 Ziyang Chen , Stylios Moscholios

Large Language Models (LLMs) are increasingly being integrated into services such as ChatGPT to provide responses to user queries. To mitigate potential harm and prevent misuse, there have been concerted efforts to align the LLMs with human…

密码学与安全 · 计算机科学 2024-12-30 Xiaomeng Hu , Pin-Yu Chen , Tsung-Yi Ho

The systems and software powered by Large Language Models (LLMs) and Multi-Modal LLMs (MLLMs) have played a critical role in numerous scenarios. However, current LLM systems are vulnerable to prompt-based attacks, with jailbreaking attacks…

密码学与安全 · 计算机科学 2025-03-18 Xiaoyu Zhang , Cen Zhang , Tianlin Li , Yihao Huang , Xiaojun Jia , Ming Hu , Jie Zhang , Yang Liu , Shiqing Ma , Chao Shen