中文
相关论文

相关论文: Detection Method for Prompt Injection by Integrati…

200 篇论文

The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in…

密码学与安全 · 计算机科学 2024-02-21 Zeyang Sha , Yang Zhang

Large Language Models (LLMs) are increasingly being integrated into the scientific peer-review process, raising new questions about their reliability and resilience to manipulation. In this work, we investigate the potential for hidden…

密码学与安全 · 计算机科学 2026-03-31 Matteo Gioele Collu , Umberto Salviati , Roberto Confalonieri , Mauro Conti , Giovanni Apruzzese

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

机器学习 · 计算机科学 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

计算与语言 · 计算机科学 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

The detection of abusive language remains a long-standing challenge with the extensive use of social networks. The detection task of abusive language suffers from limited accuracy. We argue that the existing detection methods utilize the…

计算与语言 · 计算机科学 2024-06-25 Jian Zhu , Yuping Ruan , Jingfei Chang , Wenhui Sun , Hui Wan , Jian Long , Cheng Luo

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

计算与语言 · 计算机科学 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

The effectiveness of machine learning models is significantly affected by the size of the dataset and the quality of features as redundant and irrelevant features can radically degrade the performance. This paper proposes IGRF-RFE: a hybrid…

机器学习 · 计算机科学 2023-02-07 Yuhua Yin , Julian Jang-Jaccard , Wen Xu , Amardeep Singh , Jinting Zhu , Fariza Sabrina , Jin Kwak

Large Language Models (LLMs) have gained widespread use in various applications due to their powerful capability to generate human-like text. However, prompt injection attacks, which involve overwriting a model's original instructions with…

密码学与安全 · 计算机科学 2025-04-07 Jiahao Yu , Yangguang Shao , Hanwen Miao , Junzheng Shi

The dynamic expansion of social media has led to an inundation of hateful memes on media platforms, accentuating the growing need for efficient identification and removal. Acknowledging the constraints of conventional multimodal hateful…

计算与语言 · 计算机科学 2025-03-06 Junxi Liu , Yanyan Feng , Jiehai Chen , Yun Xue , Fenghuan Li

Recent intelligent systems integrate powerful Large Language Models (LLMs) through APIs, but their trustworthiness may be critically undermined by targeted attacks like backdoor and prompt injection attacks, which secretly force LLMs to…

密码学与安全 · 计算机科学 2026-03-03 Xiaoyi Pang , Xuanyi Hao , Pengyu Liu , Qi Luo , Song Guo , Zhibo Wang

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

密码学与安全 · 计算机科学 2025-10-15 Dominik Schwarz

Dynamic analysis methods effectively identify shelled, wrapped, or obfuscated malware, thereby preventing them from invading computers. As a significant representation of dynamic malware behavior, the API (Application Programming Interface)…

密码学与安全 · 计算机科学 2023-12-14 Pei Yan , Shunquan Tan , Miaohui Wang , Jiwu Huang

Machine learning has become an appealing signature-less approach to detect and classify malware because of its ability to generalize to never-before-seen samples and to handle large volumes of data. While traditional feature-based…

密码学与安全 · 计算机科学 2024-04-30 Daniel Gibert , Carles Mateu , Jordi Planes , Quan Le

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

The advancement of Pre-Trained Language Models (PTLMs) and Large Language Models (LLMs) has led to their widespread adoption across diverse applications. Despite their success, these models remain vulnerable to attacks that exploit their…

计算与语言 · 计算机科学 2025-06-30 Mohamed Ahmed , Mohamed Abdelmouty , Mingyu Kim , Gunvanth Kandula , Alex Park , James C. Davis

Vision-language pretraining (VLP) with transformers has demonstrated exceptional performance across numerous multimodal tasks. However, the adversarial robustness of these models has not been thoroughly investigated. Existing multimodal…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Jiwei Guan , Tianyu Ding , Longbing Cao , Lei Pan , Chen Wang , Xi Zheng

The rapid expansion of electric vehicles has intensified the need for accurate and efficient diagnosis of lithium-ion batteries. Parameter identification of electrochemical battery models is widely recognized as a powerful method for…

机器学习 · 计算机科学 2025-10-29 Hojin Cheon , Hyeongseok Seo , Jihun Jeon , Wooju Lee , Dohyun Jeong , Hongseok Kim

With the rapid development of Large Language Models (LLMs), numerous mature applications of LLMs have emerged in the field of content safety detection. However, we have found that LLMs exhibit blind trust in safety detection agents. The…

密码学与安全 · 计算机科学 2024-10-15 Yupeng Ren

The proliferation of hate speech on social media poses a significant threat to online communities, requiring effective detection systems. While deep learning models have shown promise, their performance often deteriorates in few-shot or…

计算与语言 · 计算机科学 2025-04-23 Zhenkai Qin , Dongze Wu , Yuxin Liu , Guifang Yang

Prompt-based adversarial attacks have become an effective means to assess the robustness of large language models (LLMs). However, existing approaches often treat prompts as monolithic text, overlooking their structural…