English
Related papers

Related papers: Detection Method for Prompt Injection by Integrati…

200 papers

The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in…

Cryptography and Security · Computer Science 2024-02-21 Zeyang Sha , Yang Zhang

Large Language Models (LLMs) are increasingly being integrated into the scientific peer-review process, raising new questions about their reliability and resilience to manipulation. In this work, we investigate the potential for hidden…

Cryptography and Security · Computer Science 2026-03-31 Matteo Gioele Collu , Umberto Salviati , Roberto Confalonieri , Mauro Conti , Giovanni Apruzzese

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

Machine Learning · Computer Science 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

The detection of abusive language remains a long-standing challenge with the extensive use of social networks. The detection task of abusive language suffers from limited accuracy. We argue that the existing detection methods utilize the…

Computation and Language · Computer Science 2024-06-25 Jian Zhu , Yuping Ruan , Jingfei Chang , Wenhui Sun , Hui Wan , Jian Long , Cheng Luo

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

Computation and Language · Computer Science 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

The effectiveness of machine learning models is significantly affected by the size of the dataset and the quality of features as redundant and irrelevant features can radically degrade the performance. This paper proposes IGRF-RFE: a hybrid…

Machine Learning · Computer Science 2023-02-07 Yuhua Yin , Julian Jang-Jaccard , Wen Xu , Amardeep Singh , Jinting Zhu , Fariza Sabrina , Jin Kwak

Large Language Models (LLMs) have gained widespread use in various applications due to their powerful capability to generate human-like text. However, prompt injection attacks, which involve overwriting a model's original instructions with…

Cryptography and Security · Computer Science 2025-04-07 Jiahao Yu , Yangguang Shao , Hanwen Miao , Junzheng Shi

The dynamic expansion of social media has led to an inundation of hateful memes on media platforms, accentuating the growing need for efficient identification and removal. Acknowledging the constraints of conventional multimodal hateful…

Computation and Language · Computer Science 2025-03-06 Junxi Liu , Yanyan Feng , Jiehai Chen , Yun Xue , Fenghuan Li

Recent intelligent systems integrate powerful Large Language Models (LLMs) through APIs, but their trustworthiness may be critically undermined by targeted attacks like backdoor and prompt injection attacks, which secretly force LLMs to…

Cryptography and Security · Computer Science 2026-03-03 Xiaoyi Pang , Xuanyi Hao , Pengyu Liu , Qi Luo , Song Guo , Zhibo Wang

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

Cryptography and Security · Computer Science 2025-10-15 Dominik Schwarz

Dynamic analysis methods effectively identify shelled, wrapped, or obfuscated malware, thereby preventing them from invading computers. As a significant representation of dynamic malware behavior, the API (Application Programming Interface)…

Cryptography and Security · Computer Science 2023-12-14 Pei Yan , Shunquan Tan , Miaohui Wang , Jiwu Huang

Machine learning has become an appealing signature-less approach to detect and classify malware because of its ability to generalize to never-before-seen samples and to handle large volumes of data. While traditional feature-based…

Cryptography and Security · Computer Science 2024-04-30 Daniel Gibert , Carles Mateu , Jordi Planes , Quan Le

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

The advancement of Pre-Trained Language Models (PTLMs) and Large Language Models (LLMs) has led to their widespread adoption across diverse applications. Despite their success, these models remain vulnerable to attacks that exploit their…

Computation and Language · Computer Science 2025-06-30 Mohamed Ahmed , Mohamed Abdelmouty , Mingyu Kim , Gunvanth Kandula , Alex Park , James C. Davis

Vision-language pretraining (VLP) with transformers has demonstrated exceptional performance across numerous multimodal tasks. However, the adversarial robustness of these models has not been thoroughly investigated. Existing multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiwei Guan , Tianyu Ding , Longbing Cao , Lei Pan , Chen Wang , Xi Zheng

The rapid expansion of electric vehicles has intensified the need for accurate and efficient diagnosis of lithium-ion batteries. Parameter identification of electrochemical battery models is widely recognized as a powerful method for…

Machine Learning · Computer Science 2025-10-29 Hojin Cheon , Hyeongseok Seo , Jihun Jeon , Wooju Lee , Dohyun Jeong , Hongseok Kim

With the rapid development of Large Language Models (LLMs), numerous mature applications of LLMs have emerged in the field of content safety detection. However, we have found that LLMs exhibit blind trust in safety detection agents. The…

Cryptography and Security · Computer Science 2024-10-15 Yupeng Ren

The proliferation of hate speech on social media poses a significant threat to online communities, requiring effective detection systems. While deep learning models have shown promise, their performance often deteriorates in few-shot or…

Computation and Language · Computer Science 2025-04-23 Zhenkai Qin , Dongze Wu , Yuxin Liu , Guifang Yang

Prompt-based adversarial attacks have become an effective means to assess the robustness of large language models (LLMs). However, existing approaches often treat prompts as monolithic text, overlooking their structural…

Computation and Language · Computer Science 2025-08-05 Yujia Zheng , Tianhao Li , Haotian Huang , Tianyu Zeng , Jingyu Lu , Chuangxin Chu , Yuekai Huang , Ziyou Jiang , Qian Xiong , Yuyao Ge , Mingyang Li