English
Related papers

Related papers: Masked Language Model Based Textual Adversarial Ex…

200 papers

Large Language Models(LLMs) are increasingly explored for cybersecurity applications such as vulnerability detection. In the domain of threat modelling, prior work has primarily evaluated a number of general-purpose Large Language Models…

Cryptography and Security · Computer Science 2026-05-12 Saba Pourhanifeh , AbdulAziz AbdulGhaffar , Ashraf Matrawy

Recently, advanced NLP models have seen a surge in the usage of various applications. This raises the security threats of the released models. In addition to the clean models' unintentional weaknesses, {\em i.e.,} adversarial attacks, the…

Computation and Language · Computer Science 2021-01-18 Lichao Sun

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Recent attacks on Machine Learning (ML) models such as evasion attacks with adversarial examples and models stealing through extraction attacks pose several security and privacy threats. Prior work proposes to use adversarial training to…

Machine Learning · Computer Science 2022-08-23 Kacem Khaled , Gabriela Nicolescu , Felipe Gohring de Magalhães

Existing attacks against multimodal language models (MLLMs) primarily communicate instructions through text accompanied by adversarial images. In contrast, we exploit the capabilities of MLLMs to interpret non-textual instructions,…

Cryptography and Security · Computer Science 2025-06-03 Jiahui Geng , Thy Thy Tran , Preslav Nakov , Iryna Gurevych

It is well established that neural networks are vulnerable to adversarial examples, which are almost imperceptible on human vision and can cause the deep models misbehave. Such phenomenon may lead to severely inestimable consequences in the…

Machine Learning · Computer Science 2020-09-09 Dengpan Ye , Chuanxi Chen , Changrui Liu , Hao Wang , Shunzhi Jiang

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

Computation and Language · Computer Science 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

Anomaly detection aims to identify samples that deviate from the nominal data distribution and is central to many safety-critical applications. However, developing effective anomaly detection methods for categorical, mixed-type, and…

Machine Learning · Computer Science 2026-05-29 Lixing Zhang , Yuchen Liang , Liyan Xie

Model extraction attacks pose significant security threats to deployed language models, potentially compromising intellectual property and user privacy. This survey provides a comprehensive taxonomy of LLM-specific extraction attacks and…

Cryptography and Security · Computer Science 2025-07-09 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Despite being popularly used in many applications, neural network models have been found to be vulnerable to adversarial examples, i.e., carefully crafted examples aiming to mislead machine learning models. Adversarial examples can pose…

Machine Learning · Computer Science 2019-07-30 Siwakorn Srisakaokul , Yuhao Zhang , Zexuan Zhong , Wei Yang , Tao Xie , Bo Li

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

Large Language Models (LLMs) have recently demonstrated significant potential in time series forecasting, offering impressive capabilities in handling complex temporal data. However, their robustness and reliability in real-world…

Machine Learning · Computer Science 2025-03-14 Fuqiang Liu , Sicong Jiang , Luis Miranda-Moreno , Seongjin Choi , Lijun Sun

With the growing popularity of artificial intelligence and machine learning, a wide spectrum of attacks against deep learning models have been proposed in the literature. Both the evasion attacks and the poisoning attacks attempt to utilize…

Cryptography and Security · Computer Science 2022-08-16 Zeyan Liu , Fengjun Li , Jingqiang Lin , Zhu Li , Bo Luo

As Speech Large Language Models (Speech LLMs) become increasingly integrated into voice-based applications, ensuring their robustness against manipulative or adversarial input becomes critical. Although prior work has studied adversarial…

Computation and Language · Computer Science 2026-05-25 Jinyang Wu , Bin Zhu , Xiandong Zou , Qiquan Zhang , Xu Fang , Pan Zhou

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

Computation and Language · Computer Science 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

Recent advancements in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks. While various defence mechanisms have been proposed, there is a lack of comprehensive benchmarks that…

Computation and Language · Computer Science 2025-01-23 Yang Wang , Chenghua Lin

The widespread adoption of smartphones dramatically increases the risk of attacks and the spread of mobile malware, especially on the Android platform. Machine learning-based solutions have been already used as a tool to supersede…

Cryptography and Security · Computer Science 2020-03-03 Rahim Taheri , Reza Javidan , Mohammad Shojafar , Vinod P , Mauro Conti

ML models are known to be vulnerable to adversarial query attacks. In these attacks, queries are iteratively perturbed towards a particular class without any knowledge of the target model besides its output. The prevalence of…

Machine Learning · Computer Science 2023-07-03 Aqib Rashid , Jose Such

Multimodal large language models (MLLMs) are gaining increasing attention. Due to the heterogeneity of their input features, they face significant challenges in terms of jailbreak defenses. Current defense methods rely on costly fine-tuning…

Artificial Intelligence · Computer Science 2026-05-13 Xinyi Zeng , Xue Yang , Jingyuan Zhang , Huanqian Yan , Xiang Chen , Kaiwen Wei , Hankun Kang , Yu Tian