English
Related papers

Related papers: Robust Safety Classifier for Large Language Models…

200 papers

We propose a method to generate audio adversarial examples that can attack a state-of-the-art speech recognition model in the physical world. Previous work assumes that generated adversarial examples are directly fed to the recognition…

Machine Learning · Computer Science 2019-08-20 Hiromu Yakura , Jun Sakuma

While many defences against adversarial examples have been proposed, finding robust machine learning models is still an open problem. The most compelling defence to date is adversarial training and consists of complementing the training…

Machine Learning · Computer Science 2021-05-27 Alex Serban , Erik Poll , Joost Visser

Large language models (LLMs) are vulnerable to adversarial attacks that add malicious tokens to an input prompt to bypass the safety guardrails of an LLM and cause it to produce harmful content. In this work, we introduce erase-and-check,…

Computation and Language · Computer Science 2025-02-06 Aounon Kumar , Chirag Agarwal , Suraj Srinivas , Aaron Jiaxun Li , Soheil Feizi , Himabindu Lakkaraju

Warning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detection models with the intention of identifying and mitigating…

Computation and Language · Computer Science 2022-05-06 Ninareh Mehrabi , Ahmad Beirami , Fred Morstatter , Aram Galstyan

Automatic Essay Scoring (AES) is widely used to evaluate candidates for educational purposes. However, due to the lack of representative data, most existing AES systems are not robust, and their scoring predictions are biased towards the…

Computation and Language · Computer Science 2024-09-10 Haddad Philip , Tsegaye Misikir Tashu

Deep learning algorithms have become an essential component in the field of cognitive radio, especially playing a pivotal role in automatic modulation classification. However, Deep learning also present risks and vulnerabilities. Despite…

Signal Processing · Electrical Eng. & Systems 2024-02-28 Tailai Wen , Da Ke , Xiang Wang , Zhitao Huang

Due to the development of machine learning and speech processing, speech emotion recognition has been a popular research topic in recent years. However, the speech data cannot be protected when it is uploaded and processed on servers in the…

Sound · Computer Science 2022-03-10 Yi Chang , Sofiane Laridi , Zhao Ren , Gregory Palmer , Björn W. Schuller , Marco Fisichella

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Although safely enhanced Large Language Models (LLMs) have achieved remarkable success in tackling various complex tasks in a zero-shot manner, they remain susceptible to jailbreak attacks, particularly the unknown jailbreak attack. To…

Computation and Language · Computer Science 2024-06-12 Fan Liu , Zhao Xu , Hao Liu

Pre-trained language models (PLMs) have consistently demonstrated outstanding performance across a diverse spectrum of natural language processing tasks. Nevertheless, despite their success with unseen data, current PLM-based…

Computation and Language · Computer Science 2024-03-19 Javad Rafiei Asl , Prajwal Panzade , Eduardo Blanco , Daniel Takabi , Zhipeng Cai

Voice biometric systems based on automatic speaker verification (ASV) are exposed to \textit{spoofing} attacks which may compromise their security. To increase the robustness against such attacks, anti-spoofing or presentation attack…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-05 Alejandro Gomez-Alanis , Jose A. Gonzalez-Lopez , Antonio M. Peinado

Autonomous driving systems (ADS) increasingly rely on deep learning-based perception models, which remain vulnerable to adversarial attacks. In this paper, we revisit adversarial attacks and defense methods, focusing on road sign…

Robotics · Computer Science 2025-05-26 Cheng Chen , Yuhong Wang , Nafis S Munir , Xiangwei Zhou , Xugui Zhou

Transformer-based models, such as BERT and GPT, have been widely adopted in natural language processing (NLP) due to their exceptional performance. However, recent studies show their vulnerability to textual adversarial attacks where the…

Computation and Language · Computer Science 2023-12-01 Lujia Shen , Yuwen Pu , Shouling Ji , Changjiang Li , Xuhong Zhang , Chunpeng Ge , Ting Wang

It has been shown recently that deep learning based models are effective on speech quality prediction and could outperform traditional metrics in various perspectives. Although network models have potential to be a surrogate for complex…

Sound · Computer Science 2022-11-15 Hsin-Yi Lin , Huan-Hsin Tseng , Yu Tsao

Automatic speech recognition (ASR) systems are ubiquitously present in our daily devices. They are vulnerable to adversarial attacks, where manipulated input samples fool the ASR system's recognition. While adversarial examples for various…

Computation and Language · Computer Science 2022-02-03 Karla Markert , Donika Mirdita , Konstantin Böttinger

As a new programming paradigm, deep learning has expanded its application to many real-world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have…

Cryptography and Security · Computer Science 2021-03-16 Zhe Zhao , Guangke Chen , Jingyi Wang , Yiwei Yang , Fu Song , Jun Sun

Ensuring and improving the safety of autonomous driving systems (ADS) is crucial for the deployment of highly automated vehicles, especially in safety-critical events. To address the rarity issue, adversarial scenario generation methods are…

Machine Learning · Computer Science 2025-06-10 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

In communication systems, there are many tasks, like modulation recognition, which rely on Deep Neural Networks (DNNs) models. However, these models have been shown to be susceptible to adversarial perturbations, namely imperceptible…

Signal Processing · Electrical Eng. & Systems 2021-05-31 Javier Maroto , Gérôme Bovet , Pascal Frossard

Recent studies demonstrate that Large Language Models (LLMs) are vulnerable to different prompt-based attacks, generating harmful content or sensitive information. Both closed-source and open-source LLMs are underinvestigated for these…

Cryptography and Security · Computer Science 2025-05-21 Jiawen Wang , Pritha Gupta , Ivan Habernal , Eyke Hüllermeier