English
Related papers

Related papers: PINCH: An Adversarial Extraction Attack Framework …

200 papers

When large language models are trained on private data, it can be a significant privacy risk for them to memorize and regurgitate sensitive information. In this work, we propose a new practical data extraction attack that we call "neural…

Cryptography and Security · Computer Science 2024-03-05 Ashwinee Panda , Christopher A. Choquette-Choo , Zhengming Zhang , Yaoqing Yang , Prateek Mittal

Data-driven deep learning (DL) techniques developed for automatic modulation classification (AMC) of wireless signals are vulnerable to adversarial attacks. This poses a severe security threat to the DL-based wireless systems, specifically…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Nayan Moni Baishya , B. R. Manoj

Pre-trained large language models, such as GPT\nobreakdash-2 and BERT, are often fine-tuned to achieve state-of-the-art performance on a downstream task. One natural example is the ``Smart Reply'' application where a pre-trained model is…

Cryptography and Security · Computer Science 2023-09-06 Bargav Jayaraman , Esha Ghosh , Melissa Chase , Sambuddha Roy , Wei Dai , David Evans

With growing popularity, deep learning (DL) models are becoming larger-scale, and only the companies with vast training datasets and immense computing power can manage their business serving such large models. Most of those DL models are…

Artificial Intelligence · Computer Science 2024-03-06 Younghan Lee , Sohee Jun , Yungi Cho , Woorim Han , Hyungon Moon , Yunheung Paek

With the growth of adversarial attacks against machine learning models, several concerns have emerged about potential vulnerabilities in designing deep neural network-based intrusion detection systems (IDS). In this paper, we study the…

Machine Learning · Computer Science 2019-11-01 Rana Abou Khamis , Omair Shafiq , Ashraf Matrawy

Deep learning methods have shown state of the art performance in a range of tasks from computer vision to natural language processing. However, it is well known that such systems are vulnerable to attackers who craft inputs in order to…

Machine Learning · Computer Science 2020-09-29 Giulio Zizzo , Chris Hankin , Sergio Maffeis , Kevin Jones

Large language models (LLMs) are inherently vulnerable to unintended privacy breaches. Consequently, systematic red-teaming research is essential for developing robust defense mechanisms. However, current data extraction methods suffer from…

Machine Learning · Computer Science 2025-05-13 Zhiqiang Wang , Ruoxi Cheng

Recently, researchers have started decomposing deep neural network models according to their semantics or functions. Recent work has shown the effectiveness of decomposed functional blocks for defending adversarial attacks, which add small…

Machine Learning · Computer Science 2019-05-10 Yuxian Qiu , Jingwen Leng , Cong Guo , Quan Chen , Chao Li , Minyi Guo , Yuhao Zhu

Model extraction emerges as a critical security threat with attack vectors exploiting both algorithmic and implementation-based approaches. The main goal of an attacker is to steal as much information as possible about a protected victim…

Cryptography and Security · Computer Science 2024-11-18 Kevin Hector , Pierre-Alain Moellic , Mathieu Dumont , Jean-Max Dutertre

Model stealing attacks have become a serious concern for deep learning models, where an attacker can steal a trained model by querying its black-box API. This can lead to intellectual property theft and other security and privacy risks. The…

Machine Learning · Computer Science 2023-09-12 Kacem Khaled , Mouna Dhaouadi , Felipe Gohring de Magalhães , Gabriela Nicolescu

Adversarial attacks in deep learning models, especially for safety-critical systems, are gaining more and more attention in recent years, due to the lack of trust in the security and robustness of AI models. Yet the more primitive…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Abhijith Sharma , Yijun Bian , Phil Munz , Apurva Narayan

The security of deep learning (DL) systems is an extremely important field of study as they are being deployed in several applications due to their ever-improving performance to solve challenging tasks. Despite overwhelming promises, the…

Machine Learning · Computer Science 2022-08-19 Manaar Alam , Shubhajit Datta , Debdeep Mukhopadhyay , Arijit Mondal , Partha Pratim Chakrabarti

Deep learning based systems are susceptible to adversarial attacks, where a small, imperceptible change at the input alters the model prediction. However, to date the majority of the approaches to detect these attacks have been designed for…

Computation and Language · Computer Science 2022-09-27 Vyas Raina , Mark Gales

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

The ever-growing big data and emerging artificial intelligence (AI) demand the use of machine learning (ML) and deep learning (DL) methods. Cybersecurity also benefits from ML and DL methods for various types of applications. These methods…

Machine Learning · Computer Science 2019-07-18 Arif Siddiqi

Deep learning models are vulnerable to adversarial examples, which poses an indisputable threat to their applications. However, recent studies observe gradient-masking defenses are self-deceiving methods if an attacker can realize this…

Machine Learning · Computer Science 2019-02-19 Yueyao Yu , Pengfei Yu , Wenye Li

Adversarial attacks against conventional Deep Learning (DL) systems and algorithms have been widely studied, and various defenses were proposed. However, the possibility and feasibility of such attacks against Deep Reinforcement Learning…

Cryptography and Security · Computer Science 2020-05-15 Jianwen Sun , Tianwei Zhang , Xiaofei Xie , Lei Ma , Yan Zheng , Kangjie Chen , Yang Liu

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

Recent advancements of Deep Neural Networks (DNNs) have seen widespread deployment in multiple security-sensitive domains. The need of resource-intensive training and use of valuable domain-specific training data have made these models a…

Cryptography and Security · Computer Science 2021-11-09 Adnan Siraj Rakin , Md Hafizul Islam Chowdhuryy , Fan Yao , Deliang Fan

Recently, numerous highly-valuable Deep Neural Networks (DNNs) have been trained using deep learning algorithms. To protect the Intellectual Property (IP) of the original owners over such DNN models, backdoor-based watermarks have been…

Cryptography and Security · Computer Science 2024-01-30 Peizhuo Lv , Hualong Ma , Kai Chen , Jiachen Zhou , Shengzhi Zhang , Ruigang Liang , Shenchen Zhu , Pan Li , Yingjun Zhang