English
Related papers

Related papers: Model Extraction and Adversarial Attacks on Neural…

200 papers

As neural networks become the tool of choice to solve an increasing variety of problems in our society, adversarial attacks become critical. The possibility of generating data instances deliberately designed to fool a network's analysis can…

Machine Learning · Computer Science 2021-03-19 Gabriel D. Cantareira , Rodrigo F. Mello , Fernando V. Paulovich

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Model extraction attacks are a kind of attacks in which an adversary obtains a new model, whose performance is equivalent to that of a target model, via query access to the target model efficiently, i.e., fewer datasets and computational…

Cryptography and Security · Computer Science 2020-02-04 Tatsuya Takemura , Naoto Yanai , Toru Fujiwara

We investigate the role of transferability of adversarial attacks in the observed vulnerabilities of Deep Neural Networks (DNNs). We demonstrate that introducing randomness to the DNN models is sufficient to defeat adversarial attacks,…

Cryptography and Security · Computer Science 2018-06-19 Yan Zhou , Murat Kantarcioglu , Bowei Xi

In this era of machine learning models, their functionality is being threatened by adversarial attacks. In the face of this struggle for making artificial neural networks robust, finding a model, resilient to these attacks, is very…

Neural and Evolutionary Computing · Computer Science 2019-05-08 Saima Sharmin , Priyadarshini Panda , Syed Shakib Sarwar , Chankyu Lee , Wachirawit Ponghiran , Kaushik Roy

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Neural networks have become pervasive across various applications, including security-related products. However, their widespread adoption has heightened concerns regarding vulnerability to adversarial attacks. With emerging regulations and…

Cryptography and Security · Computer Science 2025-11-10 Disesdi Susanna Cox , Niklas Bunzel

In a model extraction attack, an adversary steals a copy of a remotely deployed machine learning model, given oracle prediction access. We taxonomize model extraction attacks around two objectives: *accuracy*, i.e., performing well on the…

Machine Learning · Computer Science 2020-03-05 Matthew Jagielski , Nicholas Carlini , David Berthelot , Alex Kurakin , Nicolas Papernot

Model stealing attacks have been successfully used in many machine learning domains, but there is little understanding of how these attacks work against models that perform malware detection. Malware detection and, in general, security…

Cryptography and Security · Computer Science 2023-06-06 Maria Rigaki , Sebastian Garcia

Deep neural networks (DNNs) are vulnerable to adversarial examples (AEs) that mislead the model while appearing benign to human observers. A critical concern is the transferability of AEs, which enables black-box attacks without direct…

Cryptography and Security · Computer Science 2025-10-21 Jiahao Chen , Zhou Feng , Rui Zeng , Yuwen Pu , Chunyi Zhou , Yi Jiang , Yuyou Gan , Jinbao Li , Shouling Ji

Deep neural networks (DNNs) have demonstrated excellent performance on various tasks, however they are under the risk of adversarial examples that can be easily generated when the target model is accessible to an attacker (white-box…

Machine Learning · Computer Science 2020-09-28 Yang Bai , Yuyuan Zeng , Yong Jiang , Yisen Wang , Shu-Tao Xia , Weiwei Guo

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Model extraction increasingly attracts research attentions as keeping commercial AI models private can retain a competitive advantage. In some scenarios, AI models are trained proprietarily, where neither pre-trained models nor sufficient…

Machine Learning · Computer Science 2021-04-14 Xinyi Zhang , Chengfang Fang , Jie Shi

Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

Several companies often safeguard their trained deep models (i.e., details of architecture, learnt weights, training details etc.) from third-party users by exposing them only as black boxes through APIs. Moreover, they may not even provide…

Machine Learning · Computer Science 2024-03-29 Gaurav Kumar Nayak , Inder Khatri , Ruchit Rawal , Anirban Chakraborty

Though deep neural networks perform challenging tasks excellently, they are susceptible to adversarial examples, which mislead classifiers by applying human-imperceptible perturbations on clean inputs. Under the query-free black-box…

Machine Learning · Computer Science 2020-11-05 Zifei Zhang , Kai Qiao , Jian Chen , Ningning Liang

In real world systems, the predictions of deployed Machine Learned models affect the training data available to build subsequent models. This introduces a bias in the training data that needs to be addressed. Existing solutions to this…

Machine Learning · Computer Science 2018-04-20 John Moore , Joel Pfeiffer , Kai Wei , Rishabh Iyer , Denis Charles , Ran Gilad-Bachrach , Levi Boyles , Eren Manavoglu

Transferable adversarial attacks against Deep neural networks (DNNs) have received broad attention in recent years. An adversarial example can be crafted by a surrogate model and then attack the unknown target model successfully, which…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Zhu , Yuefeng Chen , Xiaodan Li , Kejiang Chen , Yuan He , Xiang Tian , Bolun Zheng , Yaowu Chen , Qingming Huang

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

Computation and Language · Computer Science 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li