English
Related papers

Related papers: Attacking the First-Principle: A Black-Box, Query-…

200 papers

Although Deep Neural Network (DNN) has led to unprecedented progress in various natural language processing (NLP) tasks, research shows that deep models are extremely vulnerable to backdoor attacks. The existing backdoor attacks mainly…

Cryptography and Security · Computer Science 2022-06-07 Xiaoyi Chen , Yinpeng Dong , Zeyu Sun , Shengfang Zhai , Qingni Shen , Zhonghai Wu

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

To explore the vulnerability of deep neural networks (DNNs), many attack paradigms have been well studied, such as the poisoning-based backdoor attack in the training stage and the adversarial attack in the inference stage. In this paper,…

Machine Learning · Computer Science 2021-02-23 Jiawang Bai , Baoyuan Wu , Yong Zhang , Yiming Li , Zhifeng Li , Shu-Tao Xia

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

The binary code similarity detection (BCSD) method measures the similarity of two binary executable codes. Recently, the learning-based BCSD methods have achieved great success, outperforming traditional BCSD in detection accuracy and…

Cryptography and Security · Computer Science 2022-08-31 Lichen Jia , Bowen Tang , Chenggang Wu , Zhe Wang , Zihan Jiang , Yuanming Lai , Yan Kang , Ning Liu , Jingfeng Zhang

Machine learning has been applied to a broad range of applications and some of them are available online as application programming interfaces (APIs) with either free (trial) or paid subscriptions. In this paper, we study adversarial…

Machine Learning · Computer Science 2018-11-06 Yi Shi , Yalin E. Sagduyu , Kemal Davaslioglu , Jason H. Li

Membership inference attacks seek to infer membership of individual training instances of a model to which an adversary has black-box access through a machine learning-as-a-service API. In providing an in-depth characterization of…

Cryptography and Security · Computer Science 2019-02-04 Stacey Truex , Ling Liu , Mehmet Emre Gursoy , Lei Yu , Wenqi Wei

Learning-based systems have been shown to be vulnerable to evasion through adversarial data manipulation. These attacks have been studied under assumptions that the adversary has certain knowledge of either the target model internals, its…

Cryptography and Security · Computer Science 2017-08-24 Hung Dang , Yue Huang , Ee-Chien Chang

In multiple domains such as malware detection, automated driving systems, or fraud detection, classification algorithms are susceptible to being attacked by malicious agents willing to perturb the value of instance covariates to pursue…

Machine Learning · Statistics 2025-07-10 Victor Gallego , Roi Naveiro , Alberto Redondo , David Rios Insua , Fabrizio Ruggeri

Evaluating the behavioral boundaries of deep learning (DL) systems is crucial for understanding their reliability across diverse, unseen inputs. Existing solutions fall short as they rely on untargeted random, model- or latent-based…

Software Engineering · Computer Science 2026-01-22 Oliver Weißl , Amr Abdellatif , Xingcheng Chen , Giorgi Merabishvili , Vincenzo Riccio , Severin Kacianka , Andrea Stocco

Deep learning models are susceptible to adversarial attacks, where slight perturbations to input data lead to misclassification. Adversarial attacks become increasingly effective with access to information about the targeted classifier. In…

Machine Learning · Computer Science 2024-05-29 Yu Zhe , Rei Nagaike , Daiki Nishiyama , Kazuto Fukuchi , Jun Sakuma

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

We propose a new randomized ensemble technique with a provable security guarantee against black-box transfer attacks. Our proof constructs a new security problem for random binary classifiers which is easier to empirically verify and a…

Machine Learning · Computer Science 2020-02-25 Kevin Shi , Daniel Hsu , Allison Bishop

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial attacks, even in a black-box scenario. However, most of the existing black-box attack algorithms need to make a huge amount of queries to perform…

Machine Learning · Statistics 2018-09-11 Yali Du , Meng Fang , Jinfeng Yi , Jun Cheng , Dacheng Tao

We initiate the study of adversarial attacks on models for binary (i.e. black and white) image classification. Although there has been a great deal of work on attacking models for colored and grayscale images, little is known about attacks…

Machine Learning · Computer Science 2020-10-24 Eric Balkanski , Harrison Chase , Kojin Oshiba , Alexander Rilee , Yaron Singer , Richard Wang

The rapid adoption of large language models (LLMs) in critical domains has spurred extensive research into their security issues. While input manipulation attacks (e.g., prompt injection) have been well studied, Bit-Flip Attacks (BFAs) --…

Cryptography and Security · Computer Science 2025-09-24 Haotian Xu , Qingsong Peng , Jie Shi , Huadi Zheng , Yu Li , Cheng Zhuo

Machine learning security has recently become a prominent topic in the natural language processing (NLP) area. The existing black-box adversarial attack suffers prohibitively from the high model querying complexity, resulting in easily…

Cryptography and Security · Computer Science 2023-10-17 Wenjie Lv , Zhen Wang , Yitao Zheng , Zhehua Zhong , Qi Xuan , Tianyi Chen

Vulnerability prediction is valuable in identifying security issues efficiently, even though it requires the source code of the target software system, which is a restrictive hypothesis. This paper presents an experimental study to predict…

Cryptography and Security · Computer Science 2025-04-01 D. Cotroneo , F. C. Grasso , R. Natella , V. Orbinato

Binary classification is a fundamental problem in machine learning. Recent development of quantum similarity-based binary classifiers and kernel method that exploit quantum interference and feature quantum Hilbert space opened up tremendous…

Quantum Physics · Physics 2020-04-08 Daniel K. Park , Carsten Blank , Francesco Petruccione

In this work, we highlight and perform a comprehensive study on calibration attacks, a form of adversarial attacks that aim to trap victim models to be heavily miscalibrated without altering their predicted labels, hence endangering the…

Machine Learning · Computer Science 2024-12-03 Stephen Obadinma , Xiaodan Zhu , Hongyu Guo