English
Related papers

Related papers: Query-Efficient Hard-label Black-box Attack:An Opt…

200 papers

In generating adversarial examples, the conventional black-box attack methods rely on sufficient feedback from the to-be-attacked models by repeatedly querying until the attack is successful, which usually results in thousands of trials…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Renyang Liu , Wei Zhou , Xin Jin , Song Gao , Yuanyu Wang , Ruxin Wang

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

Computation and Language · Computer Science 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

Machine Learning · Computer Science 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Deep neural networks are vulnerable to adversarial examples, even in the black-box setting, where the attacker is restricted solely to query access. Existing black-box approaches to generating adversarial examples typically require a…

Machine Learning · Computer Science 2019-07-02 Moustafa Alzantot , Yash Sharma , Supriyo Chakraborty , Huan Zhang , Cho-Jui Hsieh , Mani Srivastava

Machine learning (ML), especially deep neural networks (DNNs) have been widely used in various applications, including several safety-critical ones (e.g. autonomous driving). As a result, recent research about adversarial examples has…

Machine Learning · Computer Science 2020-05-29 Huichen Li , Xiaojun Xu , Xiaolu Zhang , Shuang Yang , Bo Li

Existing score-based adversarial attacks mainly focus on crafting $top$-1 adversarial examples against classifiers with single-label classification. Their attack success rate and query efficiency are often less than satisfactory,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Md Farhamdur Reza , Richeng Jin , Tianfu Wu , Huaiyu Dai

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this…

Machine Learning · Computer Science 2021-07-09 Daniel Park , Haidar Khan , Azer Khan , Alex Gittens , Bülent Yener

Black-box adversarial attacks generate adversarial samples via iterative optimizations using repeated queries. Defending deep neural networks against such attacks has been challenging. In this paper, we propose an efficient Boundary Defense…

Cryptography and Security · Computer Science 2022-02-01 Manjushree B. Aithal , Xiaohua Li

Robust machine learning is currently one of the most prominent topics which could potentially help shaping a future of advanced AI platforms that not only perform well in average cases but also in worst cases or adverse situations. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Pu Zhao , Sijia Liu , Pin-Yu Chen , Nghia Hoang , Kaidi Xu , Bhavya Kailkhura , Xue Lin

One major problem in black-box adversarial attacks is the high query complexity in the hard-label attack setting, where only the top-1 predicted label is available. In this paper, we propose a novel geometric-based approach called Tangent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Ma , Xiangyu Guo , Li Chen , Jun-Hai Yong , Yisen Wang

We study the black-box attacks on graph neural networks (GNNs) under a novel and realistic constraint: attackers have access to only a subset of nodes in the network, and they can only attack a small number of them. A node selection step is…

Machine Learning · Computer Science 2021-10-28 Jiaqi Ma , Shuangrui Ding , Qiaozhu Mei

With the growing deployment of sequential recommender systems in e-commerce and other fields, their black-box interfaces raise security concerns: models are vulnerable to extraction and subsequent adversarial manipulation. Existing…

Information Retrieval · Computer Science 2026-02-13 Hongyue Zhang , Mingming Li , Dongqin Liu , Hui Wang , Yaning Zhang , Xi Zhou , Honglei Lv , Jiao Dai , Jizhong Han

Gradient inversion attacks aim to reconstruct local training data from intermediate gradients exposed in the federated learning framework. Despite successful attacks, all previous methods, starting from reconstructing a single data point…

Cryptography and Security · Computer Science 2024-04-16 Yanbo Wang , Jian Liang , Ran He

We study the problem of robust learning under clean-label data-poisoning attacks, where the attacker injects (an arbitrary set of) correctly-labeled examples to the training set to fool the algorithm into making mistakes on specific test…

Machine Learning · Computer Science 2021-07-08 Avrim Blum , Steve Hanneke , Jian Qian , Han Shao

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Machine learning models deployed as a service (MLaaS) are susceptible to model stealing attacks, where an adversary attempts to steal the model within a restricted access framework. While existing attacks demonstrate near-perfect…

Cryptography and Security · Computer Science 2022-04-26 Sunandini Sanyal , Sravanti Addepalli , R. Venkatesh Babu

We study adversarial examples in a black-box setting where the adversary only has API access to the target model and each query is expensive. Prior work on black-box adversarial examples follows one of two main strategies: (1) transfer…

Cryptography and Security · Computer Science 2019-12-03 Fnu Suya , Jianfeng Chi , David Evans , Yuan Tian

Research has shown that deep neural networks (DNNs) have vulnerabilities that can lead to the misrecognition of Adversarial Examples (AEs) with specifically designed perturbations. Various adversarial attack methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Ayane Tajima , Satoshi Ono

We study black-box attacks on machine learning classifiers where each query to the model incurs some cost or risk of detection to the adversary. We focus explicitly on minimizing the number of queries as a major objective. Specifically, we…

Cryptography and Security · Computer Science 2017-12-27 Fnu Suya , Yuan Tian , David Evans , Paolo Papotti

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann