English
Related papers

Related papers: Practical Relative Order Attack in Deep Ranking

200 papers

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

This work studies black-box adversarial attacks against deep neural networks (DNNs), where the attacker can only access the query feedback returned by the attacked DNN model, while other information such as model parameters or the training…

Cryptography and Security · Computer Science 2021-03-19 Yan Feng , Baoyuan Wu , Yanbo Fan , Li Liu , Zhifeng Li , Shutao Xia

Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep…

Machine Learning · Computer Science 2024-03-12 Bibek Poudel , Weizi Li

With the growing deployment of sequential recommender systems in e-commerce and other fields, their black-box interfaces raise security concerns: models are vulnerable to extraction and subsequent adversarial manipulation. Existing…

Information Retrieval · Computer Science 2026-02-13 Hongyue Zhang , Mingming Li , Dongqin Liu , Hui Wang , Yaning Zhang , Xi Zhou , Honglei Lv , Jiao Dai , Jizhong Han

With further development in the fields of computer vision, network security, natural language processing and so on so forth, deep learning technology gradually exposed certain security risks. The existing deep learning algorithms cannot…

Cryptography and Security · Computer Science 2020-11-18 Rui Zhao

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decreasing the reward,…

Machine Learning · Computer Science 2022-12-13 Dennis Gross , Thiago D. Simao , Nils Jansen , Guillermo A. Perez

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends…

Machine Learning · Computer Science 2021-11-23 Maksym Yatsura , Jan Hendrik Metzen , Matthias Hein

Rank aggregation with pairwise comparisons has shown promising results in elections, sports competitions, recommendations, and information retrieval. However, little attention has been paid to the security issue of such algorithms, in…

Machine Learning · Computer Science 2022-09-14 Ke Ma , Qianqian Xu , Jinshan Zeng , Guorong Li , Xiaochun Cao , Qingming Huang

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Chris Miller , Soroush Vosoughi

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

Machine Learning · Computer Science 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

Black-box adversarial attacks present a realistic threat to action recognition systems. Existing black-box attacks follow either a query-based approach where an attack is optimized by querying the target model, or a transfer-based approach…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Rohit Gupta , Naveed Akhtar , Gaurav Kumar Nayak , Ajmal Mian , Mubarak Shah

The success of deep learning research has catapulted deep models into production systems that our society is becoming increasingly dependent on, especially in the image and video domains. However, recent work has shown that these largely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Nathan Inkawhich , Matthew Inkawhich , Yiran Chen , Hai Li

Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning…

Machine Learning · Computer Science 2019-04-10 Martin Engilberge , Louis Chevallier , Patrick Pérez , Matthieu Cord

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

Machine Learning (ML) and Deep Learning (DL) models have achieved state-of-the-art performance on multiple learning tasks, from vision to natural language modelling. With the growing adoption of ML and DL to many areas of computer science,…

Machine Learning · Computer Science 2019-06-11 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

Black-box attack methods aim to infer suitable attack patterns to targeted DNN models by only using output feedback of the models and the corresponding input queries. However, due to lack of prior and inefficiency in leveraging the query…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Jiawei Du , Hu Zhang , Joey Tianyi Zhou , Yi Yang , Jiashi Feng

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Jie Li , Rongrong Ji , Hong Liu , Jianzhuang Liu , Bineng Zhong , Cheng Deng , Qi Tian

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples for deep learning models solely based on information limited to output label~(hard label) to a queried data input. We propose a…

Machine Learning · Computer Science 2021-06-14 Satya Narayan Shukla , Anit Kumar Sahu , Devin Willmott , J. Zico Kolter