English
Related papers

Related papers: A Cognitive Distribution and Behavior-Consistent F…

200 papers

Neural ranking models (NRMs) have been shown to be highly effective in terms of retrieval performance. Unfortunately, they have also displayed a higher degree of sensitivity to attacks than previous generation models. To help expose and…

Information Retrieval · Computer Science 2024-12-30 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

Machine Learning · Statistics 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

Machine Learning · Computer Science 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Many studies have been done to prove the vulnerability of neural networks to adversarial example. A trained and well-behaved model can be fooled by a visually imperceptible perturbation, i.e., an originally correctly classified image could…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 YiGui Luo , RuiJia Yang , Wei Sha , WeiYi Ding , YouTeng Sun , YiSi Wang

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Wenxuan Wang , Bangjie Yin , Taiping Yao , Li Zhang , Yanwei Fu , Shouhong Ding , Jilin Li , Feiyue Huang , Xiangyang Xue

Deep Neural Network (DNN) classifiers are vulnerable to adversarial attack, where an imperceptible perturbation could result in misclassification. However, the vulnerability of DNN-based image ranking systems remains under-explored. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mo Zhou , Zhenxing Niu , Le Wang , Qilin Zhang , Gang Hua

Adversarial attacks, wherein slight inputs are carefully crafted to mislead intelligent models, have attracted increasing attention. However, a critical gap persists between theoretical advancements and practical application, particularly…

Cryptography and Security · Computer Science 2025-06-26 Sabrine Ennaji , Elhadj Benkhelifa , Luigi V. Mancini

We present a method for adversarial input generation against black box models for reading comprehension based question answering. Our approach is composed of two steps. First, we approximate a victim black box model via model extraction…

Machine Learning · Computer Science 2020-11-03 Naveen Jafer Nizar , Ari Kobren

Adversarial attacks remain a significant threat that can jeopardize the integrity of Machine Learning (ML) models. In particular, query-based black-box attacks can generate malicious noise without having access to the victim model's…

Cryptography and Security · Computer Science 2025-03-18 Jeonghwan Park , Niall McLaughlin , Ihsen Alouani

Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure…

Machine Learning · Statistics 2020-06-09 Milad Nasr , Reza Shokri , Amir Houmansadr

Intelligent machine learning approaches are finding active use for event detection and identification that allow real-time situational awareness. Yet, such machine learning algorithms have been shown to be susceptible to adversarial attacks…

Systems and Control · Electrical Eng. & Systems 2024-04-23 Obai Bahwal , Oliver Kosut , Lalitha Sankar

Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks…

Machine Learning · Computer Science 2021-10-13 James Tu , Tsunhsuan Wang , Jingkang Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Jie Li , Rongrong Ji , Hong Liu , Jianzhuang Liu , Bineng Zhong , Cheng Deng , Qi Tian

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Adversarial example generation becomes a viable method for evaluating the robustness of a machine learning model. In this paper, we consider hard-label black-box attacks (a.k.a. decision-based attacks), which is a challenging setting that…

Machine Learning · Computer Science 2019-10-15 Zhenxin Xiao , Puyudi Yang , Yuchen Jiang , Kai-Wei Chang , Cho-Jui Hsieh

Reinforcement Learning (RL) agents are increasingly used to simulate sophisticated cyberattacks, but their decision-making processes remain opaque, hindering trust, debugging, and defensive preparedness. In high-stakes cybersecurity…

Cryptography and Security · Computer Science 2026-05-18 Diksha Goel , Kristen Moore , Jeff Wang , Minjune Kim , Thanh Thi Nguyen

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

Cryptography and Security · Computer Science 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

Skeleton action recognition models have secured more attention than video-based ones in various applications due to privacy preservation and lower storage requirements. Skeleton data are typically transmitted to cloud servers for action…

Cryptography and Security · Computer Science 2025-12-03 Yuxin Cao , Kai Ye , Derui Wang , Minhui Xue , Hao Ge , Chenxiong Qian , Jin Song Dong