English
Related papers

Related papers: SoK: Pitfalls in Evaluating Black-Box Attacks

200 papers

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

The field of adversarial machine learning has experienced a near exponential growth in the amount of papers being produced since 2018. This massive information output has yet to be properly processed and categorized. In this paper, we seek…

Cryptography and Security · Computer Science 2021-10-01 Kaleel Mahmood , Rigel Mahmood , Ethan Rathbun , Marten van Dijk

Insider threats is the most concerned cybersecurity problem which is poorly addressed by widely used security solutions. Despite the fact that there have been several scientific publications in this area, but from our innovative study…

Cryptography and Security · Computer Science 2022-12-13 Angad Pal Singh , Ankit Sharma

As real-world images come in varying sizes, the machine learning model is part of a larger system that includes an upstream image scaling algorithm. In this paper, we investigate the interplay between vulnerabilities of the image scaling…

Machine Learning · Computer Science 2022-06-22 Yue Gao , Ilia Shumailov , Kassem Fawaz

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Arjhun Swaminathan , Mete Akgün

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Computation and Language · Computer Science 2022-01-24 Zhouhang Xie , Jonathan Brophy , Adam Noack , Wencong You , Kalyani Asthana , Carter Perkins , Sabrina Reis , Sameer Singh , Daniel Lowd

Recent literature highlights a significant cross-impact between transfer learning and cybersecurity. Many studies have been conducted on using transfer learning to enhance security, leading to various applications in different cybersecurity…

Cryptography and Security · Computer Science 2023-09-13 Sofiya Makar , Ali Dehghantanha , Fattane Zarrinkalam , Gautam Srivastava , Abbas Yazdinejad

An attack taxonomy offers a consistent and structured classification scheme to systematically understand, identify, and classify cybersecurity threat attributes. However, existing taxonomies only focus on a narrow range of attacks and…

Cryptography and Security · Computer Science 2026-04-03 Md Habibor Rahman , Rocco Cassandro , Thorsten Wuest , Mohammed Shafae

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary…

Machine Learning · Statistics 2018-02-15 Seong Joon Oh , Max Augustin , Bernt Schiele , Mario Fritz

Despite their impressive performance, deep visual models are susceptible to transferable black-box adversarial attacks. Principally, these attacks craft perturbations in a target model-agnostic manner. However, surprisingly, we find that…

Machine Learning · Computer Science 2025-04-15 Mohammad A. A. K. Jalwana , Naveed Akhtar , Ajmal Mian , Nazanin Rahnavard , Mubarak Shah

Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life…

Machine Learning · Computer Science 2020-02-10 Siddhant Bhambri , Sumanyu Muku , Avinash Tulasi , Arun Balaji Buduru

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

Machine Learning · Computer Science 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Cyber threat intelligence is the provision of evidence-based knowledge about existing or emerging threats. Benefits from threat intelligence include increased situational awareness, efficiency in security operations, and improved…

Cryptography and Security · Computer Science 2023-08-29 Vasileios Mavroeidis , Siri Bromander

Sentence-level attacks craft adversarial sentences that are synonymous with correctly-classified sentences but are misclassified by the text classifiers. Under the black-box setting, classifiers are only accessible through their feedback to…

Computation and Language · Computer Science 2024-02-22 Raha Moraffah , Huan Liu

Adversarial examples have posed a severe threat to deep neural networks due to their transferable nature. Currently, various works have paid great efforts to enhance the cross-model transferability, which mostly assume the substitute model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Qilong Zhang , Xiaodan Li , Yuefeng Chen , Jingkuan Song , Lianli Gao , Yuan He , Hui Xue

Although adversarial robustness has been extensively studied in white-box settings, recent advances in black-box attacks (including transfer- and query-based approaches) are primarily benchmarked against weak defenses, leaving a significant…

Machine Learning · Computer Science 2026-02-18 Mohamed Djilani , Salah Ghamizi , Maxime Cordy

Adversarial examples are well-known tools to evaluate the vulnerability of deep neural networks (DNNs). Although lots of adversarial attack algorithms have been developed, it's still challenging in the practical scenario that the model's…

Cryptography and Security · Computer Science 2025-05-27 Meixi Zheng , Xuanchen Yan , Zihao Zhu , Hongrui Chen , Baoyuan Wu