English
Related papers

Related papers: Evading Black-box Classifiers Without Breaking Egg…

200 papers

Neural networks have become pervasive across various applications, including security-related products. However, their widespread adoption has heightened concerns regarding vulnerability to adversarial attacks. With emerging regulations and…

Cryptography and Security · Computer Science 2025-11-10 Disesdi Susanna Cox , Niklas Bunzel

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

Machine Learning · Computer Science 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

Machine-learning techniques are widely used in security-related applications, like spam and malware detection. However, in such settings, they have been shown to be vulnerable to adversarial attacks, including the deliberate manipulation of…

Machine Learning · Computer Science 2017-09-04 Ambra Demontis , Paolo Russu , Battista Biggio , Giorgio Fumera , Fabio Roli

Modern commercial antivirus systems increasingly rely on machine learning to keep up with the rampant inflation of new malware. However, it is well-known that machine learning models are vulnerable to adversarial examples (AEs). Previous…

Cryptography and Security · Computer Science 2021-05-03 Wei Song , Xuezixiang Li , Sadia Afroz , Deepali Garg , Dmitry Kuznetsov , Heng Yin

We study the most practical problem setup for evaluating adversarial robustness of a machine learning system with limited access: the hard-label black-box attack setting for generating adversarial examples, where limited model queries are…

Machine Learning · Computer Science 2020-02-17 Minhao Cheng , Simranjit Singh , Patrick Chen , Pin-Yu Chen , Sijia Liu , Cho-Jui Hsieh

Deep neural networks (DNNs) are inherently susceptible to adversarial attacks even under black-box settings, in which the adversary only has query access to the target models. In practice, while it may be possible to effectively detect such…

Machine Learning · Computer Science 2020-06-18 Ren Pang , Xinyang Zhang , Shouling Ji , Xiapu Luo , Ting Wang

A significant number of machine learning models are vulnerable to model extraction attacks, which focus on stealing the models by using specially curated queries against the target model. This task is well accomplished by using part of the…

Cryptography and Security · Computer Science 2023-08-11 Harshit Shah , Aravindhan G , Pavan Kulkarni , Yuvaraj Govidarajulu , Manojkumar Parmar

The success of deep learning research has catapulted deep models into production systems that our society is becoming increasingly dependent on, especially in the image and video domains. However, recent work has shown that these largely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Nathan Inkawhich , Matthew Inkawhich , Yiran Chen , Hai Li

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

Machine Learning · Computer Science 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Safety classifiers are critical in mitigating toxicity on online forums such as social media and in chatbots. Still, they continue to be vulnerable to emergent, and often innumerable, adversarial attacks. Traditional automated adversarial…

Computation and Language · Computer Science 2024-06-26 Yash Kumar Lal , Preethi Lahoti , Aradhana Sinha , Yao Qin , Ananth Balashankar

Deep learning systems, critical in domains like autonomous vehicles, are vulnerable to adversarial examples (crafted inputs designed to mislead classifiers). This study investigates black-box adversarial attacks in computer vision. This is…

Cryptography and Security · Computer Science 2025-06-09 Francesco Panebianco , Mario D'Onghia , Stefano Zanero aand Michele Carminati

The growing dependence on machine learning in real-world applications emphasizes the importance of understanding and ensuring its safety. Backdoor attacks pose a significant security risk due to their stealthy nature and potentially serious…

Cryptography and Security · Computer Science 2023-10-19 Ganghua Wang , Xun Xian , Jayanth Srinivasa , Ashish Kundu , Xuan Bi , Mingyi Hong , Jie Ding

Decision-based black-box attacks often necessitate a large number of queries to craft an adversarial example. Moreover, decision-based attacks based on querying boundary points in the estimated normal vector direction often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Md Farhamdur Reza , Ali Rahmati , Tianfu Wu , Huaiyu Dai

Training pipelines for machine learning (ML) based malware classification often rely on crowdsourced threat feeds, exposing a natural attack injection point. In this paper, we study the susceptibility of feature-based ML malware classifiers…

Cryptography and Security · Computer Science 2021-01-12 Giorgio Severi , Jim Meyer , Scott Coull , Alina Oprea

Machine Learning models face increased concerns regarding the storage of personal user data and adverse impacts of corrupted data like backdoors or systematic bias. Machine Unlearning can address these by allowing post-hoc deletion of…

Machine Learning · Computer Science 2023-02-23 Shashwat Goel , Ameya Prabhu , Amartya Sanyal , Ser-Nam Lim , Philip Torr , Ponnurangam Kumaraguru

Learned Cost Models (LCMs) have shown superior results over traditional database cost models as they can significantly improve the accuracy of cost predictions. However, LCMs still fail for some query plans, as prediction errors can be…

Databases · Computer Science 2025-07-22 Roman Heinrich , Oleksandr Havrylov , Manisha Luthra , Johannes Wehrstein , Carsten Binnig

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends…

Machine Learning · Computer Science 2021-11-23 Maksym Yatsura , Jan Hendrik Metzen , Matthias Hein

Machine-learning based intrusion detection classifiers are able to detect unknown attacks, but at the same time, they may be susceptible to evasion by obfuscation techniques. An adversary intruder which possesses a crucial knowledge about a…

Cryptography and Security · Computer Science 2019-04-16 Ivan Homoliak , Martin Teknos , Martín Ochoa , Dominik Breitenbacher , Saeid Hosseini , Petr Hanacek