English
Related papers

Related papers: Query-limited Black-box Attacks to Classifiers

200 papers

Despite significant improvements in natural language understanding models with the advent of models like BERT and XLNet, these neural-network based classifiers are vulnerable to blackbox adversarial attacks, where the attacker is only…

Machine Learning · Computer Science 2021-06-17 Jatin Chauhan , Karan Bhukar , Manohar Kaul

Machine learning systems deployed in distributed or federated environments are highly susceptible to adversarial manipulations, particularly availability attacks -adding imperceptible perturbations to training data, thereby rendering the…

Cryptography and Security · Computer Science 2025-06-02 Abdessamad El-Kabid , El-Mahdi El-Mhamdi

We introduce a novel clean-label targeted poisoning attack on learning mechanisms. While classical poisoning attacks typically corrupt data via addition, modification and omission, our attack focuses on data omission only. Our attack…

Machine Learning · Computer Science 2021-05-06 Guy Barash , Eitan Farchi , Sarit Kraus , Onn Shehory

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

As climate change increases the threat of weather-related disasters, research on weather control is gaining importance. The objective of weather control is to mitigate disaster risks by administering interventions with optimal timing,…

Atmospheric and Oceanic Physics · Physics 2025-05-19 Yuta Higuchi , Rikuto Nagai , Atsushi Okazaki , Masaki Ogura , Naoki Wakamiya

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

We study the problem of generating adversarial examples in a black-box setting in which only loss-oracle access to a model is available. We introduce a framework that conceptually unifies much of the existing work on black-box attacks, and…

Machine Learning · Statistics 2019-03-29 Andrew Ilyas , Logan Engstrom , Aleksander Madry

In a manner analogous to their classical counterparts, quantum classifiers are vulnerable to adversarial attacks that perturb their inputs. A promising countermeasure is to train the quantum classifier by adopting an attack-aware, or…

Quantum Physics · Physics 2024-02-16 Petros Georgiou , Sharu Theresa Jose , Osvaldo Simeone

Large language models (LLMs) show strong performance across many applications, but their ability to memorize and potentially reveal training data raises serious privacy concerns. We introduce the PopQuiz Attack, a black-box membership…

Cryptography and Security · Computer Science 2026-05-08 Zeyuan Chen , Yihan Ma , Xinyue Shen , Michael Backes , Yang Zhang

Recent advances in machine learning have led to increased deployment of black-box classifiers across a wide variety of applications. In many such situations there is a critical need to both reliably assess the performance of these…

Machine Learning · Statistics 2021-03-16 Disi Ji , Robert L. Logan , Padhraic Smyth , Mark Steyvers

Classifiers are often used to detect miscreant activities. We study how an adversary can efficiently query a classifier to elicit information that allows the adversary to evade detection at near-minimal cost. We generalize results of Lowd…

In recent years, binary analysis gained traction as a fundamental approach to inspect software and guarantee its security. Due to the exponential increase of devices running software, much research is now moving towards new autonomous…

Cryptography and Security · Computer Science 2023-11-06 Gianluca Capozzi , Daniele Cono D'Elia , Giuseppe Antonio Di Luna , Leonardo Querzoni

Recently, researchers have discovered that the state-of-the-art object classifiers can be fooled easily by small perturbations in the input unnoticeable to human eyes. It is also known that an attacker can generate strong adversarial…

Machine Learning · Computer Science 2018-06-28 Jihun Hamm , Akshay Mehra

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends…

Machine Learning · Computer Science 2021-11-23 Maksym Yatsura , Jan Hendrik Metzen , Matthias Hein

This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent toward a mischievous…

Machine Learning · Computer Science 2024-12-03 Jianhui Li , Bokang Zhang , Junfeng Wu

Recent approaches to training algorithm selectors in the black-box optimisation domain have advocated for the use of training data that is algorithm-centric in order to encapsulate information about how an algorithm performs on an instance,…

Machine Learning · Computer Science 2025-01-22 Quentin Renau , Emma Hart

With the development of information science and technology, various industries have generated massive amounts of data, and machine learning is widely used in the analysis of big data. However, if the privacy of machine learning…

Cryptography and Security · Computer Science 2023-01-11 Jingyi Ge

Machine learning has achieved great success in many applications, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). Unfortunately, many machine learning models are vulnerable to adversarial examples, which are…

Cryptography and Security · Computer Science 2019-11-13 Lubin Meng , Chin-Teng Lin , Tzyy-Ring Jung , Dongrui Wu

Recent studies have revealed that neural network-based policies can be easily fooled by adversarial examples. However, while most prior works analyze the effects of perturbing every pixel of every frame assuming white-box policy access, in…

Machine Learning · Computer Science 2020-10-30 Xinghua Qu , Zhu Sun , Yew-Soon Ong , Abhishek Gupta , Pengfei Wei

Neural networks are getting deeper and more computation-intensive nowadays. Quantization is a useful technique in deploying neural networks on hardware platforms and saving computation costs with negligible performance loss. However, recent…

Machine Learning · Computer Science 2021-01-26 Chang Song , Elias Fallon , Hai Li