English
Related papers

Related papers: Theoretically Principled Trade-off for Stateful De…

200 papers

The physical attack has been regarded as a kind of threat against real-world computer vision systems. Still, many existing defense methods are only useful for small perturbations attacks and can't detect physical attacks effectively. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 JiaHao Xie , Ye Luo , Jianwei Lu

As deep neural networks (DNNs) have become increasingly important and popular, the robustness of DNNs is the key to the safety of both the Internet and the physical world. Unfortunately, some recent studies show that adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Yifan Ding , Liqiang Wang , Huan Zhang , Jinfeng Yi , Deliang Fan , Boqing Gong

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this…

Machine Learning · Computer Science 2021-07-09 Daniel Park , Haidar Khan , Azer Khan , Alex Gittens , Bülent Yener

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

Machine Learning · Computer Science 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

We formalize and analyze the trade-off between backdoor-based watermarks and adversarial defenses, framing it as an interactive protocol between a verifier and a prover. While previous works have primarily focused on this trade-off, our…

Machine Learning · Computer Science 2026-01-22 Grzegorz Głuch , Berkant Turan , Sai Ganesh Nagarajan , Sebastian Pokutta

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

Machine Learning · Computer Science 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

Adversarial examples represent a serious issue for the application of machine learning models in many sensitive domains. For generating adversarial examples, decision based black-box attacks are one of the most practical techniques as they…

Machine Learning · Computer Science 2024-11-20 Nicole Meng , Caleb Manicke , David Chen , Yingjie Lao , Caiwen Ding , Pengyu Hong , Kaleel Mahmood

Recent studies have shown that detectors based on deep models are vulnerable to adversarial examples, even in the black-box scenario where the attacker cannot access the model information. Most existing attack methods aim to minimize the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Siyuan Liang , Longkang Li , Yanbo Fan , Xiaojun Jia , Jingzhi Li , Baoyuan Wu , Xiaochun Cao

Vulnerability of various machine learning methods to adversarial examples has been recently explored in the literature. Power systems which use these vulnerable methods face a huge threat against adversarial examples. To this end, we first…

Cryptography and Security · Computer Science 2022-02-16 Jiwei Tian , Buhong Wang , Jing Li , Zhen Wang , Mete Ozay

Opacity and attack detectability are important properties for any system as they allow the states to remain private and malicious attacks to be detected, respectively. In this paper, we show that a fundamental trade-off exists between these…

Systems and Control · Electrical Eng. & Systems 2022-06-14 Varkey M. John , Vaibhav Katewa

In this paper, we investigate the impact of test-time adversarial attacks on linear regression models and determine the optimal level of robustness that any model can reach while maintaining a given level of standard predictive performance…

Machine Learning · Statistics 2023-08-02 Elvis Dohmatob , Meyer Scetbon

Adversarial attacks remain a significant threat that can jeopardize the integrity of Machine Learning (ML) models. In particular, query-based black-box attacks can generate malicious noise without having access to the victim model's…

Cryptography and Security · Computer Science 2025-03-18 Jeonghwan Park , Niall McLaughlin , Ihsen Alouani

In the last decade, deep learning algorithms have become very popular thanks to the achieved performance in many machine learning and computer vision tasks. However, most of the deep learning architectures are vulnerable to so called…

Cryptography and Security · Computer Science 2018-09-07 Olga Taran , Shideh Rezaeifar , Slava Voloshynovskiy

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the network by submitting…

Cryptography and Security · Computer Science 2022-06-10 Huiying Li , Shawn Shan , Emily Wenger , Jiayun Zhang , Haitao Zheng , Ben Y. Zhao

Recently, researchers have discovered that the state-of-the-art object classifiers can be fooled easily by small perturbations in the input unnoticeable to human eyes. It is also known that an attacker can generate strong adversarial…

Machine Learning · Computer Science 2018-06-28 Jihun Hamm , Akshay Mehra

Machine learning models are vulnerable to simple model stealing attacks if the adversary can obtain output labels for chosen inputs. To protect against these attacks, it has been proposed to limit the information provided to the adversary…

Machine Learning · Computer Science 2018-12-14 Taesung Lee , Benjamin Edwards , Ian Molloy , Dong Su

Machine learning algorithms are effective in several applications, but they are not as much successful when applied to intrusion detection in cyber security. Due to the high sensitivity to their training data, cyber detectors based on…

Cryptography and Security · Computer Science 2021-06-15 Giovanni Apruzzese , Mauro Andreolini , Michele Colajanni , Mirco Marchetti

Though deep neural networks have achieved state-of-the-art performance in visual classification, recent studies have shown that they are all vulnerable to the attack of adversarial examples. Small and often imperceptible perturbations to…

Machine Learning · Computer Science 2018-06-05 Pinlong Zhao , Zhouyu Fu , Ou wu , Qinghua Hu , Jun Wang

Deepfakes pose growing challenges to the trust of information on the Internet. Thus, detecting deepfakes has attracted increasing attentions from both academia and industry. State-of-the-art deepfake detection methods consist of two key…

Cryptography and Security · Computer Science 2021-10-08 Xiaoyu Cao , Neil Zhenqiang Gong

Despite considerable efforts on making them robust, real-world AI-based systems remain vulnerable to decision based attacks, as definitive proofs of their operational robustness have so far proven intractable. Canonical robustness…

Artificial Intelligence · Computer Science 2025-05-07 Ilias Tsingenopoulos , Vera Rimmer , Davy Preuveneers , Fabio Pierazzi , Lorenzo Cavallaro , Wouter Joosen