English
Related papers

Related papers: How to Robustify Black-Box ML Models? A Zeroth-Ord…

200 papers

Despite considerable efforts on making them robust, real-world AI-based systems remain vulnerable to decision based attacks, as definitive proofs of their operational robustness have so far proven intractable. Canonical robustness…

Artificial Intelligence · Computer Science 2025-05-07 Ilias Tsingenopoulos , Vera Rimmer , Davy Preuveneers , Fabio Pierazzi , Lorenzo Cavallaro , Wouter Joosen

While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form of small, carefully chosen perturbations of their input,…

Machine Learning · Computer Science 2019-06-11 Cecilia Summers , Michael J. Dinneen

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but not against black-box…

Artificial Intelligence · Computer Science 2024-02-13 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Black-box optimization (BBO) addresses problems where objectives are accessible only through costly queries without gradients or explicit structure. Classical derivative-free methods -- line search, direct search, and model-based solvers…

Machine Learning · Computer Science 2025-10-01 Morteza Kimiaei , Vyacheslav Kungurtsev

It is becoming increasingly imperative to design robust ML defenses. However, recent work has found that many defenses that initially resist state-of-the-art attacks can be broken by an adaptive adversary. In this work we take steps to…

Machine Learning · Computer Science 2023-02-28 Keane Lucas , Matthew Jagielski , Florian Tramèr , Lujo Bauer , Nicholas Carlini

Robust machine learning is currently one of the most prominent topics which could potentially help shaping a future of advanced AI platforms that not only perform well in average cases but also in worst cases or adverse situations. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Pu Zhao , Sijia Liu , Pin-Yu Chen , Nghia Hoang , Kaidi Xu , Bhavya Kailkhura , Xue Lin

Zeroth-order optimization is an important research topic in machine learning. In recent years, it has become a key tool in black-box adversarial attack to neural network based image classifiers. However, existing zeroth-order optimization…

Machine Learning · Computer Science 2019-03-21 Haishan Ye , Zhichao Huang , Cong Fang , Chris Junchi Li , Tong Zhang

Reducing the memory footprint of Machine Learning (ML) models, particularly Deep Neural Networks (DNNs), is essential to enable their deployment into resource-constrained tiny devices. However, a disadvantage of DNN models is their…

Machine Learning · Computer Science 2023-04-26 Ferheen Ayaz , Idris Zakariyya , José Cano , Sye Loong Keoh , Jeremy Singer , Danilo Pau , Mounia Kharbouche-Harrari

Deep neural networks (DNNs) have demonstrated impressive performance on many challenging machine learning tasks. However, DNNs are vulnerable to adversarial inputs generated by adding maliciously crafted perturbations to the benign inputs.…

Machine Learning · Computer Science 2019-10-29 Ka-Ho Chow , Wenqi Wei , Yanzhao Wu , Ling Liu

Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models…

Computation and Language · Computer Science 2024-04-19 Jiabao Ji , Bairu Hou , Zhen Zhang , Guanhua Zhang , Wenqi Fan , Qing Li , Yang Zhang , Gaowen Liu , Sijia Liu , Shiyu Chang

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples which contain human-imperceptible perturbations. A series of defending methods, either proactive defence or reactive defence, have been proposed in the recent…

Machine Learning · Computer Science 2020-07-27 Derek Wang , Chaoran Li , Sheng Wen , Surya Nepal , Yang Xiang

Randomized smoothing is a recent and celebrated solution to certify the robustness of any classifier. While it indeed provides a theoretical robustness against adversarial attacks, the dimensionality of current classifiers necessarily…

Cryptography and Security · Computer Science 2022-05-02 Thibault Maho , Teddy Furon , Erwan Le Merrer

Numerous methods for crafting adversarial examples were proposed recently with high success rate. Since most existing machine learning based classifiers normalize images into some continuous, real vector, domain firstly, attacks often craft…

Machine Learning · Computer Science 2020-04-28 Lei Bu , Yuchao Duan , Fu Song , Zhe Zhao

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Advances in Machine Learning (ML) have led to its adoption as an integral component in many applications, including banking, medical diagnosis, and driverless cars. To further broaden the use of ML models, cloud-based services offered by…

Machine Learning · Computer Science 2017-03-14 Hossein Hosseini , Yize Chen , Sreeram Kannan , Baosen Zhang , Radha Poovendran

Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Vivek B. S. , Konda Reddy Mopuri , R. Venkatesh Babu

Deep neural networks (DNNs) are vulnerable to adversarial noise. A range of adversarial defense techniques have been proposed to mitigate the interference of adversarial noise, among which the input pre-processing methods are scalable and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Dawei Zhou , Nannan Wang , Xinbo Gao , Bo Han , Jun Yu , Xiaoyu Wang , Tongliang Liu

Deep Learning has been shown to be particularly vulnerable to adversarial samples. To combat adversarial strategies, numerous defensive techniques have been proposed. Among these, a promising approach is to use randomness in order to make…

Cryptography and Security · Computer Science 2020-03-18 Kumar Sharad , Giorgia Azzurra Marson , Hien Thi Thu Truong , Ghassan Karame

Black-box adversarial attacks generate adversarial samples via iterative optimizations using repeated queries. Defending deep neural networks against such attacks has been challenging. In this paper, we propose an efficient Boundary Defense…

Cryptography and Security · Computer Science 2022-02-01 Manjushree B. Aithal , Xiaohua Li