English
Related papers

Related papers: Post-train Black-box Defense via Bayesian Boundary…

200 papers

Neural networks have demonstrated remarkable success in learning and solving complex tasks in a variety of fields. Nevertheless, the rise of those networks in modern computing has been accompanied by concerns regarding their vulnerability…

Cryptography and Security · Computer Science 2023-03-03 Rabiah Al-qudah , Moayad Aloqaily , Bassem Ouni , Mohsen Guizani , Thierry Lestable

As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such…

Machine Learning · Computer Science 2020-02-04 Dylan Slack , Sophie Hilgard , Emily Jia , Sameer Singh , Himabindu Lakkaraju

Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few training samples. The attacked model behaves normally on benign…

Cryptography and Security · Computer Science 2022-02-09 Kunzhe Huang , Yiming Li , Baoyuan Wu , Zhan Qin , Kui Ren

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma

Backdoor attacks can implant malicious behaviours into deep models while preserving performance on clean data, posing a serious threat to safety-critical vision systems. Although backdoor mitigation has been studied extensively for image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

The vulnerability of deep networks to adversarial attacks is a central problem for deep learning from the perspective of both cognition and security. The current most successful defense method is to train a classifier using adversarial…

Machine Learning · Statistics 2021-03-22 Mitch Hill , Jonathan Mitchell , Song-Chun Zhu

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

Machine Learning · Computer Science 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

We propose a novel weakly supervised learning segmentation based on several global constraints derived from box annotations. Particularly, we leverage a classical tightness prior to a deep learning setting via imposing a set of constraints…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Hoel Kervadec , Jose Dolz , Shanshan Wang , Eric Granger , Ismail Ben Ayed

Deep Learning has been shown to be particularly vulnerable to adversarial samples. To combat adversarial strategies, numerous defensive techniques have been proposed. Among these, a promising approach is to use randomness in order to make…

Cryptography and Security · Computer Science 2020-03-18 Kumar Sharad , Giorgia Azzurra Marson , Hien Thi Thu Truong , Ghassan Karame

Machine learning models can learn from data samples to carry out various tasks efficiently. When data samples are adversarially manipulated, such as by insertion of carefully crafted noise, it can cause the model to make mistakes. Quantum…

Quantum Physics · Physics 2026-05-01 Emma Andrews , Sahan Sanjaya , Prabhat Mishra

Adversarial examples have posed a severe threat to deep neural networks due to their transferable nature. Currently, various works have paid great efforts to enhance the cross-model transferability, which mostly assume the substitute model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Qilong Zhang , Xiaodan Li , Yuefeng Chen , Jingkuan Song , Lianli Gao , Yuan He , Hui Xue

Third-party resources ($e.g.$, samples, backbones, and pre-trained models) are usually involved in the training of deep neural networks (DNNs), which brings backdoor attacks as a new training-phase threat. In general, backdoor attackers…

Cryptography and Security · Computer Science 2023-02-06 Yiming Li , Mengxi Ya , Yang Bai , Yong Jiang , Shu-Tao Xia

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Modern machine learning models with very high accuracy have been shown to be vulnerable to small, adversarially chosen perturbations of the input. Given black-box access to a high-accuracy classifier $f$, we show how to construct a new…

Machine Learning · Computer Science 2019-12-17 Grzegorz Głuch , Rüdiger Urbanke

Well-known (non-malicious) sources of overfitting in deep neural net (DNN) classifiers include: i) large class imbalances; ii) insufficient training-set diversity; and iii) over-training. In recent work, it was shown that backdoor…

Machine Learning · Computer Science 2023-10-02 Hang Wang , David J. Miller , George Kesidis

An adversarial example is a modified input image designed to cause a Machine Learning (ML) model to make a mistake; these perturbations are often invisible or subtle to human observers and highlight vulnerabilities in a model's ability to…

Cryptography and Security · Computer Science 2024-11-04 Ehsan Ganjidoost , Jeff Orchard

Though deep neural networks have achieved state-of-the-art performance in visual classification, recent studies have shown that they are all vulnerable to the attack of adversarial examples. Small and often imperceptible perturbations to…

Machine Learning · Computer Science 2018-06-05 Pinlong Zhao , Zhouyu Fu , Ou wu , Qinghua Hu , Jun Wang

Certified defense using randomized smoothing is a popular technique to provide robustness guarantees for deep neural networks against l2 adversarial attacks. Existing works use this technique to provably secure a pretrained non-robust model…

Machine Learning · Computer Science 2022-10-18 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Recent works have shown that the input domain of any machine learning classifier is bound to contain adversarial examples. Thus we can no longer hope to immune classifiers against adversarial examples and instead can only aim to achieve the…

Machine Learning · Computer Science 2020-09-25 Gil Fidel , Ron Bitton , Ziv Katzir , Asaf Shabtai