English
Related papers

Related papers: Smooth-Reduce: Leveraging Patches for Improved Cer…

200 papers

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

In Deep Learning, Stochastic Gradient Descent (SGD) is usually selected as a training method because of its efficiency; however, recently, a problem in SGD gains research interest: sharp minima in Deep Neural Networks (DNNs) have poor…

Machine Learning · Computer Science 2018-12-04 Wei Wen , Yandan Wang , Feng Yan , Cong Xu , Chunpeng Wu , Yiran Chen , Hai Li

Training foundation models on extensive datasets and then finetuning them on specific tasks has emerged as the mainstream approach in artificial intelligence. However, the model robustness, which is a critical aspect for safety, is often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Kai Qiu , Huishuai Zhang , Zhirong Wu , Stephen Lin

As deep learning models continue to advance and are increasingly utilized in real-world systems, the issue of robustness remains a major challenge. Existing certified training methods produce models that achieve high provable robustness…

Machine Learning · Computer Science 2023-07-26 Zhakshylyk Nurlanov , Frank R. Schmidt , Florian Bernard

Person re-identification (re-id) is a cross-camera retrieval task which establishes a correspondence between images of a person from multiple cameras. Deep Learning methods have been successfully applied to this problem and have achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Jean-Paul Ainam , Ke Qin , Guisong Liu , Guangchun Luo

Large-scale pre-trained language models have shown outstanding performance in a variety of NLP tasks. However, they are also known to be significantly brittle against specifically crafted adversarial examples, leading to increasing interest…

Computation and Language · Computer Science 2023-05-12 Han Cheol Moon , Shafiq Joty , Ruochen Zhao , Megh Thakkar , Xu Chi

Deep Neural Network (DNN) based classifiers have recently been used for the modulation classification of RF signals. These classifiers have shown impressive performance gains relative to conventional methods, however, they are vulnerable to…

Machine Learning · Computer Science 2024-10-10 Wenhan Zhang , Meiyu Zhong , Ravi Tandon , Marwan Krunz

Optimising a ranking-based metric, such as Average Precision (AP), is notoriously challenging due to the fact that it is non-differentiable, and hence cannot be optimised directly using gradient-descent methods. To this end, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Andrew Brown , Weidi Xie , Vicky Kalogeiton , Andrew Zisserman

Certified robustness circumvents the fragility of defences against adversarial attacks, by endowing model predictions with guarantees of class invariance for attacks up to a calculated size. While there is value in these certifications, the…

Machine Learning · Computer Science 2023-09-21 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

Deep neural networks are vulnerable to input deformations in the form of vector fields of pixel displacements and to other parameterized geometric deformations e.g. translations, rotations, etc. Current input deformation certification…

Machine Learning · Computer Science 2021-12-21 Motasem Alfarra , Adel Bibi , Naeemullah Khan , Philip H. S. Torr , Bernard Ghanem

The study of provable adversarial robustness for deep neural networks (DNNs) has mainly focused on static supervised learning tasks such as image classification. However, DNNs have been used extensively in real-world adaptive tasks such as…

Machine Learning · Computer Science 2022-05-31 Aounon Kumar , Alexander Levine , Soheil Feizi

This paper proposes a novel, abstraction-based, certified training method for robust image classifiers. Via abstraction, all perturbed images are mapped into intervals before feeding into neural networks for training. By training on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Zhaodi Zhang , Zhiyi Xue , Yang Chen , Si Liu , Yueling Zhang , Jing Liu , Min Zhang

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

Machine Learning · Computer Science 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

With the growing integration of AI in daily life, ensuring the robustness of systems to inference-time attacks is crucial. Among the approaches for certifying robustness to such adversarial examples, randomized smoothing has emerged as…

Computation and Language · Computer Science 2024-08-02 Zhuoqun Huang , Neil G Marchant , Olga Ohrimenko , Benjamin I. P. Rubinstein

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

Machine Learning · Computer Science 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

We propose Adaptive Diffusion Denoised Smoothing, a method for certifying the predictions of a vision model against adversarial examples, while adapting to the input. Our key insight is to reinterpret a guided denoising diffusion model as a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Frederick Shpilevskiy , Saiyue Lyu , Krishnamurthy Dj Dvijotham , Mathias Lécuyer , Pierre-André Noël

Randomized smoothing is a popular certified defense against adversarial attacks. In its essence, we need to solve a problem of statistical estimation which is usually very time-consuming since we need to perform numerous (usually $10^5$)…

Machine Learning · Statistics 2025-01-22 Vaclav Voracek