English
Related papers

Related papers: SmoothMix: Training Confidence-calibrated Smoothed…

200 papers

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

Machine Learning · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

Randomized Smoothing (RS) is a promising technique for certified robustness, and recently in RS the ensemble of multiple Deep Neural Networks (DNNs) has shown state-of-the-art performances due to its variance reduction effect over Gaussian…

Machine Learning · Computer Science 2025-04-14 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Xiaolin Huang , Jie Yang

Deep neural classifiers have recently found tremendous success in data-driven control systems. However, existing models suffer from a trade-off between accuracy and adversarial robustness. This limitation must be overcome in the control of…

Machine Learning · Computer Science 2024-06-05 Yatong Bai , Brendon G. Anderson , Somayeh Sojoudi

We study certified robustness of machine learning classifiers against adversarial perturbations. In particular, we propose the first universally approximated certified robustness (UniCR) framework, which can approximate the robustness…

Machine Learning · Computer Science 2022-07-12 Hanbin Hong , Binghui Wang , Yuan Hong

Randomized smoothing is a general technique for computing sample-dependent robustness guarantees against adversarial attacks for deep classifiers. Prior works on randomized smoothing against L_1 adversarial attacks use additive smoothing…

Machine Learning · Computer Science 2021-06-14 Alexander Levine , Soheil Feizi

As a certified defensive technique, randomized smoothing has received considerable attention due to its scalability to large datasets and neural networks. However, several important questions remain unanswered, such as (i) whether the…

Machine Learning · Computer Science 2020-06-09 Tianhang Zheng , Di Wang , Baochun Li , Jinhui Xu

Advances in adversarial defenses have led to a significant improvement in the robustness of Deep Neural Networks. However, the robust accuracy of present state-ofthe-art defenses is far from the requirements in critical applications such as…

Machine Learning · Computer Science 2023-06-13 Sravanti Addepalli , Samyak Jain , Gaurang Sriramanan , R. Venkatesh Babu

Recent studies have shown that regularization techniques using soft labels, e.g., label smoothing, Mixup, and CutMix, not only enhance image classification accuracy but also mitigate miscalibration due to overconfident predictions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jonghyun Park , Juyeop Kim , Jong-Seok Lee

Overconfidence has been shown to impair generalization and calibration of a neural network. Previous studies remedy this issue by adding a regularization term to a loss function, preventing a model from making a peaked distribution. Label…

Machine Learning · Computer Science 2022-10-26 Dongkyu Lee , Ka Chun Cheung , Nevin L. Zhang

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

Machine learning-based static malware detectors remain vulnerable to adversarial evasion techniques, such as metamorphic engine mutations. To address this vulnerability, we propose a certifiably robust malware detection framework based on…

Cryptography and Security · Computer Science 2026-04-23 Nandakrishna Giri , Asmitha K. A. , Serena Nicolazzo , Antonino Nocera , Vinod P

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

Machine Learning · Computer Science 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably…

Machine Learning · Computer Science 2024-11-12 Yan Scholten , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

Smoothing classifiers and probability density functions with Gaussian kernels appear unrelated, but in this work, they are unified for the problem of robust classification. The key building block is approximating the $\textit{energy…

Machine Learning · Statistics 2020-05-12 Saeed Saremi , Rupesh Srivastava

Adversarial data examples have drawn significant attention from the machine learning and security communities. A line of work on tackling adversarial examples is certified robustness via randomized smoothing that can provide a theoretical…

Machine Learning · Computer Science 2021-08-24 Haowen Lin , Jian Lou , Li Xiong , Cyrus Shahabi

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

The conventional success of textual classification relies on annotated data, and the new paradigm of pre-trained language models (PLMs) still requires a few labeled data for downstream tasks. However, in real-world applications, label noise…

Computation and Language · Computer Science 2022-10-14 Dan Qiao , Chenchen Dai , Yuyang Ding , Juntao Li , Qiang Chen , Wenliang Chen , Min Zhang

Implicit models such as Deep Equilibrium Models (DEQs) have emerged as promising alternative approaches for building deep neural networks. Their certified robustness has gained increasing research attention due to security concerns.…

Machine Learning · Computer Science 2024-11-05 Weizhi Gao , Zhichao Hou , Han Xu , Xiaorui Liu

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Randomized Smoothing (RS) is a promising method for obtaining robustness certificates by evaluating a base model under noise. In this work, we: (i) theoretically motivate why ensembles are a particularly suitable choice as base models for…

Machine Learning · Computer Science 2022-03-31 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev