中文
相关论文

相关论文: Certifying Confidence via Randomized Smoothing

200 篇论文

This paper is a contribution to the reproducibility challenge in the field of machine learning, specifically addressing the issue of certifying the robustness of neural networks (NNs) against adversarial perturbations. The proposed Double…

机器学习 · 计算机科学 2023-06-28 Aryan Gupta , Sarthak Gupta , Abhay Kumar , Harsh Dugar

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

机器学习 · 计算机科学 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

Only recently, researchers attempt to provide classification algorithms with provable group fairness guarantees. Most of these algorithms suffer from harassment caused by the requirement that the training and deployment data follow the same…

机器学习 · 计算机科学 2022-06-24 Jiayin Jin , Zeru Zhang , Yang Zhou , Lingfei Wu

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

机器学习 · 计算机科学 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Randomized Smoothing (RS) is a prominent technique for certifying the robustness of neural networks against adversarial perturbations. With RS, achieving high accuracy at small radii requires a small noise variance, while achieving high…

机器学习 · 计算机科学 2026-03-10 Chenhao Sun , Yuhao Mao , Martin Vechev

Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably…

机器学习 · 计算机科学 2024-11-12 Yan Scholten , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

Machine learning-based static malware detectors remain vulnerable to adversarial evasion techniques, such as metamorphic engine mutations. To address this vulnerability, we propose a certifiably robust malware detection framework based on…

密码学与安全 · 计算机科学 2026-04-23 Nandakrishna Giri , Asmitha K. A. , Serena Nicolazzo , Antonino Nocera , Vinod P

Although large language models (LLMs) have achieved great success in vast real-world applications, their vulnerabilities towards noisy inputs have significantly limited their uses, especially in high-stake environments. In these contexts,…

计算与语言 · 计算机科学 2023-07-17 Zhen Zhang , Guanhua Zhang , Bairu Hou , Wenqi Fan , Qing Li , Sijia Liu , Yang Zhang , Shiyu Chang

Certification for machine learning is proving that no adversarial sample can evade a model within a range under certain conditions, a necessity for safety-critical domains. Common certification methods for segmentation use a flat set of…

机器学习 · 计算机科学 2024-06-05 Alaa Anani , Tobias Lorenz , Bernt Schiele , Mario Fritz

Confidence estimation aims to quantify the confidence of the model prediction, providing an expectation of success. A well-calibrated confidence estimate enables accurate failure prediction and proper risk measurement when given noisy…

计算与语言 · 计算机科学 2022-03-23 Yu Lu , Jiali Zeng , Jiajun Zhang , Shuangzhi Wu , Mu Li

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

In response to subtle adversarial examples flipping classifications of neural network models, recent research has promoted certified robustness as a solution. There, invariance of predictions to all norm-bounded attacks is achieved through…

机器学习 · 计算机科学 2022-10-13 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

Although randomized smoothing has demonstrated high certified robustness and superior scalability to other certified defenses, the high computational overhead of the robustness certification bottlenecks the practical applicability, as it…

计算机视觉与模式识别 · 计算机科学 2021-12-23 Ruoxin Chen , Jie Li , Junchi Yan , Ping Li , Bin Sheng

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

Post-hoc attribution methods aim to explain deep learning predictions by highlighting influential input pixels. However, these explanations are highly non-robust: small, imperceptible input perturbations can drastically alter the…

机器学习 · 计算机科学 2025-06-19 Alaa Anani , Tobias Lorenz , Mario Fritz , Bernt Schiele

Randomized smoothing (RS) is a well known certified defense against adversarial attacks, which creates a smoothed classifier by predicting the most likely class under random noise perturbations of inputs during inference. While initial work…

机器学习 · 计算机科学 2023-04-21 Soumalya Nandi , Sravanti Addepalli , Harsh Rangwani , R. Venkatesh Babu

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or $\ell_\infty$;…

机器学习 · 计算机科学 2020-07-27 Greg Yang , Tony Duan , J. Edward Hu , Hadi Salman , Ilya Razenshteyn , Jerry Li

We show a hardness result for random smoothing to achieve certified adversarial robustness against attacks in the $\ell_p$ ball of radius $\epsilon$ when $p>2$. Although random smoothing has been well understood for the $\ell_2$ case using…

机器学习 · 计算机科学 2020-03-06 Avrim Blum , Travis Dick , Naren Manoj , Hongyang Zhang

Implicit models such as Deep Equilibrium Models (DEQs) have emerged as promising alternative approaches for building deep neural networks. Their certified robustness has gained increasing research attention due to security concerns.…

机器学习 · 计算机科学 2024-11-05 Weizhi Gao , Zhichao Hou , Han Xu , Xiaorui Liu

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed to defend against…

密码学与安全 · 计算机科学 2020-07-21 Binghui Wang , Xiaoyu Cao , Jinyuan jia , Neil Zhenqiang Gong