English
Related papers

Related papers: Randomized Smoothing Meets Vision-Language Models

200 papers

Randomized Smoothing (RS) is a promising technique for certified robustness, and recently in RS the ensemble of multiple Deep Neural Networks (DNNs) has shown state-of-the-art performances due to its variance reduction effect over Gaussian…

Machine Learning · Computer Science 2025-04-14 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Xiaolin Huang , Jie Yang

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Neural networks (NNs) are known to be vulnerable against adversarial perturbations, and thus there is a line of work aiming to provide robustness certification for NNs, such as randomized smoothing, which samples smoothing noises from a…

Machine Learning · Computer Science 2023-02-01 Linyi Li , Jiawei Zhang , Tao Xie , Bo Li

Federated learning is an emerging data-private distributed learning framework, which, however, is vulnerable to adversarial attacks. Although several heuristic defenses are proposed to enhance the robustness of federated learning, they do…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Bhavya Kailkhura , Ryan Goldhahn , Yi Zhou

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbed input with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanbin Hong , Yuan Hong

Tree-based models are used in many high-stakes application domains such as finance and medicine, where robustness and interpretability are of utmost importance. Yet, methods for improving and certifying their robustness are severely…

Machine Learning · Computer Science 2022-11-16 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Although large language models (LLMs) have achieved great success in vast real-world applications, their vulnerabilities towards noisy inputs have significantly limited their uses, especially in high-stake environments. In these contexts,…

Computation and Language · Computer Science 2023-07-17 Zhen Zhang , Guanhua Zhang , Bairu Hou , Wenqi Fan , Qing Li , Sijia Liu , Yang Zhang , Shiyu Chang

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin

Randomized smoothing is a general technique for computing sample-dependent robustness guarantees against adversarial attacks for deep classifiers. Prior works on randomized smoothing against L_1 adversarial attacks use additive smoothing…

Machine Learning · Computer Science 2021-06-14 Alexander Levine , Soheil Feizi

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

Machine Learning · Computer Science 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or $\ell_\infty$;…

Machine Learning · Computer Science 2020-07-27 Greg Yang , Tony Duan , J. Edward Hu , Hadi Salman , Ilya Razenshteyn , Jerry Li

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm. This "randomized smoothing" technique has been proposed…

Machine Learning · Computer Science 2019-06-18 Jeremy M Cohen , Elan Rosenfeld , J. Zico Kolter

Recently, the issue of adversarial robustness in the time series domain has garnered significant attention. However, the available defense mechanisms remain limited, with adversarial training being the predominant approach, though it does…

Machine Learning · Computer Science 2024-09-20 Chang Dong , Zhengyang Li , Liangwei Zheng , Weitong Chen , Wei Emma Zhang

As a certified defensive technique, randomized smoothing has received considerable attention due to its scalability to large datasets and neural networks. However, several important questions remain unanswered, such as (i) whether the…

Machine Learning · Computer Science 2020-06-09 Tianhang Zheng , Di Wang , Baochun Li , Jinhui Xu

The widespread deployment of pre-trained language models (PLMs) has exposed them to textual backdoor attacks, particularly those planted during the pre-training stage. These attacks pose significant risks to high-reliability applications,…

Machine Learning · Computer Science 2025-02-12 Bowei He , Lihao Yin , Hui-Ling Zhen , Jianping Zhang , Lanqing Hong , Mingxuan Yuan , Chen Ma

Certified defenses such as randomized smoothing have shown promise towards building reliable machine learning systems against $\ell_p$-norm bounded attacks. However, existing methods are insufficient or unable to provably defend against…

Machine Learning · Computer Science 2022-06-30 Zhongkai Hao , Chengyang Ying , Yinpeng Dong , Hang Su , Jun Zhu , Jian Song

Large-scale pre-trained language models have shown outstanding performance in a variety of NLP tasks. However, they are also known to be significantly brittle against specifically crafted adversarial examples, leading to increasing interest…

Computation and Language · Computer Science 2023-05-12 Han Cheol Moon , Shafiq Joty , Ruochen Zhao , Megh Thakkar , Xu Chi

This paper presents preliminary work on a novel connection between certified robustness in machine learning and the modeling of 3D objects. We highlight an intriguing link between the Maximal Certified Radius (MCR) of a classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Gabriel Pérez S , Juan C. Pérez , Motasem Alfarra , Jesús Zarzar , Sara Rojas , Bernard Ghanem , Pablo Arbeláez

Offline reinforcement learning (RL) provides a promising direction to exploit massive amount of offline data for complex decision-making tasks. Due to the distribution shift issue, current offline RL algorithms are generally designed to be…

Machine Learning · Computer Science 2022-10-25 Rui Yang , Chenjia Bai , Xiaoteng Ma , Zhaoran Wang , Chongjie Zhang , Lei Han