English
Related papers

Related papers: Smoothed Embeddings for Certified Few-Shot Learnin…

200 papers

Strong theoretical guarantees of robustness can be given for ensembles of classifiers generated by input randomization. Specifically, an $\ell_2$ bounded adversary cannot alter the ensemble prediction generated by an additive isotropic…

Machine Learning · Computer Science 2020-02-28 Guang-He Lee , Yang Yuan , Shiyu Chang , Tommi S. Jaakkola

Smoothing classifiers and probability density functions with Gaussian kernels appear unrelated, but in this work, they are unified for the problem of robust classification. The key building block is approximating the $\textit{energy…

Machine Learning · Statistics 2020-05-12 Saeed Saremi , Rupesh Srivastava

Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably…

Machine Learning · Computer Science 2024-11-12 Yan Scholten , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

Deep Neural Networks are vulnerable to small perturbations that can drastically alter their predictions for perceptually unchanged inputs. The literature on adversarially robust Deep Learning attempts to either enhance the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Thomas Massena , Corentin Friedrich , Franck Mamalet , Mathieu Serrurier

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed to defend against…

Cryptography and Security · Computer Science 2020-07-21 Binghui Wang , Xiaoyu Cao , Jinyuan jia , Neil Zhenqiang Gong

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

Recently, the issue of adversarial robustness in the time series domain has garnered significant attention. However, the available defense mechanisms remain limited, with adversarial training being the predominant approach, though it does…

Machine Learning · Computer Science 2024-09-20 Chang Dong , Zhengyang Li , Liangwei Zheng , Weitong Chen , Wei Emma Zhang

Reinforcement Learning (RL) has achieved remarkable success in safety-critical areas, but it can be weakened by adversarial attacks. Recent studies have introduced "smoothed policies" in order to enhance its robustness. Yet, it is still…

Machine Learning · Computer Science 2023-12-13 Ronghui Mu , Leandro Soriano Marcolino , Tianle Zhang , Yanghao Zhang , Xiaowei Huang , Wenjie Ruan

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

Few-shot classification algorithms can alleviate the data scarceness issue, which is vital in many real-world problems, by adopting models pre-trained from abundant data in other domains. However, the pre-training process was commonly…

Machine Learning · Computer Science 2020-03-03 Chao Wang , Ruo-Ze Liu , Han-Jia Ye , Yang Yu

Few-shot image classification, where the goal is to generalize to tasks with limited labeled data, has seen great progress over the years. However, the classifiers are vulnerable to adversarial examples, posing a question regarding their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Akshayvarun Subramanya , Hamed Pirsiavash

Randomized smoothing (RS) has been shown to be a fast, scalable technique for certifying the robustness of deep neural network classifiers. However, methods based on RS require augmenting data with large amounts of noise, which leads to…

Machine Learning · Computer Science 2022-05-13 Ameya Joshi , Minh Pham , Minsu Cho , Leonid Boytsov , Filipe Condessa , J. Zico Kolter , Chinmay Hegde

The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an…

Machine Learning · Computer Science 2019-11-28 Chao Tang , Yifei Fan , Anthony Yezzi

Randomized smoothing has emerged as a potent certifiable defense against adversarial attacks by employing smoothing noises from specific distributions to ensure the robustness of a smoothed classifier. However, the utilization of Monte…

Machine Learning · Computer Science 2025-04-01 Devansh Bhardwaj , Kshitiz Kaushik , Sarthak Gupta

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

Certified defenses such as randomized smoothing have shown promise towards building reliable machine learning systems against $\ell_p$-norm bounded attacks. However, existing methods are insufficient or unable to provably defend against…

Machine Learning · Computer Science 2022-06-30 Zhongkai Hao , Chengyang Ying , Yinpeng Dong , Hang Su , Jun Zhu , Jian Song

Designing neural networks with bounded Lipschitz constant is a promising way to obtain certifiably robust classifiers against adversarial examples. However, the relevant progress for the important $\ell_\infty$ perturbation setting is…

Machine Learning · Computer Science 2022-10-28 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Implicit models such as Deep Equilibrium Models (DEQs) have emerged as promising alternative approaches for building deep neural networks. Their certified robustness has gained increasing research attention due to security concerns.…

Machine Learning · Computer Science 2024-11-05 Weizhi Gao , Zhichao Hou , Han Xu , Xiaorui Liu

Randomized smoothing has achieved state-of-the-art certified robustness against $l_2$-norm adversarial attacks. However, it is not wholly resolved on how to find the optimal base classifier for randomized smoothing. In this work, we employ…

Machine Learning · Computer Science 2021-02-24 Chizhou Liu , Yunzhen Feng , Ranran Wang , Bin Dong