English
Related papers

Related papers: Promoting Robustness of Randomized Smoothing: Two …

200 papers

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

Recent studies have identified a critical challenge in deep neural networks (DNNs) known as ``robust fairness", where models exhibit significant disparities in robust accuracy across different classes. While prior work has attempted to…

Machine Learning · Computer Science 2025-03-24 Gaojie Jin , Tianjin Huang , Ronghui Mu , Xiaowei Huang

Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably…

Machine Learning · Computer Science 2024-11-12 Yan Scholten , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

For many queries in the Web retrieval setting there is an on-going ranking competition: authors manipulate their documents so as to promote them in rankings. Such competitions can have unwarranted effects not only in terms of retrieval…

Information Retrieval · Computer Science 2018-06-14 Gregory Goren , Oren Kurland , Moshe Tennenholtz , Fiana Raiber

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Fatemeh Amerehi , Patrick Healy

Mixture of Experts (MoE) have shown remarkable success in leveraging specialized expert networks for complex machine learning tasks. However, their susceptibility to adversarial attacks presents a critical challenge for deployment in robust…

Machine Learning · Computer Science 2025-05-28 Xu Zhang , Kaidi Xu , Ziqing Hu , Ren Wang

Randomized smoothing is considered to be the state-of-the-art provable defense against adversarial perturbations. However, it heavily exploits the fact that classifiers map input objects to class probabilities and do not focus on the ones…

Machine Learning · Computer Science 2023-06-06 Mikhail Pautov , Olesya Kuznetsova , Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety. Current robustness certificates for graph classifiers guarantee output invariance with respect to the total number of node pair flips…

Machine Learning · Computer Science 2023-06-27 Pierre Osselin , Henry Kenlay , Xiaowen Dong

With the rise of powerful foundation models, a pre-training-fine-tuning paradigm becomes increasingly popular these days: A foundation model is pre-trained using a huge amount of data from various sources, and then the downstream users only…

Machine Learning · Computer Science 2025-04-16 Meiqi Liu , Zhuoqun Huang , Yue Xing

Robust Model-Agnostic Meta-Learning (MAML) is usually adopted to train a meta-model which may fast adapt to novel classes with only a few exemplars and meanwhile remain robust to adversarial attacks. The conventional solution for robust…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Xiaoyue Duan , Guoliang Kang , Runqi Wang , Shumin Han , Song Xue , Tian Wang , Baochang Zhang

Noise injection-based method has been shown to be able to improve the robustness of artificial neural networks in previous work. In this work, we propose a novel noise injection-based training scheme for better model robustness.…

Machine Learning · Computer Science 2023-05-30 Zeliang Zhang , Jinyang Jiang , Minjie Chen , Zhiyuan Wang , Yijie Peng , Zhaofei Yu

Randomized ensemble classifiers (RECs), where one classifier is randomly selected during inference, have emerged as an attractive alternative to traditional ensembling methods for realizing adversarially robust classifiers with limited…

Machine Learning · Computer Science 2023-05-30 Hassan Dbouk , Naresh R. Shanbhag

Randomized smoothing is the primary certified robustness method for accessing the robustness of deep learning models to adversarial perturbations in the l2-norm, by adding isotropic Gaussian noise to the input image and returning the…

Machine Learning · Computer Science 2024-04-09 Chengyan Fu , Wenjie Wang

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite the growing popularity of MoE, little work investigated its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Zhang , Ruisi Cai , Tianlong Chen , Guanhua Zhang , Huan Zhang , Pin-Yu Chen , Shiyu Chang , Zhangyang Wang , Sijia Liu

A reliable application of deep neural network classifiers requires robustness certificates against adversarial perturbations. Gaussian smoothing is a widely analyzed approach to certifying robustness against norm-bounded perturbations,…

Machine Learning · Computer Science 2024-09-23 Hossein Goli , Farzan Farnia

Along with recent diffusion models, randomized smoothing has become one of a few tangible approaches that offers adversarial robustness to models at scale, e.g., those of large pre-trained models. Specifically, one can perform randomized…

Machine Learning · Computer Science 2023-10-30 Jongheon Jeong , Jinwoo Shin