English
Related papers

Related papers: Improving robustness to corruptions with multiplic…

200 papers

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against such attacks, an effective and popular approach, known as…

Machine Learning · Computer Science 2022-09-08 Gaoyuan Zhang , Songtao Lu , Yihua Zhang , Xiangyi Chen , Pin-Yu Chen , Quanfu Fan , Lee Martie , Lior Horesh , Mingyi Hong , Sijia Liu

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

Due to scene complexity, sensor inaccuracies, and processing imprecision, point cloud corruption is inevitable. Over-reliance on input features is the root cause of DNN vulnerabilities. It remains unclear whether this issue exists in 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhiqiang Tian , Weigang Li , Chunhua Deng , Junwei Hu , Yongqiang Wang , Wenping Liu

Deep Neural Networks (DNNs) are vulnerable to invisible perturbations on the images generated by adversarial attacks, which raises researches on the adversarial robustness of DNNs. A series of methods represented by the adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Jia Cai , Feipeng Cai , Xiaolin Huang , Jie Yang

Deep neural networks (DNNs) are effective in solving many real-world problems. Larger DNN models usually exhibit better quality (e.g., accuracy) but their excessive computation results in long inference time. Model sparsification can reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Xiaolong Ma , Minghai Qin , Fei Sun , Zejiang Hou , Kun Yuan , Yi Xu , Yanzhi Wang , Yen-Kuang Chen , Rong Jin , Yuan Xie

Deep neural networks (DNNs) have significantly boosted the performance of many challenging tasks. Despite the great development, DNNs have also exposed their vulnerability. Recent studies have shown that adversaries can manipulate the…

Cryptography and Security · Computer Science 2024-08-06 Liang-bo Ning , Zeyu Dai , Wenqi Fan , Jingran Su , Chao Pan , Luning Wang , Qing Li

Deep neural networks are not resilient to parameter corruptions: even a single-bitwise error in their parameters in memory can cause an accuracy drop of over 10%, and in the worst cases, up to 99%. This susceptibility poses great challenges…

Cryptography and Security · Computer Science 2025-04-03 Tahmid Hasan Prato , Seijoon Kim , Lizhong Chen , Sanghyun Hong

Deep neural networks (DNNs) could be deceived by generating human-imperceptible perturbations of clean samples. Therefore, enhancing the robustness of DNNs against adversarial attacks is a crucial task. In this paper, we aim to train robust…

Machine Learning · Computer Science 2024-01-23 Shayan Mohajer Hamidi , Linfeng Ye

Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Adversarial purification has achieved great success in combating adversarial image perturbations, which are usually assumed to be additive. However, non-additive adversarial perturbations such as blur, occlusion, and distortion are also…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Junjie Nan , Jianing Li , Wei Chen , Mingkun Zhang , Xueqi Cheng

Fully connected deep neural networks (DNN) often include redundant weights leading to overfitting and high memory requirements. Additionally, the performance of DNN is often challenged by traditional machine learning models in tabular data…

Machine Learning · Computer Science 2022-05-18 Manar Samad , Sakib Abrar

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

Robustness and compactness are two essential attributes of deep learning models that are deployed in the real world. The goals of robustness and compactness may seem to be at odds, since robustness requires generalization across domains,…

Machine Learning · Computer Science 2024-03-14 Anna Bair , Hongxu Yin , Maying Shen , Pavlo Molchanov , Jose Alvarez

Weight pruning methods for deep neural networks (DNNs) have been investigated recently, but prior work in this area is mainly heuristic, iterative pruning, thereby lacking guarantees on the weight reduction ratio and convergence time. To…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Tianyun Zhang , Shaokai Ye , Kaiqi Zhang , Jian Tang , Wujie Wen , Makan Fardad , Yanzhi Wang

In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer vision applications,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Tejas Borkar , Lina Karam

Deep neural networks achieve high prediction accuracy when the train and test distributions coincide. In practice though, various types of corruptions occur which deviate from this setup and cause severe performance degradations. Few…

Machine Learning · Computer Science 2023-05-30 Theodoros Tsiligkaridis , Athanasios Tsiligkaridis

Data augmentation has been widely used to improve generalization in training deep neural networks. Recent works show that using worst-case transformations or adversarial augmentation strategies can significantly improve the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Liang Xiao , Jiaolong Xu , Dawei Zhao , Erke Shang , Qi Zhu , Bin Dai

Most existing works focus on improving robustness against adversarial attacks bounded by a single $l_p$ norm using adversarial training (AT). However, these AT models' multiple-norm robustness (union accuracy) is still low, which is crucial…

Machine Learning · Computer Science 2024-09-24 Enyi Jiang , Gagandeep Singh

There is widespread interest in emerging technologies, especially resistive crossbars for accelerating Deep Neural Networks (DNNs). Resistive crossbars offer a highly-parallel and efficient matrix-vector-multiplication (MVM) operation. MVM…

Emerging Technologies · Computer Science 2019-07-02 Amogh Agrawal , Chankyu Lee , Kaushik Roy