English
Related papers

Related papers: Enhancing Generalization of Universal Adversarial …

200 papers

The stochastic gradient descent (SGD) method and its variants are algorithms of choice for many Deep Learning tasks. These methods operate in a small-batch regime wherein a fraction of the training data, say $32$-$512$ data points, is…

Machine Learning · Computer Science 2017-02-13 Nitish Shirish Keskar , Dheevatsa Mudigere , Jorge Nocedal , Mikhail Smelyanskiy , Ping Tak Peter Tang

The blooming of social media and face recognition (FR) systems has increased people's concern about privacy and security. A new type of adversarial privacy cloak (class-universal) can be applied to all the images of regular users, to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Xuannan Liu , Yaoyao Zhong , Weihong Deng , Hongzhi Shi , Xingchen Cui , Yunfeng Yin , Dongchao Wen

Deep Neural Networks (DNNs) are vulnerable to adversarial examples which would inveigle neural networks to make prediction errors with small perturbations on the input images. Researchers have been devoted to promoting the research on the…

Machine Learning · Computer Science 2021-08-30 Jun Yan , Xiaoyang Deng , Huilin Yin , Wancheng Ge

Stochastic Gradient Descent (SGD) is a workhorse in machine learning, yet its slow convergence can be a computational bottleneck. Variance reduction techniques such as SAG, SVRG and SAGA have been proposed to overcome this weakness,…

Machine Learning · Computer Science 2016-02-29 Thomas Hofmann , Aurelien Lucchi , Simon Lacoste-Julien , Brian McWilliams

Despite their impressive performance, deep neural networks (DNNs) are widely known to be vulnerable to adversarial attacks, which makes it challenging for them to be deployed in security-sensitive applications, such as autonomous driving.…

Machine Learning · Computer Science 2020-10-09 Philipp Benz , Chaoning Zhang , Tooba Imtiaz , In So Kweon

Universal adversarial perturbations (UAPs) have garnered significant attention due to their ability to undermine deep neural networks across multiple inputs using a single noise pattern. Evolutionary algorithms offer a promising approach to…

Machine Learning · Computer Science 2026-01-21 Shiqi Wang , Mahdi Khosravy , Neeraj Gupta , Olaf Witkowski

The booming interest in adversarial attacks stems from a misalignment between human vision and a deep neural network (DNN), i.e. a human imperceptible perturbation fools the DNN. Moreover, a single perturbation, often called universal…

Machine Learning · Computer Science 2021-02-15 Chaoning Zhang , Philipp Benz , Adil Karjauv , In So Kweon

Adaptive gradient methods, which adopt historical gradient information to automatically adjust the learning rate, despite the nice property of fast convergence, have been observed to generalize worse than stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2020-06-24 Jinghui Chen , Dongruo Zhou , Yiqi Tang , Ziyan Yang , Yuan Cao , Quanquan Gu

As Segment Anything Model (SAM) becomes a popular foundation model in computer vision, its adversarial robustness has become a concern that cannot be ignored. This works investigates whether it is possible to attack SAM with image-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Dongshen Han , Chaoning Zhang , Sheng Zheng , Chang Lu , Yang Yang , Heng Tao Shen

Universal Adversarial Perturbations (UAPs) are imperceptible, image-agnostic vectors that cause deep neural networks (DNNs) to misclassify inputs with high probability. In practical attack scenarios, adversarial perturbations may undergo…

Machine Learning · Computer Science 2023-06-07 Changming Xu , Gagandeep Singh

In the graph domain, deep graph networks based on Message Passing Neural Networks (MPNNs) or Graph Transformers often cause over-smoothing of node features, limiting their expressive capacity. Many upsampling techniques involving node and…

Machine Learning · Computer Science 2026-02-03 Xiaotang Wang , Yun Zhu , Haizhou Shi , Yongchao Liu , Yongqi Zhang

While deep learning models have achieved remarkable success in time series forecasting, their vulnerability to adversarial examples remains a critical security concern. However, existing attack methods in the forecasting field typically…

Machine Learning · Computer Science 2026-02-13 Ruixian Su , Yukun Bao , Xinze Zhang

Variance reduction (VR) methods employ stochastic gradients with decreasing variance, and they have been widely applied to solve large-scale optimization problems in machine learning because of their efficiency. Existing theoretical studies…

Machine Learning · Computer Science 2026-05-28 Yunwen Lei , Zimeng Wang , Xiaoming Yuan

Universal adversarial perturbations (UAPs), a.k.a. input-agnostic perturbations, has been proved to exist and be able to fool cutting-edge deep learning models on most of the data samples. Existing UAP methods mainly focus on attacking…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Jie Li , Rongrong Ji , Hong Liu , Xiaopeng Hong , Yue Gao , Qi Tian

Graph neural networks (GNNs) are a class of effective deep learning models for node classification tasks; yet their predictive capability may be severely compromised under adversarially designed unnoticeable perturbations to the graph…

Machine Learning · Computer Science 2023-01-05 Xiao Zang , Jie Chen , Bo Yuan

Deep Neural Networks (DNNs) are susceptible to elaborately designed perturbations, whether such perturbations are dependent or independent of images. The latter one, called Universal Adversarial Perturbation (UAP), is very attractive for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Zhixing Ye , Xinwen Cheng , Xiaolin Huang

Universal adversarial attacks, which hinder most deep neural network (DNN) tasks using only a small single perturbation called a universal adversarial perturbation (UAP), is a realistic security threat to the practical application of a DNN.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Kazuki Koga , Kazuhiro Takemoto

Improving the generalization ability of modern deep neural networks (DNNs) is a fundamental challenge in machine learning. Two branches of methods have been proposed to seek flat minima and improve generalization: one led by sharpness-aware…

Machine Learning · Computer Science 2024-04-02 Tao Li , Qinghua Tao , Weihao Yan , Zehao Lei , Yingwen Wu , Kun Fang , Mingzhen He , Xiaolin Huang

Deep neural networks (DNNs) have significantly boosted the performance of many challenging tasks. Despite the great development, DNNs have also exposed their vulnerability. Recent studies have shown that adversaries can manipulate the…

Cryptography and Security · Computer Science 2024-08-06 Liang-bo Ning , Zeyu Dai , Wenqi Fan , Jingran Su , Chao Pan , Luning Wang , Qing Li

Deep neural networks often suffer from poor performance or even training failure due to the ill-conditioned problem, the vanishing/exploding gradient problem, and the saddle point problem. In this paper, a novel method by acting the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mei Liu , Liangming Chen , Xiaohao Du , Long Jin , Mingsheng Shang