English
Related papers

Related papers: Fast Gradient Non-sign Methods

200 papers

Recent developments in the filed of Deep Learning have demonstrated that Deep Neural Networks(DNNs) are vulnerable to adversarial examples. Specifically, in image classification, an adversarial example can fool the well trained deep neural…

Machine Learning · Computer Science 2021-01-26 Xunguang Wang , Ship Peng Xu , Eric Ke Wang

Signed graphs are well-suited for modeling social networks as they capture both positive and negative relationships. Signed graph neural networks (SGNNs) are commonly employed to predict link signs (i.e., positive and negative) in such…

Cryptography and Security · Computer Science 2024-05-14 Jialong Zhou , Yuni Lai , Jian Ren , Kai Zhou

The ubiquity of deep neural networks (DNNs), cloud-based training, and transfer learning is giving rise to a new cybersecurity frontier in which unsecure DNNs have `structural malware' (i.e., compromised weights and activation pathways). In…

Machine Learning · Computer Science 2021-02-05 N. Benjamin Erichson , Dane Taylor , Qixuan Wu , Michael W. Mahoney

Understanding the asymptotic behavior of gradient-descent training of deep neural networks is essential for revealing inductive biases and improving network performance. We derive the infinite-time training limit of a mathematically…

Machine Learning · Statistics 2022-02-08 Samuel Lippl , L. F. Abbott , SueYeon Chung

Federated learning (FL) has emerged as a prominent distributed learning paradigm. FL entails some pressing needs for developing novel parameter estimation approaches with theoretical guarantees of convergence, which are also communication…

Machine Learning · Computer Science 2024-01-24 Richeng Jin , Yufan Huang , Xiaofan He , Huaiyu Dai , Tianfu Wu

Fairness-aware graph neural networks (GNNs) have gained a surge of attention as they can reduce the bias of predictions on any demographic group (e.g., female) in graph-based applications. Although these methods greatly improve the…

Machine Learning · Computer Science 2024-03-05 Binchi Zhang , Yushun Dong , Chen Chen , Yada Zhu , Minnan Luo , Jundong Li

Solving for adversarial examples with projected gradient descent has been demonstrated to be highly effective in fooling the neural network based classifiers. However, in the black-box setting, the attacker is limited only to the query…

Machine Learning · Computer Science 2022-10-19 Seungyong Moon , Gaon An , Hyun Oh Song

Deep neural networks (DNNs) have shown vulnerability to adversarial attacks, i.e., carefully perturbed inputs designed to mislead the network at inference time. Recently introduced localized attacks, Localized and Visible Adversarial Noise…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Muzammal Naseer , Salman H. Khan , Fatih Porikli

Automatic modulation classification (AMC) using the Deep Neural Network (DNN) approach outperforms the traditional classification techniques, even in the presence of challenging wireless channel environments. However, the adversarial…

Machine Learning · Computer Science 2022-06-01 Eyad Shtaiwi , Ahmed El Ouadrhiri , Majid Moradikia , Salma Sultana , Ahmed Abdelhadi , Zhu Han

Spiking Neural Networks (SNNs) have attracted growing interest in both computational neuroscience and artificial intelligence, primarily due to their inherent energy efficiency and compact memory footprint. However, achieving adversarial…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

This chapter introduces the concept of adversarial attacks on image classification models built on convolutional neural networks (CNN). CNNs are very popular deep-learning models which are used in image classification tasks. However, very…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jaydip Sen , Subhasis Dasgupta

After the discovery of adversarial examples and their adverse effects on deep learning models, many studies focused on finding more diverse methods to generate these carefully crafted samples. Although empirical results on the effectiveness…

Machine Learning · Computer Science 2020-06-03 Utku Ozbulak , Manvel Gasparyan , Wesley De Neve , Arnout Van Messem

While adaptive gradient methods are the workhorse of modern machine learning, sign-based optimization algorithms such as Lion and Muon have recently demonstrated superior empirical performance over AdamW in training large language models…

Machine Learning · Computer Science 2026-05-11 Dingzhi Yu , Hongyi Tao , Yuanyu Wan , Luo Luo , Lijun Zhang

Policy-gradient methods are widely used in reinforcement learning, yet training often becomes unstable or slows down as learning progresses. We study this phenomenon through the noise-to-signal ratio (NSR) of a policy-gradient estimator,…

Optimization and Control · Mathematics 2026-02-10 Haoyu Han , Heng Yang

Interpretability is crucial to understand the inner workings of deep neural networks (DNNs) and many interpretation methods generate saliency maps that highlight parts of the input image that contribute the most to the prediction made by…

Cryptography and Security · Computer Science 2022-07-21 Shihong Fang , Anna Choromanska

Security-sensitive applications that rely on Deep Neural Networks (DNNs) are vulnerable to small perturbations that are crafted to generate Adversarial Examples(AEs). The AEs are imperceptible to humans and cause DNN to misclassify them.…

Cryptography and Security · Computer Science 2021-06-22 Ahmed Aldahdooh , Wassim Hamidouche , Olivier Déforges

Graph Neural Networks (GNNs) have emerged as the dominant approach for machine learning on graph-structured data. However, concerns have arisen regarding the vulnerability of GNNs to small adversarial perturbations. Existing defense methods…

Machine Learning · Computer Science 2024-02-22 Sofiane Ennadir , Yassine Abbahaddou , Johannes F. Lutzeyer , Michalis Vazirgiannis , Henrik Boström

The path signature, having enjoyed recent success in the machine learning community, is a theoretically-driven method for engineering features from irregular paths. On the other hand, graph neural networks (GNN), neural architectures for…

Machine Learning · Computer Science 2024-02-07 Hans Riess , Manolis Veveakis , Michael M. Zavlanos

Deep neural networks (DNN)-based machine learning (ML) algorithms have recently emerged as the leading ML paradigm particularly for the task of classification due to their superior capability of learning efficiently from large datasets. The…

Machine Learning · Computer Science 2018-11-06 Faiq Khalid , Muhammmad Abdullah Hanif , Semeen Rehman , Junaid Qadir , Muhammad Shafique

High cost of training time caused by multi-step adversarial example generation is a major challenge in adversarial training. Previous methods try to reduce the computational burden of adversarial training using single-step adversarial…

Machine Learning · Computer Science 2021-02-09 Lehui Xie , Yaopeng Wang , Jia-Li Yin , Ximeng Liu